megengine.functional.nn.gelu¶

Applies the element-wise function:

\[\text{gelu}(x) = x\Phi(x)\]

where \(\Phi(x)\) is the Cumulative Distribution Function for Gaussian Distribution.

megengine.functional.nn.silu

megengine.functional.nn.softplus