megengine.functional.nn.gelu

gelu(x)[source]

Applies the element-wise function:

\[\text{gelu}(x) = x\Phi(x)\]

where \(\Phi(x)\) is the Cumulative Distribution Function for Gaussian Distribution.

previous

megengine.functional.nn.silu

next

megengine.functional.nn.softplus