GELU#
General#
GELU operation applies following formula on every element of \(\src\) tensor (the variable names follow the standard Naming Conventions):
\[dst = 0.5 * src * (1.0 + erf(src) / \sqrt2)\]
Operation attributes#
GELU operation does not support any attribute.
Execution arguments#
The inputs and outputs must be provided according to below index order when constructing an operation.
Inputs#
Index |
Argument Name |
Required or Optional |
|---|---|---|
0 |
|
Required |
Outputs#
Index |
Argument Name |
Required or Optional |
|---|---|---|
0 |
|
Required |
Supported data types#
GELU operation supports the following data type combinations.
Src |
Dst |
|---|---|
f32 |
f32 |
f16 |
f16 |
bf16 |
bf16 |