SoftPlus#
General#
SoftPlus operation applies following formula on every element of \(\src\) tensor (the variable names follow the standard Naming Conventions):
Operation attributes#
Attribute Name |
Description |
Value Type |
Supported Values ——————- |
Required or Optional |
|---|---|---|---|---|
Value for the SoftPlus formulation. |
f32 |
Arbitrary f32 value ( |
Optional |
Execution arguments#
The inputs and outputs must be provided according to below index order when constructing an operation.
Inputs#
Index |
Argument Name |
Required or Optional |
|---|---|---|
0 |
|
Required |
Outputs#
Index |
Argument Name |
Required or Optional |
|---|---|---|
0 |
|
Required |
Supported data types#
SoftPlus operation supports the following data type combinations.
Src |
Dst |
|---|---|
f32 |
f32 |
bf16 |
bf16 |
f16 |
f16 |
Implementation Notes#
SoftPlus supports in-place operations, meaning that src can be used as both input and output (dst). In case of in-place operation, the original src data will be overwritten. Use in-place operations whenever possible for performance.