ReLU#
ReLU applies following formula on every element of src tensor (the variable names follow the standard Conventions):
\[\begin{split}\dst = \begin{cases} \src & \text{if}\ \src > 0 \\
     0 & \text{if}\ \src \leq 0 \end{cases}\end{split}\]
Operation Attributes#
ReLU operation does not support any attribute.
Execution Arguments#
The inputs and outputs must be provided according to the below index order when constructing an operation.
Inputs#
Index  | 
Argument Name  | 
Required or Optional  | 
|---|---|---|
0  | 
  | 
Required  | 
Outputs#
Index  | 
Argument Name  | 
Required or Optional  | 
|---|---|---|
0  | 
  | 
Required  | 
Supported Data Types#
ReLU operation supports the following data type combinations.
Src  | 
Dst  | 
|---|---|
f32  | 
f32  | 
bf16  | 
bf16  | 
f16  | 
f16  |