HardSigmoidBackward#
HardSigmoidBackward operation computes gradient for HardSigmoid. The formula is defined as follows:
\[\begin{split}\diffsrc = \begin{cases} \diffdst \cdot \alpha & \text{if}\ 0 < \alpha \src + \beta < 1 \\ 0 & \text{otherwise}\ \end{cases}\end{split}\]
Operation Attributes#
  | 
Description  | 
Value Type  | 
  | 
  | 
|---|---|---|---|---|
\(\alpha\) in the formula.  | 
f32  | 
Arbitrary f32 value  | 
Required  | 
|
\(\beta\) in the formula.  | 
f32  | 
Arbitrary f32 value  | 
Required  | 
Execution Arguments#
The inputs and outputs must be provided according to the below index order when constructing an operation.
Inputs#
Index  | 
Argument Name  | 
Required or Optional  | 
|---|---|---|
0  | 
  | 
Required  | 
1  | 
  | 
Required  | 
Outputs#
Index  | 
Argument Name  | 
Required or Optional  | 
|---|---|---|
0  | 
  | 
Required  | 
Supported Data Types#
HardSigmoidBackward operation supports the following data type combinations.
Src  | 
Diff_dst  | 
Diff_src  | 
|---|---|---|
f32  | 
f32  | 
f32  | 
f16  | 
f16  | 
f16  | 
bf16  | 
bf16  | 
bf16  |