ReLUBackward

General

ReLUBackward operation computes gradient for ReLU.

Operation attributes

Attribute Name	Description	Value Type	Supported Values	Required or Optional
use_dst	If true, use dst of ReLU operation to calculate the gradient. Otherwise, use src .	bool	true (default), false	Optional

Execution arguments

The inputs and outputs must be provided according to below index order when constructing an operation.

Inputs

Index	Argument Name	Required or Optional
0	src / dst	Required
1	diff_dst	Required

Outputs

Index	Argument Name	Required or Optional
0	diff_src	Required

Supported data types

ReLUBackward operation supports the following data type combinations.

Src / Dst	Diff_dst	Diff_src
f32	f32	f32
f16	f16	f16
bf16	bf16	bf16