repository

Contents

MishBackward

General

MishBackward operation computes gradient for Mish.

$$\begin{array}{rl}dst& =dif{f}_{dst}\ast \frac{e^{src}\ast \omega }{{\delta }^2},where\\ \omega & =e^{3src}+4\ast e^{2src}+e^{src}\ast (4\ast src+6)+4\ast (src+1)\\ \delta & =e^{2src}+2\ast e^{src}+2\end{array}$$

Operation attributes

MishBackward operation does not support any attribute.

Execution arguments

The inputs and outputs must be provided according to below index order when constructing an operation.

Inputs

Index	Argument Name	Required or Optional
0	src	Required
1	diff_dst	Required

Outputs

Index	Argument Name	Required or Optional
0	diff_src	Required

Supported data types

MishBackward operation supports the following data type combinations.

Src	Diff_dst	Diff_src
f32	f32	f32
f16	f16	f16
bf16	bf16	bf16

Mish Multiply