SoftPlus

SoftPlus operation applies following formula on every element of src tensor (the variable names follow the standard Conventions):

\[\dst = 1 / \operatorname{beta} \* \ln(e^{\operatorname{beta}*\src} + 1.0)\]

Operation Attributes

Attribute Name	Description	Value Type	Supported Values	Required or Optional
beta	Value for the SoftPlus formulation.	s64	Arbitrary s64 value (1 in default)	Optional

Execution Arguments

The inputs and outputs must be provided according to the below index order when constructing an operation.

Inputs

Index	Argument Name	Required or Optional
0	src	Required

Outputs

Index	Argument Name	Required or Optional
0	dst	Required

Supported Data Types

SoftPlus operation supports the following data type combinations.

Src	Dst
f32	f32
bf16	bf16
f16	f16