.. index:: pair: page; BatchNormTrainingBackward .. _doxid-dev_guide_op_batchnormtrainingbackward: BatchNormTrainingBackward ========================= General ~~~~~~~ BatchNormTrainingBackward operation calculated the gradients of input tensors. Operation attributes ~~~~~~~~~~~~~~~~~~~~ ======================================================================================================================== ================================================================ ======= ============================ ========= Attribute Name De ======================================================================================================================== ================================================================ ======= ============================ ========= :ref:`epsilon ` A number to be added to the variance to avoid division by zero. f32 A positive f32 value Required :ref:`data_format ` Controls how to interpret the shape of ``src`` and ``dst`` . string ``NCX`` , ``NXC`` (default) Optional ======================================================================================================================== ================================================================ ======= ============================ ========= Execution arguments ~~~~~~~~~~~~~~~~~~~ The inputs and outputs must be provided according to below index order when constructing an operation. Inputs ------ ====== =============================== ========= Index Argu ====== =============================== ========= 0 ``src`` Required 1 ``diff_dst`` Required 2 ``mean`` Required 3 ``variance`` Required 4 ``gamma`` ( :math:`\sigma^2` ) Optional ====== =============================== ========= Outputs ------- ====== =============== ========= Index Argu ====== =============== ========= 0 ``diff_src`` Required 1 ``diff_gamma`` Optional 2 ``diff_beta`` Optional ====== =============== ========= .. note:: ``diff_gamma`` and ``diff_beta`` should be either both provided or neither provided. If neither provided, the input ``gamma`` will be ignored. Supported data types ~~~~~~~~~~~~~~~~~~~~ BatchNormTrainingBackward operation supports the following data type combinations. ====== ========== Src / ====== ========== f32 f32 bf16 f32, bf16 f16 f32 ====== ==========