Unary Fusion Patterns

Unary Fusion Patterns#

Overview#

oneDNN supports various unary fusion patterns to optimize performance and reduce memory bandwidth requirements. This document describes the supported fusion patterns for Unary operations.

Pattern Structure#

oneDNN defines floating-point Unary fusion patterns as follows. The blue nodes are required when defining a Unary fusion pattern while the brown nodes are optional.

Unary pattern

  1. Unary Operation : Performs the corresponding unary operation for the src tensor. Refer to the Note in Fusion Patterns.

  2. Epilogue Subgraph : Optional and can include the following operations:

    • Unary operations.

    • Binary operations: refer to the Note in Fusion Patterns.

    Combination Rules:

    epilogue subgraph

    • 0 to 4 Binary or Unary operations are supported in the epilogue subgraph.

Data Types#

oneDNN supports the following combinations of data types for src and dst:

src

dst

f32,bf16,f16

f32,bf16,f16

The definition of the data types and support status on different CPU and GPU platforms follow the general description in the Data Types Guide.

Contents