Skip to content

[FRONTEND][ONNX] Extend axes for layer_norm when gamma/beta are multi-dimensional#18143

Merged
mshr-h merged 4 commits intoapache:mainfrom
ConvolutedDog:fix-onnx-layernorm
Jul 14, 2025
Merged

[FRONTEND][ONNX] Extend axes for layer_norm when gamma/beta are multi-dimensional#18143
mshr-h merged 4 commits intoapache:mainfrom
ConvolutedDog:fix-onnx-layernorm

Conversation

@ConvolutedDog
Copy link
Copy Markdown
Contributor

This PR fixes #18136, which enhances the layer_norm operator to automatically extend the normalization axes when gamma and beta parameters are multi-dimensional tensors.

  • Key changes:
    • Add shape validation to ensure gamma and beta have matching dimensions
    • Automatically extend the axes list to cover all dimensions of gamma/beta when needed

@mshr-h mshr-h merged commit 359e05e into apache:main Jul 14, 2025
10 checks passed
ShiboXing pushed a commit to ShiboXing/tvm that referenced this pull request Aug 10, 2025
…-dimensional (apache#18143)

* Extend axes for layer_norm when gamma/beta are multi-dimensional

* Add testcase for layer_norm when gamma/beta are multi-dimensional

* fix lint

* fix lint
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

2 participants