[PyTorch] Integration test for Megatron-LM - #1329

Merged

timmoon10 merged 7 commits into

NVIDIA:mainfrom

timmoon10:debug-mcore-norm

Nov 21, 2024

Commits on Nov 12, 2024

Handle deprecated `hidden_size` arg in norm modules
timmoon10
committed
6e5d1e0
Support initializing norm ops on CPU
timmoon10
committed
4cf53ad
Add integration test for Megatron-LM
timmoon10
committed
610a5d3

Commits on Nov 13, 2024

[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
79e9fa8
Rename Mcore integration test
timmoon10
committed
49a8f3c

Commits on Nov 15, 2024

Merge branch 'main' into debug-mcore-norm
timmoon10
authored
1014133

Commits on Nov 21, 2024

Handle case in RMSNorm where hidden dim is not provided
timmoon10
committed
c462c63