Cut a release branch for stable GPU runs WIP#522

Draft

chajath wants to merge 10 commits into

mainfrom

maxtext-gpu-release-rc

Commits on Feb 28, 2024

Commits on Feb 29, 2024

Refactor the code for MaxText training on H100 GPUs via XPK.
yangyuwei
committed

Commits on Mar 13, 2024

Fix the issue of creating 8 processes per GPU.
yangyuwei
committed
Fix the issue of creating 8 processes per GPU for gpu_multi_process_run.sh
yangyuwei
committed

Commits on Mar 14, 2024

Commits on Mar 15, 2024

Revert "Fix the issue of creating 8 processes per GPU."
chajath
committed

Commits on Mar 26, 2024

Allow overriding NCCL_FASTRAK_NUM_FLOWS
chajath
committed