[PyTorch] Add CUDA graph tests with FP8 weight caching - #869

Merged

timmoon10 merged 6 commits into

NVIDIA:mainfrom

timmoon10:debug-cuda-graph-microbatching

Jun 3, 2024

Commits on May 24, 2024

Modify CUDA graph tests to use grad accumulation steps
timmoon10
committed
718996c

Commits on May 25, 2024

Initialize grad buffers before capturing CUDA graph in CUDA graph tests
timmoon10
committed
ab5eb38
Only use BS=2 in CUDA graph tests
timmoon10
committed
4107434
Merge branch 'main' into debug-cuda-graph-microbatching
timmoon10
authored
4b97bc0

Commits on Jun 3, 2024

Update tests/pytorch/test_cuda_graphs.py
timmoon10
authored
204436d
Merge branch 'main' into debug-cuda-graph-microbatching
timmoon10
authored
0030f7e