Skip to content

[PyTorch] Preserve FP8 scaling factors for attention backward - #1597

Closed
cyanguwa wants to merge 1 commit into
NVIDIA:mainfrom
cyanguwa:save_qkv_scales_for_bwd
Closed

[PyTorch] Preserve FP8 scaling factors for attention backward#1597
cyanguwa wants to merge 1 commit into
NVIDIA:mainfrom
cyanguwa:save_qkv_scales_for_bwd

clone fp8 tensors to preserve scaling factors between fwd/bwd

c9df446
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs