Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
NVIDIA
/
TransformerEngine
Public
Notifications
You must be signed in to change notification settings
Fork
795
Star
3.5k
Code
Issues
157
Pull requests
158
Discussions
Actions
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Security and quality
Insights
[PyTorch][torch.compile] Support for UnfusedDotProductAttention
- #3201
#3201
Merged
pggPL
merged 15 commits into
NVIDIA:main
NVIDIA/TransformerEngine:main
from
pggPL:unfused_dpa_torch_compile
pggPL/TransformerEngine:unfused_dpa_torch_compile
Copy head branch name to clipboard
Jul 24, 2026
Conversation
Commits
15
(15)
Checks
Files changed
Merged
[PyTorch][torch.compile] Support for UnfusedDotProductAttention
#3201
pggPL
merged 15 commits into
NVIDIA:main
NVIDIA/TransformerEngine:main
from
pggPL:unfused_dpa_torch_compile
pggPL/TransformerEngine:unfused_dpa_torch_compile
Copy head branch name to clipboard
Commits
Commits on Jun 25, 2026
[PyTorch] Make UnfusedDotProductAttention compatible with torch.compile + CUDA graphs
Show description for 4cba8bc
pggPL
committed
4cba8bc
View commit details
Copy full SHA for 4cba8bc
Browse repository at this point
Commits on Jul 8, 2026
Merge branch 'main' of https://github.com/NVIDIA/TransformerEngine into unfused_attention_torch_compile
Show description for da07306
pggPL
committed
da07306
View commit details
Copy full SHA for da07306
Browse repository at this point
[PyTorch] torch.compile support for the FP8-emulation path of UnfusedDotProductAttention
Show description for 5190150
pggPL
committed
5190150
View commit details
Copy full SHA for 5190150
Browse repository at this point
[PyTorch] Run UnfusedDotProductAttention as an eager island when fp8_output=True
Show description for 15cbcd1
pggPL
committed
15cbcd1
View commit details
Copy full SHA for 15cbcd1
Browse repository at this point
[PyTorch] Test FP8-emulation compile path also with reduce-overhead (cudagraphs)
Show description for 8bd9881
pggPL
committed
8bd9881
View commit details
Copy full SHA for 8bd9881
Browse repository at this point
Commits on Jul 9, 2026
[PyTorch] Drop FP8 torch.compile support in UnfusedDotProductAttention; run FP8 as an eager island
Show description for ac1f2b0
pggPL
committed
ac1f2b0
View commit details
Copy full SHA for ac1f2b0
Browse repository at this point
[PyTorch] Remove te_fp8_emu custom ops; restore upstream FP8EmulationFunc
Show description for fab4dd7
pggPL
committed
fab4dd7
View commit details
Copy full SHA for fab4dd7
Browse repository at this point
[PyTorch] Shorten the total_tokens_q comment
Show description for b310d53
pggPL
committed
b310d53
View commit details
Copy full SHA for b310d53
Browse repository at this point
[PyTorch] Drop _scale_to_tensor; pass the softmax scale as a plain float
Show description for 1c7a5a8
pggPL
committed
1c7a5a8
View commit details
Copy full SHA for 1c7a5a8
Browse repository at this point
[PyTorch] Drop redundant num_tokens comment (rationale documented at the callsite)
Show description for c5a2dff
pggPL
committed
c5a2dff
View commit details
Copy full SHA for c5a2dff
Browse repository at this point
[PyTorch] Review cleanups: black formatting, drop unused import/duplicate dict, silence W0613
Show description for 2de9691
pggPL
committed
2de9691
View commit details
Copy full SHA for 2de9691
Browse repository at this point
Commits on Jul 10, 2026
[pre-commit.ci] auto fixes from pre-commit.com hooks
Show description for 8a7c2e8
pre-commit-ci[bot]
committed
8a7c2e8
View commit details
Copy full SHA for 8a7c2e8
Browse repository at this point
Commits on Jul 23, 2026
Merge remote-tracking branch 'upstream/main' into unfused_dpa_torch_compile
pggPL
committed
00432c3
View commit details
Copy full SHA for 00432c3
Browse repository at this point
[PyTorch] Address review: document Convert{THD,BSHD} apply() arity in docstrings
Show description for 081c96b
pggPL
committed
081c96b
View commit details
Copy full SHA for 081c96b
Browse repository at this point
[PyTorch] Fix UnboundLocalError on thd inference in UnfusedDotProductAttention
Show description for 3847a22
pggPL
committed
3847a22
View commit details
Copy full SHA for 3847a22
Browse repository at this point
You can’t perform that action at this time.