Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
NVIDIA
/
TransformerEngine
Public
Notifications
You must be signed in to change notification settings
Fork
797
Star
3.5k
Code
Issues
158
Pull requests
160
Discussions
Actions
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Security and quality
Insights
Generalized Tensor Parallelism (GTP)
- #3005
#3005
Merged
timmoon10
merged 19 commits into
NVIDIA:main
NVIDIA/TransformerEngine:main
from
fanshiqing:gtp_release
fanshiqing/TransformerEngine:gtp_release
Copy head branch name to clipboard
Jul 22, 2026
Conversation
Commits
19
(19)
Checks
Files changed
Merged
Generalized Tensor Parallelism (GTP)
#3005
timmoon10
merged 19 commits into
NVIDIA:main
NVIDIA/TransformerEngine:main
from
fanshiqing:gtp_release
fanshiqing/TransformerEngine:gtp_release
Copy head branch name to clipboard
Commits
Commits on May 25, 2026
Generalized Tensor Parallelism (GTP) init commit
Show description for 43a6cea
fanshiqing
and
jiemingz
committed
43a6cea
View commit details
Copy full SHA for 43a6cea
Browse repository at this point
Commits on Jun 1, 2026
Merge remote-tracking branch 'origin/main' into gtp_release
Show description for a7d0925
fanshiqing
committed
a7d0925
View commit details
Copy full SHA for a7d0925
Browse repository at this point
Commits on Jun 4, 2026
GTP + gmm fusion
Show description for a532120
fanshiqing
committed
a532120
View commit details
Copy full SHA for a532120
Browse repository at this point
Commits on Jun 14, 2026
Merge remote-tracking branch 'origin' into gtp_release
Show description for 2b26b69
fanshiqing
committed
2b26b69
View commit details
Copy full SHA for 2b26b69
Browse repository at this point
[fix] Respect per-op activation-offload markers in fused grouped MLP
Show description for 8bb26f0
fanshiqing
committed
8bb26f0
View commit details
Copy full SHA for 8bb26f0
Browse repository at this point
Commits on Jun 23, 2026
Merge commit '4130d73e' into gtp_gmm_fusion
Show description for b7c1595
fanshiqing
committed
b7c1595
View commit details
Copy full SHA for b7c1595
Browse repository at this point
Commits on Jun 27, 2026
Code clean: rename GTP weight-sharding axis to gtp_remat
Show description for 8aaa5a1
fanshiqing
committed
8aaa5a1
View commit details
Copy full SHA for 8aaa5a1
Browse repository at this point
[pre-commit.ci] auto fixes from pre-commit.com hooks
Show description for 48d5413
pre-commit-ci[bot]
committed
48d5413
View commit details
Copy full SHA for 48d5413
Browse repository at this point
Commits on Jul 6, 2026
Revert "[fix] Respect per-op activation-offload markers in fused grouped MLP"
Show description for 5f1cd62
fanshiqing
committed
5f1cd62
View commit details
Copy full SHA for 5f1cd62
Browse repository at this point
Make TE GTP-agnostic at construction
Show description for 96ef071
fanshiqing
committed
96ef071
View commit details
Copy full SHA for 96ef071
Browse repository at this point
Commits on Jul 13, 2026
GTP+nvfp4: fix GTP backward GEMM scaling-mode mismatch for bf16-gathered weights
Show description for 5252b0e
fanshiqing
committed
5252b0e
View commit details
Copy full SHA for 5252b0e
Browse repository at this point
Make TE runtime GTP-agnostic via a DistributedWeight protocol
Show description for e59a054
fanshiqing
committed
e59a054
View commit details
Copy full SHA for e59a054
Browse repository at this point
Commits on Jul 14, 2026
Code clean
Show description for de9dc81
fanshiqing
committed
de9dc81
View commit details
Copy full SHA for de9dc81
Browse repository at this point
Simplify the NVFP4 gather post-process; Materialize the EGTP FC1 weight before the NVFP4 dgrad dispatch
Show description for 0f7226e
fanshiqing
committed
0f7226e
View commit details
Copy full SHA for 0f7226e
Browse repository at this point
Commits on Jul 15, 2026
Code clean
Show description for c256929
fanshiqing
committed
c256929
View commit details
Copy full SHA for c256929
Browse repository at this point
Commits on Jul 16, 2026
Merge remote-tracking branch 'origin' into gtp_release
Show description for d09d3b5
fanshiqing
committed
d09d3b5
View commit details
Copy full SHA for d09d3b5
Browse repository at this point
Commits on Jul 17, 2026
fix comments
Show description for ae56984
fanshiqing
committed
ae56984
View commit details
Copy full SHA for ae56984
Browse repository at this point
Commits on Jul 20, 2026
Support DistributedWeight in the fusible grouped-linear ops path
Show description for aad67cc
fanshiqing
committed
aad67cc
View commit details
Copy full SHA for aad67cc
Browse repository at this point
Unify distributed-weight wgrad finalize to return a graph-safe dummy
Show description for 4d29de3
fanshiqing
committed
4d29de3
View commit details
Copy full SHA for 4d29de3
Browse repository at this point
You can’t perform that action at this time.
![pre-commit-ci[bot]](https://avatars.githubusercontent.com/in/68672?v=4&size=32){kind=avatar}