Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
NVIDIA
/
TransformerEngine
Public
Notifications
You must be signed in to change notification settings
Fork
796
Star
3.5k
Code
Issues
156
Pull requests
160
Discussions
Actions
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Security and quality
Insights
[PyTorch] Refactor FP8 workspaces in linear modules
- #820
#820
Merged
timmoon10
merged 22 commits into
NVIDIA:main
NVIDIA/TransformerEngine:main
from
timmoon10:fp8-workspace-refactor
timmoon10/TransformerEngine:fp8-workspace-refactor
Copy head branch name to clipboard
May 30, 2024
Conversation
Commits
22
(22)
Checks
Files changed
Merged
[PyTorch] Refactor FP8 workspaces in linear modules
#820
timmoon10
merged 22 commits into
NVIDIA:main
NVIDIA/TransformerEngine:main
from
timmoon10:fp8-workspace-refactor
timmoon10/TransformerEngine:fp8-workspace-refactor
Copy head branch name to clipboard
Commits
Commits on Apr 26, 2024
Initial refactor of FP8 workspaces in Linear module
Show description for 9d15d66
timmoon10
committed
9d15d66
View commit details
Copy full SHA for 9d15d66
Browse repository at this point
Remove extra kernel launch
Show description for d482d7f
timmoon10
committed
d482d7f
View commit details
Copy full SHA for d482d7f
Browse repository at this point
Minor perf optimizations
Show description for ddad776
timmoon10
committed
ddad776
View commit details
Copy full SHA for ddad776
Browse repository at this point
Debug FP8 recipe test
Show description for cbd241e
timmoon10
committed
cbd241e
View commit details
Copy full SHA for cbd241e
Browse repository at this point
Commits on Apr 27, 2024
Refactor FP8 workspaces in LayerNormLinear and LayerNormMLP
Show description for bca47c0
timmoon10
committed
bca47c0
View commit details
Copy full SHA for bca47c0
Browse repository at this point
Merge branch 'main' into fp8-workspace-refactor
timmoon10
committed
061956f
View commit details
Copy full SHA for 061956f
Browse repository at this point
Document FP8 workspace function
Show description for aacba88
timmoon10
committed
aacba88
View commit details
Copy full SHA for aacba88
Browse repository at this point
Commits on Apr 29, 2024
Merge branch 'main' into fp8-workspace-refactor
timmoon10
committed
e6698fb
View commit details
Copy full SHA for e6698fb
Browse repository at this point
Commits on May 14, 2024
Merge branch 'main' into fp8-workspace-refactor
Show description for 98e64c7
timmoon10
committed
98e64c7
View commit details
Copy full SHA for 98e64c7
Browse repository at this point
Revert changes to FP8 recipe tests
Show description for 03caf40
timmoon10
committed
03caf40
View commit details
Copy full SHA for 03caf40
Browse repository at this point
Commits on May 15, 2024
Add support for lazy FP8 transpose caching
Show description for 78e3035
timmoon10
committed
78e3035
View commit details
Copy full SHA for 78e3035
Browse repository at this point
Fix Pylint warnings
Show description for b43b9fe
timmoon10
committed
b43b9fe
View commit details
Copy full SHA for b43b9fe
Browse repository at this point
Commits on May 16, 2024
Debug ONNX export
Show description for 7ec703b
timmoon10
committed
7ec703b
View commit details
Copy full SHA for 7ec703b
Browse repository at this point
Debug fused attention tests
Show description for c8e7a1e
timmoon10
committed
c8e7a1e
View commit details
Copy full SHA for c8e7a1e
Browse repository at this point
Commits on May 20, 2024
Merge branch 'main' into fp8-workspace-refactor
Show description for f0e796b
timmoon10
committed
f0e796b
View commit details
Copy full SHA for f0e796b
Browse repository at this point
Commits on May 21, 2024
Merge branch 'main' into fp8-workspace-refactor
timmoon10
authored
320a441
View commit details
Copy full SHA for 320a441
Browse repository at this point
Make sure Float8Tensor.transpose_2d is backward compatible
Show description for 2f85a8c
timmoon10
committed
2f85a8c
View commit details
Copy full SHA for 2f85a8c
Browse repository at this point
Merge branch 'main' into fp8-workspace-refactor
timmoon10
authored
4486ab3
View commit details
Copy full SHA for 4486ab3
Browse repository at this point
Commits on May 22, 2024
Revert changes to ONNX export operations
Show description for 4fdd63c
timmoon10
committed
4fdd63c
View commit details
Copy full SHA for 4fdd63c
Browse repository at this point
Merge branch 'main' into fp8-workspace-refactor
timmoon10
authored
559b854
View commit details
Copy full SHA for 559b854
Browse repository at this point
Commits on May 28, 2024
Debug scale factor update in Float8Tensor transpose_2d
Show description for 4c3d7f8
timmoon10
committed
4c3d7f8
View commit details
Copy full SHA for 4c3d7f8
Browse repository at this point
Merge branch 'main' into fp8-workspace-refactor
Show description for a0c8505
timmoon10
committed
a0c8505
View commit details
Copy full SHA for a0c8505
Browse repository at this point
You can’t perform that action at this time.
