Skip to content

nvrtc MXFP8 kernels - #3302

Draft
CarlosGomes98 wants to merge 4 commits into
NVIDIA:mainfrom
CarlosGomes98:cgomes/nvrtc-quantize-mxfp8
Draft

nvrtc MXFP8 kernels#3302
CarlosGomes98 wants to merge 4 commits into
NVIDIA:mainfrom
CarlosGomes98:cgomes/nvrtc-quantize-mxfp8

Conversation

@CarlosGomes98

Copy link
Copy Markdown
Contributor

Description

Migrate mxfp8 quantization kernels to nvrtc. #3054

This ended up not providing much of a build time advantage. However, it enables an example of run-time kernel specialization which we can do with NVRTC.

However, it does introduce some code complexity in the dispatch.

Fixes # (issue)

Type of change

  • Documentation change (change only to the documentation, either a fix or a new content)
  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Infra/Build change
  • Code refactoring

Changes

Please list the changes introduced in this PR:

  • Change A
  • Change B

Checklist:

  • I have read and followed the contributing guidelines
  • The functionality is complete
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes

Signed-off-by: CarlosGomes98 <carlosmiguel.gomes@live.com.pt>
Signed-off-by: CarlosGomes98 <carlosmiguel.gomes@live.com.pt>
Signed-off-by: CarlosGomes98 <carlosmiguel.gomes@live.com.pt>
@github-actions github-actions Bot added the community-contribution PRs from external contributor outside the core maintainers, representing community-driven work. label Aug 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contribution PRs from external contributor outside the core maintainers, representing community-driven work.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant