Skip to content

[Dlight] Scheduling Low batch GEMM using GEMV-like rule #16579

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jinhongyii merged 8 commits into from
Feb 21, 2024
Merged

[Dlight] Scheduling Low batch GEMM using GEMV-like rule #16579

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
772e1f0
low batch
jinhongyii Feb 15, 2024
34ee0a3
fix
jinhongyii Feb 15, 2024
12192da
fix lint
jinhongyii Feb 15, 2024
cd3761b
do dequantize only once
jinhongyii Feb 19, 2024
9f612ef
change default
jinhongyii Feb 20, 2024
b14dfa1
add test
jinhongyii Feb 20, 2024
b06d9fe
fix lint
jinhongyii Feb 20, 2024
75b49fe
fix lint
jinhongyii Feb 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions python/tvm/dlight/gpu/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@
For CUDA/ROCm/Vulkan/Metal-specific rules, use `tvm.dlight.cuda/rocm/vulkan/metal` instead
"""
from .gemv import GEMV
from .low_batch_gemv import LowBatchGEMV
from .fallback import Fallback
from .matmul import Matmul
from .reduction import Reduction
Expand Down
Loading