[MetaSchedule] Enhance tune_tir to tune IRModule of TIR Collections#14784
Merged
junrushao merged 1 commit intoapache:mainfrom May 7, 2023
Merged
Conversation
Collaborator
|
Thanks for contributing to TVM! Please refer to the contributing guidelines https://tvm.apache.org/docs/contribute/ for useful information and tips. Please request code reviews from Reviewers by @-ing them in a comment.
Generated by tvm-bot |
This was referenced May 6, 2023
junrushao
force-pushed
the
feature/2023-05-05/tune-tir-module
branch
from
d3a686d to
6aefbc3
Compare
junrushao
changed the title
tune_tir_moduletune_tir to tune IRModule of TIR Collections
tqchen
approved these changes
May 6, 2023
junrushao
force-pushed
the
feature/2023-05-05/tune-tir-module
branch
2 times, most recently
from
95fe8b8 to
25ba3a4
Compare
This PR enhances the user-facing API `tune_tir` that makes it
more convenient to feed in an IRModule consists of multiple TIRs and
customize the search space for them. This is widely used in our MLC-LLM
project where we wanted to customize the search space for some
quantization-related operators.
An example usecase:
```python
from tvm import meta_schedule as ms
ms.tir_integration.tune_tir(
...
space="cuda", <========== by default, the space is "cuda" rather than "cuda-tensorcore"
special_space={
"fused_decode1_fused_matmul2_add1_gelu": sch_fused_decode_gemv,
"decode": sch_decode,
},
)
```
junrushao
force-pushed
the
feature/2023-05-05/tune-tir-module
branch
from
25ba3a4 to
f55ace0
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR enhances the user-facing API
tune_tirthat makes it more convenient to feed in an IRModule consists of multiple TIRs and customize the search space for them. This is widely used in our MLC-LLM project where we wanted to customize the search space for some quantization-related operators.An example usecase: