Revert "[core] separate builder init and builder prepare for each batch"#12377
Revert "[core] separate builder init and builder prepare for each batch"#12377youkaichao wants to merge 1 commit intomainfrom
Conversation
|
👋 Hi! Thank you for contributing to the vLLM project. Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can do one of these:
🚀 |
|
This pull request has merge conflicts that must be resolved before it can be |
|
close as #12380 fixed it. |
Reverts #12253 as people find it causes large perf regression