Skip to content

assert PytorchEngineConfig block size#3826

Merged
windreamer merged 1 commit intoInternLM:mainfrom
Tsundoku958:Tsundoku958/fix-block-size
Aug 11, 2025
Merged

assert PytorchEngineConfig block size#3826
windreamer merged 1 commit intoInternLM:mainfrom
Tsundoku958:Tsundoku958/fix-block-size

Conversation

@Tsundoku958
Copy link
Copy Markdown
Contributor

@Tsundoku958 Tsundoku958 commented Aug 11, 2025

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily receiving feedbacks. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers.

Motivation

Fix the bug described in issue #3781
If block_size=8:
image
if block_size is not power of 2
image

Modification

Assert Block size in lmdeploy/messages.py.

@lvhan028 lvhan028 requested a review from grimoire August 11, 2025 06:20
Copy link
Copy Markdown
Collaborator

@grimoire grimoire left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! LGTM

@windreamer windreamer merged commit 57e32dc into InternLM:main Aug 11, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants