Skip to content

[bugFix] append eos_token_ids in rollout worker manually#1063

Merged
pppppM merged 1 commit intoInternLM:mainfrom
YanhuiDua:fix_eos
Sep 9, 2025
Merged

[bugFix] append eos_token_ids in rollout worker manually#1063
pppppM merged 1 commit intoInternLM:mainfrom
YanhuiDua:fix_eos

Conversation

@YanhuiDua
Copy link
Copy Markdown
Collaborator

@YanhuiDua YanhuiDua commented Sep 9, 2025

Append eos_token_ids in rollout worker according to finish reason manually, and this logic will be removed when lmdeploy supports to return stop_tokens

@windreamer
Copy link
Copy Markdown
Collaborator

It seems LMDeploy already merged relateve PR InternLM/lmdeploy#3941 into main branch.

@pppppM pppppM merged commit f5c60e2 into InternLM:main Sep 9, 2025
2 of 3 checks passed
leexinhao pushed a commit to leexinhao/xtuner-videochat that referenced this pull request Oct 29, 2025
@YanhuiDua YanhuiDua deleted the fix_eos branch March 17, 2026 09:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants