Skip to content

Enhance request checker#4104

Merged
lvhan028 merged 6 commits intoInternLM:mainfrom
lvhan028:enhance-request-checker
Nov 11, 2025
Merged

Enhance request checker#4104
lvhan028 merged 6 commits intoInternLM:mainfrom
lvhan028:enhance-request-checker

Conversation

@lvhan028
Copy link
Copy Markdown
Collaborator

@lvhan028 lvhan028 commented Nov 6, 2025

Motivation

engine crashed when api_server is launched without logprobs_mode option but client requests logprobs output

Modification

  • Enhanced Request Checker: Now returns a BadRequest response for any invalid request.
  • Initiated API Server Refactor: Created three new serving_xxx.py files to begin modularizing the codebase by dedicating a separate file for each endpoint implementation.

@lvhan028 lvhan028 merged commit 0da627e into InternLM:main Nov 11, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants