Skip to content

[ci] refactor eval into api eval and add h800 eval workflow#4008

Merged
lvhan028 merged 34 commits intoInternLM:mainfrom
zhulinJulia24:add_h800_eval
Oct 10, 2025
Merged

[ci] refactor eval into api eval and add h800 eval workflow#4008
lvhan028 merged 34 commits intoInternLM:mainfrom
zhulinJulia24:add_h800_eval

Conversation

@zhulinJulia24
Copy link
Copy Markdown
Collaborator

including #3987

  1. Refactored chat model evaluation to api-eval
  2. Added h800 chat and base model evaluation
  3. Added more models to base model evaluation
  4. Changed nativa to cuda-ipc

In a future pull request, we will add the openai_extra_kwargs configuration extension (which will add reasoning_effort to gpt-oss) and llmjudger to api-eval.

@lvhan028 lvhan028 merged commit c875e37 into InternLM:main Oct 10, 2025
4 checks passed
@zhulinJulia24 zhulinJulia24 deleted the add_h800_eval branch January 5, 2026 11:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants