Skip to content

add Qwen3-8B accuracy evaluation in llm_compressor.md#4319

Merged
lvhan028 merged 1 commit intoInternLM:mainfrom
43758726:add/add_Qwen3-8B_accuracy_evaluation
Feb 5, 2026
Merged

add Qwen3-8B accuracy evaluation in llm_compressor.md#4319
lvhan028 merged 1 commit intoInternLM:mainfrom
43758726:add/add_Qwen3-8B_accuracy_evaluation

Conversation

@43758726
Copy link
Copy Markdown
Collaborator

@43758726 43758726 commented Feb 3, 2026

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily receiving feedbacks. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers.

Motivation

This PR extends the “Accuracy Evaluation” section in llm_compressor.md and llm_compressor.md by adding AWQ (symmetric/asymmetric) results for Qwen3-8B (Dense). The Dense model serves as a baseline under the same quantization settings and evaluation pipeline as Qwen3-30B-A3B (MoE), enabling a clearer comparison to assess whether int4 quantization leads to larger accuracy degradation for MoE models than for Dense models.

Modification

lmdeploy/docs/en/quantization/llm_compressor.md: add AWQ (symmetric/asymmetric) accuracy evaluation for Qwen3-8B (Dense).
lmdeploy/docs/zh_cn/quantization/llm_compressor.md: add AWQ (symmetric/asymmetric) accuracy evaluation for Qwen3-8B (Dense).

Checklist

  1. Pre-commit or other linting tools are used to fix the potential lint issues.
  2. The modification is covered by complete unit tests. If not, please add more unit tests to ensure the correctness.
  3. If the modification has a dependency on downstream projects of a newer version, this PR should be tested with all supported versions of downstream projects.
  4. The documentation has been modified accordingly, like docstring or example tutorials.

@lvhan028 lvhan028 changed the title [Add] add Qwen3-8B accuracy evaluation in llm_compressor.md add Qwen3-8B accuracy evaluation in llm_compressor.md Feb 5, 2026
@lvhan028 lvhan028 merged commit 96c9857 into InternLM:main Feb 5, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants