GLM4-9B-chat模型推理报错

[shatang123]

Reminder

• I have read the README and searched the existing issues.

System Info

llamafactory version: 0.8.4.dev0

• Platform: Linux-3.10.0-1127.19.1.el7.x86_64-x86_64-with-glibc2.17
• Python version: 3.10.9
• PyTorch version: 2.3.1+cu121 (GPU)
• Transformers version: 4.41.2
• Datasets version: 2.20.0
• Accelerate version: 0.32.1
• PEFT version: 0.11.1
• TRL version: 0.9.6
• GPU type: NVIDIA A100-SXM4-80GB

Reproduction

代码版本：LLaMA-Factory代码和GLM4-9B-chat模型是7-21日拉取的。
报错日志：too many values to unpack (expected 2)

依赖版本
transformers==4.41.2

目前GLM4-9B-chat官方仓库中要求transformers==4.42.4，而LLaMA-Factory安装该版本后提示版本不兼容

目前不知道如何解决

Expected behavior

No response

Others

No response

[DentistCode]

+1，同样的问题

[0zyl]

＋1，急求解决办法

[hiyouga]

fixed

[reyvan14]

+1

[AlexYoung757]

修改glm4模型的modeling_chatglm.py文件中的
model_kwargs["past_key_values"] = self._extract_past_from_model_output(
outputs, standardize_cache_format=standardize_cache_format
)