在use_unsloth: true时pissa工作不正常

[xd2333]

Reminder

• I have read the README and searched the existing issues.

System Info

• llamafactory version: 0.8.4.dev0
• Platform: Linux-5.15.153.1-microsoft-standard-WSL2-x86_64-with-glibc2.35
• Python version: 3.10.14
• PyTorch version: 2.3.0 (GPU)
• Transformers version: 4.41.2
• Datasets version: 2.20.0
• Accelerate version: 0.32.1
• PEFT version: 0.11.1
• TRL version: 0.9.6
• GPU type: NVIDIA GeForce RTX 4090
• DeepSpeed version: 0.13.1
• Bitsandbytes version: 0.43.1
• vLLM version: 0.4.2

Reproduction

1. 在use_unsloth: true时，pissa_init: true没有执行pissa初始化，会直接进入微调阶段
2. 在use_unsloth: true时，使用adapter_name_or_path指定pissa_init后，在加载模型时还是加载原始模型，而不是pissa初始化后的模型

Expected behavior

No response

Others

No response

[hiyouga]

先用 scripts/pissa_init