Skip to content

Bug Fixes #2197

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
danielhanchen merged 856 commits into from
Mar 26, 2025
Merged

Bug Fixes #2197

danielhanchen merged 856 commits into from
Mar 26, 2025

Conversation

@danielhanchen
Copy link
Contributor

@danielhanchen danielhanchen commented Mar 26, 2025 •
edited by shimmyshimmer
Loading

Solves:

  1. Gemma vision requires grad failed
  2. Pixtral & Mistral3 SDPA does NOT work
  3. Qwen Vision inference gibberish
  4. finetune_vision_layers **kwargs
  5. UNSLOTH_DISABLE_AUTO_UPDATES
  6. Fix Mistral Small 3.1 Data Collator not working

danielhanchen and others added 29 commits March 21, 2025 17:24
@danielhanchen
Update llama.py
0c995e8
@danielhanchen
Update llama.py
5ba0878
@danielhanchen
Update llama.py
cd5e195
@danielhanchen
Update llama.py
855695d
@danielhanchen
Update vision.py
4d7e3a1
@danielhanchen
HF Transfer
33194f1
@naliazheli
fix(utils): add missing importlib import to fix NameError (#2134)
ef71732 
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
@jeromeku
Add QLoRA Train and Merge16bit Test (#2130)
1d7b570 
* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license
@danielhanchen
Update pyproject.toml
167b482
@danielhanchen
Merge branch 'main' into nightly
d28b929
@danielhanchen
Merge branch 'main' into nightly
2064656
@danielhanchen
Update vision.py
3fdfff8
@danielhanchen
Update vision.py
172fe3c
@danielhanchen
Update vision.py
da6ad9f
@danielhanchen
Update vision.py
781887f
@danielhanchen
Update loader.py
fce9e82
@danielhanchen
Update loader.py
9ceabbe
@danielhanchen
Revert
87dc533
@danielhanchen
Update vision.py
cafd05e
@danielhanchen
Update vision.py
6ebcae0
@danielhanchen
Update vision.py
9f34d47
@danielhanchen
Update vision.py
26b0c83
@danielhanchen
Update vision.py
f9dd304
@danielhanchen
Bug fix
10cfe62
@danielhanchen
Update mapper.py
bfa1b9f
@danielhanchen
check SDPA for Mistral 3, Pixtral
b3c2975
@danielhanchen
Update vision.py
75ce106
@danielhanchen
Versioning
86c6060
@danielhanchen
Update rl_replacements.py
d4c0550
@danielhanchen danielhanchen merged commit 158b25c into main Mar 26, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.