Replies: 3 comments
-
|
yes 👍 though FSDP2 isn't tested. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
@zlyzg you'll want to try making use of TREAD when you do this. see the dedicated document for that or the wan quickstart subsection. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
RamTorch, Musubi blocks to swap, FSDP2 and group offload are available now. though, in order of reliability. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Great work! I am wondering if current Simpletuner suppports full finetuning of Wan's DiT. Thanks!
Beta Was this translation helpful? Give feedback.
All reactions