Not getting same results with SimpleTuner as HuggingfaceDiffusers full fine tune.

[GobbleCrow]

Hey guys, I've been trying to Fine-tune SD3.5 Medium for the past 2 weeks and have run into many issues, previously I fully fine-tuned SDXL with HuggingFace Diffusers and made a pretty great model. Now, I'm trying SD3.5 Medium and haven't had any luck. I'm using the same dataset, mostly the same settings (that I found were important), and still don't have anything good. I'm guessing it's my configurations but I really can't figure it out. This isn't an issue with SimpleTuner in any way so I thought I'd put it here in the discussions because I'd really like to know how any of you shifted from HF to SimpleTuner.

I'm totally willing to send my training presets from both trainings but don't think I should overflow this discussion with training params. I'd really appreciate the help! Thank you in advance!