Release v3.3.2 - easily optimise memory consumption · bghira/SimpleTuner

Features

Better diffusion loss tracking when using LayerSync + CREPA
WebUI easy memory optimisation config for light/medium/aggressive configs
TUI simpletuner configure also able to apply optimisation presets to existing configs

ComfyUI will now automatically enable v-prediction and ztsnr for relevant checkpoints
LongCat batched training now works correctly
LongCat edit fixed
ControlNet demo dataset repeats boosted
Chroma indent issue fixed, now trains again
Example configs fixed, populate in UI correctly
Example configs no longer use constant LR scheduler with warmup steps incorrectly
SDXL hidden state buffer arg removed
TinyGemm device mismatch
Examples no longer suggest validation_torch_compile or lion optimiser for video models (degrades)

add pure diffusion loss term pre-augmentation when aux loss is enabled by @bghira in #2201
switch video training example configs from Lion to AdamW BF16 by @bghira in #2206
remove validation torch compile option from examples by @bghira in #2207
(#2175) move scale_shift to _data device by @bghira in #2202
when example uses lr warmup, use constant_with_warmup by @bghira in #2208
Fixup crepa states extraction for K5 by @kabachuha in #2209
fix: remove unsupported hidden_states_buffer from SDXL model_predict by @joeqzzuo in #2213
fix config syntax by @bghira in #2214
(#2211) fix Chroma indent issue and resolve validation and training noise by @bghira in #2215
use repeats of 4 by default on demo CN datasets by @bghira in #2218
add lycoris example for longcat edit by @bghira in #2217
longcat image: fix text encoder padding on inputs and initialisation of text processor by @bghira in #2216
(#1822) add --delete_model_after_load to remove files from disk after they're loaded into memory by @bghira in #2210
comfyui: ztsnr and vpred compatibility by @bghira in #2220
easy memory optimisation presets by @bghira in #2221
merge by @bghira in #2219

Full Changelog: v3.3.1...v3.3.2