[Question] training params of lora files

[yuwon]

Thank you for the great work!!

In the HF, there are several models with different setting like normalcfg vs. smallcfg, 2step to 16 step.
I'm wondering what was the training params for those models?

[G-U-N]

Thanks for the interest! You can refer to the comments in the run.sh.

LMK if there are any further questions.

[yuwon]

Thank you for the fast response!
I found some different hparams there and have questions about the params.

What is not_apply_cfg_solver for? It seems like unconditioned output is set to the conditioned output. Let me know if I'm wrong.

And what was the training params for the models with different steps? e.g., 2step and 16step loras. Is it controlled by multiphase? e.g., for 4steps lora, set multiphase to 4.

[G-U-N]

Yes. You are right. All the other params are set the same.