Roadmap of AutoencoderKL

[lavinal712]

• Add PSNR, SSIM, LPIPS metric in training.
• Support VAE based on Transformer.
• Add EMA.
• Improved evaluation code.
• Data argumentation.
• Support 3D VAE.
• Improve training efficiency.

[lzardy]

Hello, I am curious, does the current iteration of the scripts allows modifying the channel count to be trained, specifically for SDXL VAE? Most VAE for SD15 and SDXL are 4 channel only.

[lavinal712]

Hello, I am curious, does the current iteration of the scripts allows modifying the channel count to be trained, specifically for SDXL VAE? Most VAE for SD15 and SDXL are 4 channel only.

Could you elaborate further? I didn't fully understand your intention. This repository provides a convenient VAE training solution, including training VAEs with different numbers of channels. If you want to train from scratch, you can adjust the configuration file to do so. If it's something else, please clarify your idea in detail. Thank you!