More experimental questions of Open-Sora-Plan and Latte

[ZTzxj]

Can this method be applied to Open-Sora-Plan and Latte as in the PAB paper, and would like to ask if there is a specific code for this part if it is to be applied

[Shenyi-Z]

Thank you for your attention to ToCa! This should be feasible, and the ToCa method is likely to be used on a variety of similar models. ( OpenSora-Plan should be similar to OpenSora) Recently, we also made a version of image generation on FLUX, which will be uploaded after sorting out in the near future. As we said, ToCa does token-wise calculation and allocation of computational layers, which should be feasible for most methods. As for experiments on more models, we may carry out follow-up work, but there is no relevant plan in the near future. However, we believe that it will not be too difficult to carry out experiments on OpenSora-Plan.

[Shenyi-Z]

Hello! Seems you have mentioned code for testing FLOPs. We will update it in the next few days and try to complete it within this November~

[Shenyi-Z]

Hello! Seems you have mentioned code for testing FLOPs. We will update it in the next few days and try to complete it within this November~

12.05: Updating soon, quite busy recently QwQ