Support for flux？

[d123f]

This is really a great job. I have a little question. How does Duca perform on flux compared to Toca? Does Duca support flux and would the code be released?

[Shenyi-Z]

DuCa's performance on FLUX shows only a slight improvement over ToCa in terms of FLOPs reduction. However, it achieves a significantly better acceleration in latency. This is fundamentally because DuCa supports FlashAttention — as we emphasized in the paper, it is a crucial technology. The FLUX implementation will be released soon (within 1–2 weeks; I’ve been a bit busy lately — apologies, it should have been released much earlier). In addition, our paper will receive a corresponding version update alongside the release.

[d123f]

Thank you for your response very much!!! Supporting FlashAttention is a very significant advantage. I am really looking forward to the release of Duca's code about flux!