umT5

[Iamleos]

Model description

umT5

Open source examples / papers / references

• Paper: https://arxiv.org/abs/2304.09151
• Website: https://github.com/google-research/multilingual-t5
• Model code: https://github.com/google-research/multilingual-t5
• Model weights: https://huggingface.co/google/umt5-xxl

Why this model?

• wan2.1 need umT5

[Iamleos]

I want to implement this model. cc @jenriver

[jenriver]

Thanks lamleos! I'll assign it to you since you're working on it.

[jenriver]

TODO: Implement KV Cache for efficient inference

[chapman20j]

Hi @Iamleos. Just following up since this issue was recently re-opened. Are you interested in implementing a KV-cache for this model?