Whether support multi-language compression #219
FuJiaJie123
started this conversation in
General
Replies: 1 comment
-
|
From my point of view, the xlm-roberta base strongly suggests multilingual capability is possible, but the practical question is not only whether it runs on Chinese input. It is whether the compression preserves the right information density and semantic faithfulness across languages with different tokenization behavior. I would treat multilingual support as something to verify empirically per language and domain rather than assume from the encoder name alone. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I am wondering whether LLMingua-2 can be used to compress Chinese prompt, or only for english?
Beta Was this translation helpful? Give feedback.
All reactions