Character level latency for speech-to-text

[George0828Zhang]

Hello,
Will this feature ever be updated?

2021-11-14 19:58:00 | ERROR    | simuleval.scorer | Character level latency for speech-to-text model is not supported at the moment. We will update this feature very soon.

Also, I'm curious as to why this combination was not implemented, does it require additional handling? AFAIK, the only differenct between word and char is when calculating the reference length here. I'm trying to implemented myself, but I'm struggling to see the difference, would be great if you can provide some explanations or if this is updated. Thanks.

[xutaima]

Hi @George0828Zhang. There are some logics to be handle, but yes it shouldn't be a struggle. The motivation to separate char and word was to evaluate language without space (like Chinese, Japanese). I am working on this at the moment, and you are very welcome to make pull request if you already have some implementation.