- input:
ππΌββοΈ
- expected output:
ππΌββοΈ
- actual output:
ββπΌπ
I wonder how you can achieve tokenising a combined emoji into 1 character.
This library seems to correctly do it for me:
https://github.com/bluelovers/runes
It will tokenise ππΌββοΈ as just 1 character. (it doesn't flip sentences though...)
BTW, do you consider extracting just the tokeniser part of this library without the reverse part into a separate NPM package?
ππΌββοΈππΌββοΈββπΌπI wonder how you can achieve tokenising a combined emoji into 1 character.
This library seems to correctly do it for me:
https://github.com/bluelovers/runes
It will tokenise
ππΌββοΈas just 1 character. (it doesn't flip sentences though...)BTW, do you consider extracting just the tokeniser part of this library without the reverse part into a separate NPM package?