(not an issue - just a question) Do you know if USE does the tokenization, and splits sentences. Or should the user make the tokenisation? `"hello world. this is some text. hello"` or `[['hello', 'world',], ['this', 'is', 'some', 'text'], ['hello']]`
(not an issue - just a question)
Do you know if USE does the tokenization, and splits sentences. Or should the user make the tokenisation?
"hello world. this is some text. hello"or
[['hello', 'world',], ['this', 'is', 'some', 'text'], ['hello']]