Fix Perplexity Score For Tokenizers without bos_token_id#682

lhoestq merged 1 commit intohuggingface:mainhuggingface/evaluate:mainfrom

kylehowells:perplexity-support-tokenisers-without-bos_token_idkylehowells/evaluate:perplexity-support-tokenisers-without-bos_token_idCopy head branch name to clipboard