OSError: Can't load tokenizer for 'StreamVLN_Video_qwen_1_5_r2r_rxr_envdrop_scalevln_v1_3' #64
Description
Hi, thank you for your great work!
Issue: Missing Tokenizer Files in Downloaded Model
Problem Description
When running the evaluation script with the locally downloaded model, I encounter tokenizer loading errors. The model directory appears to be missing necessary tokenizer files.
Error Details
OSError: Can't load tokenizer for 'StreamVLN_Video_qwen_1_5_r2r_rxr_envdrop_scalevln_v1_3'.
If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name.
Otherwise, make sure 'StreamVLN_Video_qwen_1_5_r2r_rxr_envdrop_scalevln_v1_3' is the correct path to a directory containing all relevant files for a LlamaTokenizerFast tokenizer.