[bugs and help need] I followed main readme page guideline, there is connection error and model running error #124
Description
I looks like start vLLM server well
(LongBench) root@salab-hpedl380g11-03:~/wayne/kvcache/LongBench# vllm serve THUDM/glm-4-9b-chat --api-key token-abc123 --tensor-parallel-size 4 --gpu-memory-utilization 0.95 --max_model_len 128000 --trust-remote-code
INFO 04-26 11:42:40 [__init__.py:239] Automatically detected platform cuda.
INFO 04-26 11:42:41 [api_server.py:1034] vLLM API server version 0.8.4
INFO 04-26 11:42:41 [api_server.py:1035] args: Namespace(subparser='serve', model_tag='THUDM/glm-4-9b-chat', config='', host=None, port=8000, uvicorn_log_level='info', disable_uvicorn_access_log=False, allow_credentials=False, allowed_origins=['*'], allowed_methods=['*'], allowed_headers=['*'], api_key='token-abc123', lora_modules=None, prompt_adapters=None, chat_template=None, chat_template_content_format='auto', response_role='assistant', ssl_keyfile=None, ssl_certfile=None, ssl_ca_certs=None, enable_ssl_refresh=False, ssl_cert_reqs=0, root_path=None, middleware=[], return_tokens_as_token_ids=False, disable_frontend_multiprocessing=False, enable_request_id_headers=False, enable_auto_tool_choice=False, tool_call_parser=None, tool_parser_plugin='', model='THUDM/glm-4-9b-chat', task='auto', tokenizer=None, hf_config_path=None, skip_tokenizer_init=False, revision=None, code_revision=None, tokenizer_revision=None, tokenizer_mode='auto', trust_remote_code=True, allowed_local_media_path=None, load_format='auto', download_dir=None, model_loader_extra_config=None, use_tqdm_on_load=True, config_format=<ConfigFormat.AUTO: 'auto'>, dtype='auto', kv_cache_dtype='auto', max_model_len=128000, guided_decoding_backend='auto', logits_processor_pattern=None, model_impl='auto', distributed_executor_backend=None, pipeline_parallel_size=1, tensor_parallel_size=4, data_parallel_size=1, enable_expert_parallel=False, max_parallel_loading_workers=None, ray_workers_use_nsight=False, disable_custom_all_reduce=False, block_size=None, enable_prefix_caching=None, prefix_caching_hash_algo='builtin', disable_sliding_window=False, use_v2_block_manager=True, num_lookahead_slots=0, seed=None, swap_space=4, cpu_offload_gb=0, gpu_memory_utilization=0.95, num_gpu_blocks_override=None, max_num_batched_tokens=None, max_num_partial_prefills=1, max_long_partial_prefills=1, long_prefill_token_threshold=0, max_num_seqs=None, max_logprobs=20, disable_log_stats=False, quantization=None, rope_scaling=None, rope_theta=None, hf_token=None, hf_overrides=None, enforce_eager=False, max_seq_len_to_capture=8192, tokenizer_pool_size=0, tokenizer_pool_type='ray', tokenizer_pool_extra_config=None, limit_mm_per_prompt=None, mm_processor_kwargs=None, disable_mm_preprocessor_cache=False, enable_lora=False, enable_lora_bias=False, max_loras=1, max_lora_rank=16, lora_extra_vocab_size=256, lora_dtype='auto', long_lora_scaling_factors=None, max_cpu_loras=None, fully_sharded_loras=False, enable_prompt_adapter=False, max_prompt_adapters=1, max_prompt_adapter_token=0, device='auto', num_scheduler_steps=1, multi_step_stream_outputs=True, scheduler_delay_factor=0.0, enable_chunked_prefill=None, speculative_config=None, ignore_patterns=[], preemption_mode=None, served_model_name=None, qlora_adapter_name_or_path=None, show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, disable_async_output_proc=False, scheduling_policy='fcfs', scheduler_cls='vllm.core.scheduler.Scheduler', override_neuron_config=None, override_pooler_config=None, compilation_config=None, kv_transfer_config=None, worker_cls='auto', worker_extension_cls='', generation_config='auto', override_generation_config=None, enable_sleep_mode=False, calculate_kv_scales=False, additional_config=None, enable_reasoning=False, reasoning_parser=None, disable_cascade_attn=False, disable_chunked_mm_input=False, disable_log_requests=False, max_log_len=None, disable_fastapi_docs=False, enable_prompt_tokens_details=False, enable_server_load_tracking=False, dispatch_function=<function ServeSubcommand.cmd at 0x78a9338be0c0>)
INFO 04-26 11:42:46 [config.py:689] This model supports multiple tasks: {'generate', 'reward', 'score', 'embed', 'classify'}. Defaulting to 'generate'.
INFO 04-26 11:42:46 [config.py:1713] Defaulting to use ray for distributed inference
INFO 04-26 11:42:46 [config.py:1901] Chunked prefill is enabled with max_num_batched_tokens=2048.
WARNING 04-26 11:42:47 [tokenizer.py:248] Using a slow tokenizer. This might cause a significant slowdown. Consider using a fast tokenizer instead.
INFO 04-26 11:42:50 [__init__.py:239] Automatically detected platform cuda.
INFO 04-26 11:42:51 [core.py:61] Initializing a V1 LLM engine (v0.8.4) with config: model='THUDM/glm-4-9b-chat', speculative_config=None, tokenizer='THUDM/glm-4-9b-chat', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, override_neuron_config=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.bfloat16, max_seq_len=128000, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=4, pipeline_parallel_size=1, disable_custom_all_reduce=False, quantization=None, enforce_eager=False, kv_cache_dtype=auto, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='auto', reasoning_backend=None), observability_config=ObservabilityConfig(show_hidden_metrics=False, otlp_traces_endpoint=None, collect_model_forward_time=False, collect_model_execute_time=False), seed=None, served_model_name=THUDM/glm-4-9b-chat, num_scheduler_steps=1, multi_step_stream_outputs=True, enable_prefix_caching=True, chunked_prefill_enabled=True, use_async_output_proc=True, disable_mm_preprocessor_cache=False, mm_processor_kwargs=None, pooler_config=None, compilation_config={"level":3,"custom_ops":["none"],"splitting_ops":["vllm.unified_attention","vllm.unified_attention_with_output"],"use_inductor":true,"compile_sizes":[],"use_cudagraph":true,"cudagraph_num_of_warmups":1,"cudagraph_capture_sizes":[512,504,496,488,480,472,464,456,448,440,432,424,416,408,400,392,384,376,368,360,352,344,336,328,320,312,304,296,288,280,272,264,256,248,240,232,224,216,208,200,192,184,176,168,160,152,144,136,128,120,112,104,96,88,80,72,64,56,48,40,32,24,16,8,4,2,1],"max_capture_size":512}
2025-04-26 11:42:53,764 INFO worker.py:1832 -- Started a local Ray instance. View the dashboard at http://127.0.0.1:8265
INFO 04-26 11:42:55 [ray_utils.py:335] No current placement group found. Creating a new placement group.
WARNING 04-26 11:42:55 [ray_utils.py:342] The number of required GPUs exceeds the total number of available GPUs in the placement group.
INFO 04-26 11:43:05 [ray_utils.py:233] Waiting for creating a placement group of specs for 10 seconds. specs=[{'node:10.74.40.87': 0.001, 'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}]. Check `ray status` and `ray list nodes` to see if you have enough resources, and make sure the IP addresses used by ray cluster are the same as VLLM_HOST_IP environment variable specified in each node if you are running on a multi-node.
INFO 04-26 11:43:25 [ray_utils.py:233] Waiting for creating a placement group of specs for 30 seconds. specs=[{'node:10.74.40.87': 0.001, 'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}]. Check `ray status` and `ray list nodes` to see if you have enough resources, and make sure the IP addresses used by ray cluster are the same as VLLM_HOST_IP environment variable specified in each node if you are running on a multi-node.
INFO 04-26 11:44:05 [ray_utils.py:233] Waiting for creating a placement group of specs for 70 seconds. specs=[{'node:10.74.40.87': 0.001, 'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}]. Check `ray status` and `ray list nodes` to see if you have enough resources, and make sure the IP addresses used by ray cluster are the same as VLLM_HOST_IP environment variable specified in each node if you are running on a multi-node.
INFO 04-26 11:45:25 [ray_utils.py:233] Waiting for creating a placement group of specs for 150 seconds. specs=[{'node:10.74.40.87': 0.001, 'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}]. Check `ray status` and `ray list nodes` to see if you have enough resources, and make sure the IP addresses used by ray cluster are the same as VLLM_HOST_IP environment variable specified in each node if you are running on a multi-node.
INFO 04-26 11:48:05 [ray_utils.py:233] Waiting for creating a placement group of specs for 310 seconds. specs=[{'node:10.74.40.87': 0.001, 'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}, {'GPU': 1.0}]. Check `ray status` and `ray list nodes` to see if you have enough resources, and make sure the IP addresses used by ray cluster are the same as VLLM_HOST_IP environment variable specified in each node if you are running on a multi-node.
but when I run pred.py, I got error, please suggest
(LongBench) root@salab-hpedl380g11-03:~/wayne/kvcache/LongBench# python pred.py --model GLM-4-9B-Chat
Namespace(save_dir='results', model='GLM-4-9B-Chat', cot=False, no_context=False, rag=0, n_proc=16)
0%| | 0/31 [00:00<?, ?it/s]
Token indices sequence length is longer than the specified maximum sequence length for this model (135864 > 128000). Running this sequence through the model will result in indexing errors
0%| | 0/32 [00:00<?, ?it/s]
Token indices sequence length is longer than the specified maximum sequence length for this model (138693 > 128000). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (274409 > 128000). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (173170 > 128000). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (320894 > 128000). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (473946 > 128000). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (701616 > 128000). Running this sequence through the model will result in indexing errors
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Token indices sequence length is longer than the specified maximum sequence length for this model (1113927 > 128000). Running this sequence through the model will result in indexing errors
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
3%|████▏ | 1/31 [00:11<05:47, 11.58s/it]
Max tries. Failed.
3%|████ | 1/32 [00:11<05:58, 11.58s/it]
Max tries. Failed.
3%|████ | 1/32 [00:11<05:57, 11.52s/it]
Max tries. Failed.
3%|████▏ | 1/31 [00:11<05:53, 11.77s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
3%|████▏ | 1/31 [00:11<05:54, 11.82s/it]
Max tries. Failed.
3%|████▏ | 1/31 [00:11<05:58, 11.96s/it]
Token indices sequence length is longer than the specified maximum sequence length for this model (351299 > 128000). Running this sequence through the model will result in indexing errors
Max tries. Failed.
3%|████▏ | 1/31 [00:11<05:58, 11.96s/it]
Max tries. Failed.
3%|████ | 1/32 [00:12<06:15, 12.12s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Token indices sequence length is longer than the specified maximum sequence length for this model (134350 > 128000). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (347031 > 128000). Running this sequence through the model will result in indexing errors
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
3%|████ | 1/32 [00:12<06:38, 12.87s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
3%|████▏ | 1/31 [00:13<06:34, 13.14s/it]
Max tries. Failed.
3%|████▏ | 1/31 [00:13<06:37, 13.25s/it]
Max tries. Failed.
3%|████ | 1/32 [00:13<06:50, 13.23s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
3%|████ | 1/32 [00:13<07:00, 13.58s/it]
Max tries. Failed.
3%|████▏ | 1/31 [00:13<06:50, 13.69s/it]
Max tries. Failed.
3%|████ | 1/32 [00:13<07:09, 13.85s/it]
Max tries. Failed.
3%|████▏ | 1/31 [00:14<07:13, 14.46s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████ | 2/32 [00:23<05:47, 11.60s/it]
Max tries. Failed.
6%|████████▎ | 2/31 [00:23<05:38, 11.66s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████▎ | 2/31 [00:23<05:42, 11.82s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████▎ | 2/31 [00:23<05:44, 11.88s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████ | 2/32 [00:24<06:13, 12.44s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████ | 2/32 [00:24<06:09, 12.33s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████▎ | 2/31 [00:25<06:07, 12.68s/it]
Max tries. Failed.
6%|████████▎ | 2/31 [00:25<06:00, 12.44s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████ | 2/32 [00:25<06:22, 12.76s/it]
Token indices sequence length is longer than the specified maximum sequence length for this model (315081 > 128000). Running this sequence through the model will result in indexing errors
Max tries. Failed.
6%|████████▎ | 2/31 [00:25<06:17, 13.01s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████ | 2/32 [00:25<06:30, 13.00s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████▎ | 2/31 [00:26<06:13, 12.87s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████ | 2/32 [00:26<06:41, 13.39s/it]
Max tries. Failed.
6%|████████▎ | 2/31 [00:27<06:30, 13.48s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████▎ | 2/31 [00:27<06:33, 13.58s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
6%|████████ | 2/32 [00:27<06:49, 13.64s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
10%|████████████▍ | 3/31 [00:35<05:27, 11.71s/it]
Max tries. Failed.
10%|████████████▍ | 3/31 [00:35<05:27, 11.69s/it]
Max tries. Failed.
9%|████████████ | 3/32 [00:35<05:39, 11.71s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
10%|████████████▍ | 3/31 [00:35<05:29, 11.75s/it]
Token indices sequence length is longer than the specified maximum sequence length for this model (481616 > 128000). Running this sequence through the model will result in indexing errors
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
9%|████████████ | 3/32 [00:36<05:49, 12.05s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
10%|████████████▍ | 3/31 [00:37<05:49, 12.49s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
9%|████████████ | 3/32 [00:38<06:12, 12.84s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
10%|████████████▍ | 3/31 [00:38<06:04, 13.01s/it]
Max tries. Failed.
10%|████████████▍ | 3/31 [00:38<05:53, 12.61s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
10%|████████████▍ | 3/31 [00:39<06:07, 13.14s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
9%|████████████ | 3/32 [00:39<06:21, 13.15s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
10%|████████████▍ | 3/31 [00:39<06:10, 13.22s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
10%|████████████▍ | 3/31 [00:40<06:13, 13.35s/it]
Max tries. Failed.
9%|████████████ | 3/32 [00:40<06:28, 13.41s/it]
Max tries. Failed.
9%|████████████ | 3/32 [00:40<06:40, 13.81s/it]
Max tries. Failed.
9%|████████████ | 3/32 [00:40<06:40, 13.82s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:47<05:17, 11.75s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:47<05:17, 11.75s/it]
Max tries. Failed.
12%|████████████████ | 4/32 [00:47<05:30, 11.82s/it]
Token indices sequence length is longer than the specified maximum sequence length for this model (129784 > 128000). Running this sequence through the model will result in indexing errors
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
12%|████████████████ | 4/32 [00:47<05:33, 11.91s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:48<05:35, 12.44s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:49<05:32, 12.30s/it]
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:50<05:28, 12.15s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:50<05:40, 12.62s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
12%|████████████████ | 4/32 [00:51<05:51, 12.56s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:51<05:42, 12.69s/it]
Max tries. Failed.
12%|████████████████ | 4/32 [00:51<06:06, 13.07s/it]
Max tries. Failed.
12%|████████████████ | 4/32 [00:52<06:02, 12.94s/it]
Max tries. Failed.
12%|████████████████ | 4/32 [00:52<05:59, 12.84s/it]
Max tries. Failed.
12%|████████████████ | 4/32 [00:52<06:07, 13.11s/it]
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:52<05:57, 13.24s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
13%|████████████████▌ | 4/31 [00:53<06:04, 13.50s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████▋ | 5/31 [00:58<05:02, 11.62s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████▋ | 5/31 [00:58<05:03, 11.66s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████▋ | 5/31 [01:00<05:18, 12.25s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████ | 5/32 [01:00<05:36, 12.48s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████▋ | 5/31 [01:01<05:15, 12.12s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████ | 5/32 [01:01<05:39, 12.59s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████▋ | 5/31 [01:02<05:18, 12.24s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████▋ | 5/31 [01:03<05:27, 12.60s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████ | 5/32 [01:03<05:33, 12.37s/it]
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████▋ | 5/31 [01:04<05:28, 12.65s/it]
Max tries. Failed.
16%|████████████████████ | 5/32 [01:04<05:39, 12.57s/it]
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Error Occurs: "Connection error." Retry ...
Max tries. Failed.
16%|████████████████████