Skip to content

[Bug] 测试完成后解析结果的时候发生报错,提示需设置trust_remote_code=True #183

@NSDie

Description

@NSDie

操作系统及版本

ubuntu 20.04

安装工具的python环境

在anaconda/miniconda创建的python虚拟环境

python版本

3.10

AISBench工具版本

3.1.20260306

AISBench执行命令

ais_bench --models vllm_api_stream_chat --datasets synthetic_gen_string -m perf

模型配置文件或自定义配置文件内容

from ais_bench.benchmark.models import VLLMCustomAPIChat
from ais_bench.benchmark.utils.postprocess.model_postprocessors import extract_non_reasoning_content

models = [
dict(
attr="service",
type=VLLMCustomAPIChat,
abbr="vllm-api-stream-chat",
path="/data1/l00862397/TeleChat3-105B",
model="deepseek_v3",
stream=True,
request_rate=0,
use_timestamp=False,
retry=2,
api_key="",
host_ip="10.246.63.18",
host_port=1999,
url="",
max_out_len=1024,
batch_size=1,
trust_remote_code=True,
generation_kwargs=dict(
#temperature=0.01,
ignore_eos=True,
),
pred_postprocessor=dict(type=extract_non_reasoning_content),
)
]

预期行为

No response

实际行为

contains custom code which must be executed to correctly load the model. You can inspect the repository content at /data1/l00862397/TeleChat3-105B . Please pass the argument trust_remote_code=True to allow custom code to be run. | Visit https://ais-bench-benchmark-rf.readthedocs.io/en/latest/ais_benchmark.html#ais_benchmark.utils.logging.exceptions.FileOperationError

前置检查

  • 我已读懂主页文档的快速入门,无法解决问题
  • 我已检索过FAQ,无重复问题
  • 我已搜索过现有Issue,无重复问题
  • 我已更新到最新版本,问题仍存在

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingcontent_check_passedissue content check passed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions