-
Notifications
You must be signed in to change notification settings - Fork 19
Description
操作系统及版本
ubuntu 20.04
安装工具的python环境
在anaconda/miniconda创建的python虚拟环境
python版本
3.10
AISBench工具版本
3.1.20260306
AISBench执行命令
ais_bench --models vllm_api_stream_chat --datasets synthetic_gen_string -m perf
模型配置文件或自定义配置文件内容
from ais_bench.benchmark.models import VLLMCustomAPIChat
from ais_bench.benchmark.utils.postprocess.model_postprocessors import extract_non_reasoning_content
models = [
dict(
attr="service",
type=VLLMCustomAPIChat,
abbr="vllm-api-stream-chat",
path="/data1/l00862397/TeleChat3-105B",
model="deepseek_v3",
stream=True,
request_rate=0,
use_timestamp=False,
retry=2,
api_key="",
host_ip="10.246.63.18",
host_port=1999,
url="",
max_out_len=1024,
batch_size=1,
trust_remote_code=True,
generation_kwargs=dict(
#temperature=0.01,
ignore_eos=True,
),
pred_postprocessor=dict(type=extract_non_reasoning_content),
)
]
预期行为
No response
实际行为
contains custom code which must be executed to correctly load the model. You can inspect the repository content at /data1/l00862397/TeleChat3-105B . Please pass the argument trust_remote_code=True to allow custom code to be run. | Visit https://ais-bench-benchmark-rf.readthedocs.io/en/latest/ais_benchmark.html#ais_benchmark.utils.logging.exceptions.FileOperationError
前置检查
- 我已读懂主页文档的快速入门,无法解决问题
- 我已检索过FAQ,无重复问题
- 我已搜索过现有Issue,无重复问题
- 我已更新到最新版本,问题仍存在