Skip to content

用vllm推理通过postman调用返回内容有问题 #10

@liutianye

Description

@liutianye

用vllm推理的qwen2-7B的环境,模型换成了apollo-6B起来服务以后调用成功,但是返回内容大概率是空白,小概率是乱码类的内容。
微信截图_20240815172408

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions