Search results

Wide range of metrics (rpm,e2el) compared to other solutions

Status: Open.

#95 In ray-project/llmperf;

· psydok opened on Jul 2, 2025

Support --tokenizer-path to load custom tokenizer (local or remote)

Status: Open.

#92 In ray-project/llmperf;

· SkylarJiang opened on May 27, 2025

Is it able to test embedding models with llmperf ?

Status: Open.

#91 In ray-project/llmperf;

· artemus717 opened on Apr 16, 2025

unabl to benchmark the llama4 models using llmperf

Status: Open.

#90 In ray-project/llmperf;

· nskpro-cmd opened on Apr 8, 2025

How to benchmark reason model with llmperf?

Status: Open.

#89 In ray-project/llmperf;

· bash99 opened on Mar 28, 2025

Feature Request: Support multimodal models in correctness test

Status: Open.

#88 In ray-project/llmperf;

· liu-shaojun opened on Mar 12, 2025

How to solve ”ZeroDivisionError: division by zero“

Status: Open.

#87 In ray-project/llmperf;

· Mbmfc opened on Mar 12, 2025

Using multiples CPUs

Status: Open.

#86 In ray-project/llmperf;

· dsantiago opened on Mar 7, 2025

Cannot build with <code>ray</code> in Docker

Status: Open.

#84 In ray-project/llmperf;

· Fmstrat opened on Feb 23, 2025

commit: f1d6bed , In some scenarios, the number of requests will double and the input length will be fixed at two number

Status: Open.

#82 In ray-project/llmperf;

· lq2030 opened on Feb 10, 2025

Support other scenarios

Status: Open.

#78 In ray-project/llmperf;

· yw-furiosa opened on Oct 28, 2024

how to test vllm interface

Status: Open.

#77 In ray-project/llmperf;

· ZTurboX opened on Oct 25, 2024