 shuwenn
|
b23477af44
|
bench: infer tokenizer from serving model info (#28195)
|
2026-06-15 20:03:12 -07:00 |
|
|
shuwenn
|
9d37e710b7
|
[Bench] Add consistent p90/p95/p99 percentiles for all latency metrics (#27662)
|
2026-06-12 13:44:38 -07:00 |
|
|
|
14ed9b448e
|
Add ZMQ IPv6 support, bench_serving sampling params, and reduce routed_dp_rank log noise (#27180)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Grigory Sizov <grisha.sizov@gmail.com>
|
2026-06-03 17:49:34 -07:00 |
|
|
Jimmy Shong
|
f838adb7d4
|
bench_serving: add Zipfian shared-prefix sampling to generated-shared-prefix (#26378)
|
2026-05-28 14:39:46 -07:00 |
|
|
|
97d129f8c6
|
# feat(bench): add SPEED-Bench dataset support to bench_serving (#24149)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
|
2026-05-28 14:37:00 -07:00 |
|
|
Ratish P
|
5e7bf73757
|
Fix bench_serving non-stream reasoning content (#25298)
|
2026-05-20 18:41:46 +00:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
371cb2ade2
|
[Bench] Add MEM profile activity to bench_serving (#25026)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-13 16:22:11 -07:00 |
|
|
sglang-botandClaude Opus 4.7
|
0a2615df24
|
chore: add vLLM SPDX copyright headers to ported files (#25182)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-05-13 15:17:30 -07:00 |
|
|
Khoa Pham
|
49ac447c94
|
[bench] Agentic support for bench_serving.py (#25016)
|
2026-05-12 16:00:45 -07:00 |
|
|
Xinyuan Tong
|
989a16187d
|
[Bench] Fix bench_serving missing reasoning_content stream chunks (#23954)
|
2026-04-30 15:00:27 -07:00 |
|
|
ybyang
|
41258f874d
|
[PD]feat(bench): add --fake-prefill flag for decode-only stress testing (#22973)
|
2026-04-16 13:57:55 -07:00 |
|
|
Xiaoyu Zhang
|
0f0f004f1f
|
[Benchmark] Add auto benchmark tool with YAML-driven server flag search and canonical dataset format (#21736)
|
2026-04-04 21:46:58 +08:00 |
|
|
David Cheung
|
ed427e1299
|
Migrate all callers from /get_server_info to /server_info (#21463)
|
2026-04-01 21:17:50 -07:00 |
|
|
|
d2fa8d67ba
|
Wrap IPv6 addresses in gRPC, bench_serving, and log messages (#21236)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-03-29 00:36:31 -07:00 |
|
|
Shu Wang
|
efebcab43e
|
Support skip-softmax attention (#19089)
|
2026-03-28 15:55:48 -07:00 |
|
|
satyamk7054andSatyam Kumar
|
a54d71e967
|
[Benchmark] Add sglang-embedding backend to bench_serving (#20017)
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
|
2026-03-11 13:13:16 -07:00 |
|
|
Qiaolin Yu
|
bd460e9565
|
add logprob related params in bench_serving (#20218)
|
2026-03-10 15:04:57 -07:00 |
|
|
Kalyan Kumarandgemini-code-assist[bot]
|
c1df359b44
|
Add XPU profiler activity support in benchmark code (#12981)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-03-04 23:22:56 -08:00 |
|
|
almaslof
|
b0f26698f5
|
feat(benchmark script): add similar to vllm --ready-check-timeout-sec parameter (#15466)
|
2026-03-03 13:44:38 -08:00 |
|
|
Ratish PandLiangsheng Yin
|
ae6f6e1495
|
[Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2026-02-24 12:22:01 -08:00 |
|
|
Liangsheng Yin
|
1f2da824dd
|
[Benchmark] Remove re-exports from bench_serving.py (#19130)
|
2026-02-21 14:30:30 -08:00 |
|
|
Ratish PandXuchun Shang
|
f158869c2c
|
[Refactor] Benchmark Phase 1: extract utils and datasets from bench_serving (#19077)
Co-authored-by: Xuchun Shang <107600043+xucsh@users.noreply.github.com>
|
2026-02-21 13:50:11 -08:00 |
|
|
Liangsheng Yin
|
2d85f01d43
|
Revert "Fix generated-shared-prefix bench_serving" (#18956)
|
2026-02-17 20:43:55 -08:00 |
|
|
Qiaolin Yu
|
3c601db031
|
Fix generated-shared-prefix bench_serving (#18769)
|
2026-02-17 14:00:22 -08:00 |
|
|
akhilg-nv
|
48eac1b62d
|
Improve profiler options for bench_serving (#16991)
|
2026-02-16 00:36:01 +08:00 |
|
|
Michaelandmichaelzhang-ai
|
88010e9601
|
[AMD] Fix nightly 1-GPU test failures and bench_serving regression (#18761)
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
|
2026-02-15 20:36:47 +08:00 |
|
|
Liangsheng Yin
|
cd90346a2b
|
Add cache hit rate UT (#18566)
|
2026-02-10 21:27:41 -08:00 |
|
|
gaopengff
|
7541da15d2
|
Fix prefill latency performance drop of bench serving (#14592)
|
2026-01-29 21:28:17 -08:00 |
|
|
Douglas Yang
|
4c7136bb36
|
feature: adding openai compatible API request to bench_serving (#17219)
|
2026-01-23 16:04:28 -08:00 |
|
|
fzyzcjy
|
d874c8bba4
|
Tiny support http headers in bench serving (#16606)
|
2026-01-07 10:15:17 +08:00 |
|
|
fzyzcjy
|
ed307a40bf
|
Tiny add --gsp-ordered (#16575)
|
2026-01-06 22:43:52 +08:00 |
|
|
Raayan Dhar
|
84d13c54bb
|
feat: only add input vision tokens in bench_serving result if vision dataset is used (#15492)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
|
2026-01-06 12:14:42 +08:00 |
|
|
fzyzcjy
|
c105a3124b
|
Support multi-round conversations in bench_serving (#6135)
|
2026-01-06 11:59:39 +08:00 |
|
|
Kangyan-Zhou
|
12b89e51d8
|
Add P90/99 e2e latency in bench_serving script (#16245)
|
2025-12-31 15:40:33 -08:00 |
|
|
jiapingWandXinyuan Tong
|
278012caa0
|
[Feature] support bench jsonl files with sharegpt format (#15057)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-12-29 10:06:11 -08:00 |
|
|
fzyzcjy
|
c12567274a
|
Tiny change bench-serving to use routing key header (#15827)
|
2025-12-25 21:29:49 +08:00 |
|
|
fzyzcjy
|
ad7f35fb9d
|
Support gsp send routing id in bench serving (#15588)
|
2025-12-22 11:32:24 +08:00 |
|
|
fzyzcjy
|
f4100732b8
|
Tiny fix bench serving GSP mode cache file strategy (#15587)
|
2025-12-22 11:27:55 +08:00 |
|
|
|
bed301a5ac
|
[Feature] Enable return routed experts (#12162)
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-21 15:16:43 +08:00 |
|
|
b8zhong
|
e72b02db28
|
tiny fix lint on main (#15424)
|
2025-12-18 15:55:02 -08:00 |
|
|
Frankandgemini-code-assist[bot]
|
9749d3e346
|
Update benchmarks to use HF token from environment. (#15421)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 13:47:27 -08:00 |
|
|
|
9acb21ae27
|
feat: support EPD disaggregation (#12263)
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: Nicholas <45984215+liusy58@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2025-12-14 22:30:08 +08:00 |
|
|
fzyzcjy
|
df111bc0fe
|
Super tiny add gsp-fast-prepare (#14992)
|
2025-12-13 09:45:21 +08:00 |
|
|
fzyzcjy
|
45eeeb9a3c
|
Tiny support range ratio in GSP in bench serving (#14828)
|
2025-12-11 17:26:07 +08:00 |
|
|
fzyzcjy
|
a368df2818
|
Tiny add more error info for bench_serving (#14827)
|
2025-12-11 17:25:49 +08:00 |
|
|
fzyzcjy
|
119fd956fb
|
Tiny support printing requests in bench_serving for observability (#14652)
|
2025-12-09 08:27:58 +08:00 |
|
|
Baizhou Zhang
|
42fcf5438f
|
Revert "tiny remove deprecated endpoint call" (#14533)
|
2025-12-05 23:48:54 -08:00 |
|
|
b8zhong
|
ec7b2c16d9
|
tiny remove deprecated endpoint call (#13607)
|
2025-12-05 09:54:49 -08:00 |
|
|
Xiaoyu Zhangandgithub-actions[bot]
|
9c80072845
|
Add peak output tokens per second in bench_serving (#14165)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-12-01 17:47:54 +08:00 |
|
|
fzyzcjy
|
487c8d4df3
|
Tiny add several args to bench serving (#14181)
|
2025-12-01 14:45:47 +08:00 |
|