Commit Graph
23 Commits
Author SHA1 Message Date
Liangsheng Yin cf93712937 [misc] Share bench HTTP-client base-URL resolution with IPv6-compatible formatting (#28598) 2026-06-17 20:50:49 -07:00
Liangsheng Yin d2b5488392 [misc] Centralize bench launch-vs-connect into a reusable acquire_endpoint (#28592) 2026-06-17 19:40:43 -07:00
Chetan Kumar Verma 732b81d5b9 [Fix] DeepSeek-OCR-2 bench_serving: fix processor loading (#28483) 2026-06-17 15:29:37 -07:00
Rohit Kumar Singhandgithub-actions[bot] 9371062ef3 Fix deep seek ocr2 image processing (#27884)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-06-17 12:59:18 +08:00
Michael a32aeb688a [AMD] Fix AttributeError in GeneratedSharedPrefixDataset.from_args for in-process callers (#27580) 2026-06-08 21:53:14 -07:00
Bowen WangandXinyuan Tong 07f326c184 Fix multimodal synthetic benchmark prompt generation to exclude special tokens (#26864)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-06-04 22:27:43 +00:00
Jimmy Shong f838adb7d4 bench_serving: add Zipfian shared-prefix sampling to generated-shared-prefix (#26378) 2026-05-28 14:39:46 -07:00
97d129f8c6 # feat(bench): add SPEED-Bench dataset support to bench_serving (#24149)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
2026-05-28 14:37:00 -07:00
Bishwo Adhikari 46e0f5007d Fix image (random multimodal) dataset token statistics (#22371) 2026-05-16 23:12:03 -07:00
Mick ff70aeac30 [diffusion] feat: add performance mode server args (#24491) 2026-05-14 00:57:46 +08:00
Khoa Pham 49ac447c94 [bench] Agentic support for bench_serving.py (#25016) 2026-05-12 16:00:45 -07:00
Yihao Wang 9150e77399 [Model] Add MiniCPM-V 4.6 support (#24855) 2026-05-10 12:24:17 -04:00
Lianmin Zheng e40e339c72 Filter non-int token ids in benchmark and observe decode-side bootstrap/alloc metrics (#24684) 2026-05-08 11:45:37 -07:00
Yuhao Yang 16f306fd85 [VLM] GPU Image Preprocessing for Kimi-K2.5 (#22368) 2026-04-11 11:13:30 +08:00
Xiaoyu Zhang 0f0f004f1f [Benchmark] Add auto benchmark tool with YAML-driven server flag search and canonical dataset format (#21736) 2026-04-04 21:46:58 +08:00
Yuhao Yang 4e69f14b95 fix bench_serving sglang backend to support image dataset (#21294) 2026-03-29 10:02:11 +08:00
Shu Wang efebcab43e Support skip-softmax attention (#19089) 2026-03-28 15:55:48 -07:00
Liangsheng Yin c580ddd19d Fix benchmark generating empty prompts when random_input_len is small (#21492) 2026-03-26 16:24:35 -07:00
Mook abc672e717 [Benchmark] use flashinfer bench_gpu_time instead of triton do_bench (#20305) 2026-03-12 04:04:30 +00:00
satyamk7054andSatyam Kumar a54d71e967 [Benchmark] Add sglang-embedding backend to bench_serving (#20017)
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
2026-03-11 13:13:16 -07:00
a0a8f1473c [Benchmark] Fix generated_shared_prefix attribute naming and remove args dependency (#19363)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2026-02-25 18:45:54 -08:00
Ratish PandLiangsheng Yin ae6f6e1495 [Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2026-02-24 12:22:01 -08:00
Ratish PandXuchun Shang f158869c2c [Refactor] Benchmark Phase 1: extract utils and datasets from bench_serving (#19077)
Co-authored-by: Xuchun Shang <107600043+xucsh@users.noreply.github.com>
2026-02-21 13:50:11 -08:00