 Liangsheng Yin
|
558c9bdcc2
|
[misc] Improve benchmark determinism and dataset API coverage (#33255)
|
2026-08-02 01:39:50 -07:00 |
|
|
Yuwei AnandClaude Fable 5
|
3e0f7c3f30
|
[BCG][3/N] Enable bcg on dsa & deepep a2a backend (#31987)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-31 16:45:18 -07:00 |
|
|
Rain Jiang
|
4af8ddb576
|
support rust sglang server (#29799)
|
2026-07-31 11:56:31 -07:00 |
|
|
Mick
|
22faf9fef8
|
embedding: centralize capabilities and complete OpenAI compatibility (#32481)
|
2026-07-30 10:28:52 +08:00 |
|
|
Xiaoyu Zhang
|
075bd97952
|
[Benchmark] Remove obsolete auto-benchmark remnants (#31941)
|
2026-07-21 20:44:52 +08:00 |
|
|
fzyzcjy
|
e77d95c3d5
|
Pass per-forward overrides to ForwardBatch.init_new as explicit arguments (#30670)
|
2026-07-15 14:25:59 +08:00 |
|
|
Mick
|
43124cdd90
|
fix: fix image benchmark backend parity (#30867)
|
2026-07-15 10:11:22 +08:00 |
|
|
fzyzcjy
|
6999007a13
|
Drop ModelRunner's duplicated parallel-degree fields and read them via self.ps (#31165)
|
2026-07-14 16:02:40 +08:00 |
|
|
fzyzcjy
|
725920915f
|
Introduce ModelRunner.ps ParallelState (#31161)
|
2026-07-14 16:01:14 +08:00 |
|
|
|
6cc9352dfe
|
[Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-07-12 17:25:26 -05:00 |
|
|
Mick
|
af66370d81
|
bench: support random image resolutions (#30879)
|
2026-07-12 08:28:56 +08:00 |
|
|
Liangsheng Yin
|
348e6fd29b
|
[Fix] Guard kernel OOB accesses and harden runtime edge cases (#30847)
|
2026-07-11 14:22:13 -05:00 |
|
|
Liangsheng Yin
|
078f06fbf4
|
[Refactor] Share chat encoding dispatch between serving and offline tools (#30623)
|
2026-07-09 02:45:42 -07:00 |
|
|
Cheng Wan
|
e703f9e566
|
[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492)
|
2026-07-09 02:09:39 -07:00 |
|
|
Liangsheng Yin
|
bc5d376c2c
|
[Bench] Add fixed-prompt mode and per-request spec accept length metrics (#30615)
|
2026-07-09 02:06:04 -07:00 |
|
|
|
3a679459e5
|
[bench] Add agentic-trace multi-turn dataset to bench_serving (#29215)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-06 19:45:44 -07:00 |
|
|
Lijuan Tang
|
3cdc2415b1
|
[MLX] Fix step-bounded profiling for bench tools on Apple Silicon (#29217)
|
2026-06-30 22:55:29 -07:00 |
|
|
Polisetty V R K Jyothendra Varma
|
d5abafcc1c
|
[Intel GPU] add pytorch profiling support for XPU in bench offline throughput and enhance num steps (#28308)
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
|
2026-06-29 09:10:15 +08:00 |
|
|
fzyzcjy
|
7002a37ea1
|
Inline extend_range accessors and remove the extend_input_len/fill_len properties (#27611)
|
2026-06-25 08:56:44 +08:00 |
|
|
Liangsheng Yin
|
e3f1fa9d8e
|
[misc] Unify benchmark deprecation shims and one_batch_server CLI entrypoint (#29108)
|
2026-06-23 21:10:25 -07:00 |
|
|
Alex Tumanov
|
52b89c4948
|
[misc] Add bench_serving compatibility shim (#28997)
|
2026-06-23 19:49:53 -07:00 |
|
|
Alex Tumanov
|
33373cbb12
|
[misc] Move bench_serving into sglang.benchmark (#28996)
|
2026-06-23 19:34:11 -07:00 |
|
|
Liangsheng Yin
|
f76c6c95be
|
[misc] Add sglang.bench_offline_throughput deprecation shim (#29085)
|
2026-06-23 18:39:58 -07:00 |
|
|
Liangsheng Yin
|
b448b08401
|
[misc] Move bench_offline_throughput into sglang/benchmark/ with a back-compat shim (#28747)
|
2026-06-23 18:37:52 -07:00 |
|
|
Liangsheng Yin
|
11e7c9e0e6
|
[misc] Add sglang.bench_one_batch deprecation shim (#29082)
|
2026-06-23 14:57:35 -07:00 |
|
|
Liangsheng Yin
|
c864c8d9c2
|
[misc] Move bench_one_batch into sglang/benchmark/ with a back-compat shim (#28687)
|
2026-06-23 14:48:35 -07:00 |
|
|
vikram singh shekhawatandClaude Sonnet 4.6
|
e63b57da0b
|
[Fix] model init / XPU / transformers-v5 / bench-image fixes (#28292)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-06-23 12:58:13 +08:00 |
|
|
Lianmin ZhengandYinghai Lu
|
45d203fb08
|
Fix tokenizer state cleanup on dispatch failure (#28694)
Co-authored-by: Yinghai Lu <yinghai@meta.com>
|
2026-06-19 21:55:39 -07:00 |
|
|
Liangsheng Yin
|
d271de64fe
|
[misc] Move bench_one_batch_server into sglang/benchmark/ with a back-compat shim (#28625)
|
2026-06-19 14:19:29 -07:00 |
|
|
Liangsheng Yin
|
cf93712937
|
[misc] Share bench HTTP-client base-URL resolution with IPv6-compatible formatting (#28598)
|
2026-06-17 20:50:49 -07:00 |
|
|
Liangsheng Yin
|
d2b5488392
|
[misc] Centralize bench launch-vs-connect into a reusable acquire_endpoint (#28592)
|
2026-06-17 19:40:43 -07:00 |
|
|
Chetan Kumar Verma
|
732b81d5b9
|
[Fix] DeepSeek-OCR-2 bench_serving: fix processor loading (#28483)
|
2026-06-17 15:29:37 -07:00 |
|
|
Rohit Kumar Singhandgithub-actions[bot]
|
9371062ef3
|
Fix deep seek ocr2 image processing (#27884)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2026-06-17 12:59:18 +08:00 |
|
|
Michael
|
a32aeb688a
|
[AMD] Fix AttributeError in GeneratedSharedPrefixDataset.from_args for in-process callers (#27580)
|
2026-06-08 21:53:14 -07:00 |
|
|
Bowen WangandXinyuan Tong
|
07f326c184
|
Fix multimodal synthetic benchmark prompt generation to exclude special tokens (#26864)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-04 22:27:43 +00:00 |
|
|
Jimmy Shong
|
f838adb7d4
|
bench_serving: add Zipfian shared-prefix sampling to generated-shared-prefix (#26378)
|
2026-05-28 14:39:46 -07:00 |
|
|
|
97d129f8c6
|
# feat(bench): add SPEED-Bench dataset support to bench_serving (#24149)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
|
2026-05-28 14:37:00 -07:00 |
|
|
Bishwo Adhikari
|
46e0f5007d
|
Fix image (random multimodal) dataset token statistics (#22371)
|
2026-05-16 23:12:03 -07:00 |
|
|
Mick
|
ff70aeac30
|
[diffusion] feat: add performance mode server args (#24491)
|
2026-05-14 00:57:46 +08:00 |
|
|
Khoa Pham
|
49ac447c94
|
[bench] Agentic support for bench_serving.py (#25016)
|
2026-05-12 16:00:45 -07:00 |
|
|
Yihao Wang
|
9150e77399
|
[Model] Add MiniCPM-V 4.6 support (#24855)
|
2026-05-10 12:24:17 -04:00 |
|
|
Lianmin Zheng
|
e40e339c72
|
Filter non-int token ids in benchmark and observe decode-side bootstrap/alloc metrics (#24684)
|
2026-05-08 11:45:37 -07:00 |
|
|
Yuhao Yang
|
16f306fd85
|
[VLM] GPU Image Preprocessing for Kimi-K2.5 (#22368)
|
2026-04-11 11:13:30 +08:00 |
|
|
Xiaoyu Zhang
|
0f0f004f1f
|
[Benchmark] Add auto benchmark tool with YAML-driven server flag search and canonical dataset format (#21736)
|
2026-04-04 21:46:58 +08:00 |
|
|
Yuhao Yang
|
4e69f14b95
|
fix bench_serving sglang backend to support image dataset (#21294)
|
2026-03-29 10:02:11 +08:00 |
|
|
Shu Wang
|
efebcab43e
|
Support skip-softmax attention (#19089)
|
2026-03-28 15:55:48 -07:00 |
|
|
Liangsheng Yin
|
c580ddd19d
|
Fix benchmark generating empty prompts when random_input_len is small (#21492)
|
2026-03-26 16:24:35 -07:00 |
|
|
Mook
|
abc672e717
|
[Benchmark] use flashinfer bench_gpu_time instead of triton do_bench (#20305)
|
2026-03-12 04:04:30 +00:00 |
|
|
satyamk7054andSatyam Kumar
|
a54d71e967
|
[Benchmark] Add sglang-embedding backend to bench_serving (#20017)
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
|
2026-03-11 13:13:16 -07:00 |
|
|
|
a0a8f1473c
|
[Benchmark] Fix generated_shared_prefix attribute naming and remove args dependency (#19363)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
|
2026-02-25 18:45:54 -08:00 |
|