 Jae B.
|
a91c2e6596
|
[Apple Silicon] [CI] Move the MLX lane to the check-changes + pr-gate composite (#30121)
|
2026-07-10 22:00:15 -07:00 |
|
|
Alison Shao
|
90688366d9
|
test(disagg): set MC_GID_INDEX on RoCE hosts so mooncake KV transfer works (#30737)
|
2026-07-11 11:29:22 +08:00 |
|
|
Xinyuan Tong
|
b76dd0be69
|
Fix Mistral GSM8K chat eval (#27757)
|
2026-07-09 21:08:48 -07:00 |
|
|
Cheng Wan
|
1f15308dca
|
[refactor] Retire the legacy config accessor and the remaining process singletons (#30493)
|
2026-07-09 02:10:47 -07:00 |
|
|
Cheng Wan
|
e703f9e566
|
[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492)
|
2026-07-09 02:09:39 -07:00 |
|
|
Liangsheng Yin
|
bc5d376c2c
|
[Bench] Add fixed-prompt mode and per-request spec accept length metrics (#30615)
|
2026-07-09 02:06:04 -07:00 |
|
|
Cheng Wan
|
b14f7b4f75
|
[refactor] Move model-capability adjustments into the resolution pipeline (#30299)
|
2026-07-07 21:26:55 -07:00 |
|
|
|
16372b4c5f
|
[Spec] Anchor GLM-5.2 MTP IndexShare topk on the draft-extend step (#29787)
Co-authored-by: kpham-sgl <264503018+kpham-sgl@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-06 20:36:48 -07:00 |
|
|
hhhh1252023
|
1b481deade
|
feat: sync npu nightly test improvements from Ascend testcases (#29403)
|
2026-07-06 22:41:15 +08:00 |
|
|
Lianmin Zheng
|
9d00385b63
|
Cleanup: relocate temp_set_env and consolidate multi-device/CUDA helpers in common.py (#30180)
|
2026-07-05 18:47:26 -07:00 |
|
|
Xinyuan Tong
|
854b46be99
|
feat(parser): resolve special-token suffix at runtime for compatibility (#29920)
|
2026-07-05 00:13:46 +08:00 |
|
|
Baizhou Zhang
|
1f0f353d92
|
[CI] Add GLM52 NVFP4 MTP B200 tests (#30021)
|
2026-07-03 13:43:38 -07:00 |
|
|
Xiaoyu Zhang
|
b276a9acee
|
chore: cleanup garbage code (#29770)
|
2026-07-02 16:14:01 +08:00 |
|
|
cctry
|
697b400d70
|
Share one logits output buffer across prefill/decode/draft cuda-graph runners (#29779)
|
2026-07-01 23:30:56 -07:00 |
|
|
YAMYandYuwei An
|
307094dc7d
|
[DeepSeek V4] Cover both dense and sparse prefill paths in the compress attention unittest (#29885)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-07-01 21:20:12 -07:00 |
|
|
Xinyuan TongandAlison Shao
|
0c1a0be3b2
|
fix(precision): do not promote failed runs to the comparison baseline (#28190)
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
|
2026-07-01 18:19:15 -07:00 |
|
|
Mohammad Miadh Angkad
|
8f0d320d31
|
[Spec] Enable FlashInfer autotune for spec draft (#29595)
|
2026-07-01 13:36:07 -07:00 |
|
|
ashwini rathiandSinghal, Shubham
|
5134dcdcab
|
[Intel XPU] Initially add nightly GSM8K accuracy tests for Llama-3.1-8B (TP=2) and Qwen3-32B (TP=4) (#28908)
Co-authored-by: Singhal, Shubham <shubham.singhal@intel.com>
|
2026-07-01 16:27:24 +08:00 |
|
|
Cheng Wanandlch1475369
|
fc96edd297
|
feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533)
Co-authored-by: lch1475369 <lch1475369@gmail.com>
|
2026-06-29 14:49:54 -07:00 |
|
|
Liangsheng Yin
|
c0d45cda29
|
[Spec] Add DFLASH basic sanity CI test (#29338)
|
2026-06-28 23:45:05 -07:00 |
|
|
Liangsheng Yin
|
909123ddb8
|
[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)
|
2026-06-28 18:38:28 -07:00 |
|
|
Rain JiangandLianmin Zheng
|
be1930133a
|
Convert IPC dataclasses to msgspec.Struct with opt-in msgpack transport (#28688)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-26 12:04:03 -07:00 |
|
|
Khoa PhamandCursor
|
eeee3abbbf
|
[CI] Fix false spec accept length failure after profiling phase (#29329)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-25 22:19:30 -07:00 |
|
|
Liangsheng Yin
|
b6ebdcc92e
|
[test] Split perf table out of fwd occupancy kit report (#29348)
|
2026-06-25 20:23:42 -07:00 |
|
|
hhhh1252023
|
781537b61d
|
[NPU] Nightly CI refactor and enhancement (#27433)
|
2026-06-26 08:52:06 +08:00 |
|
|
Liangsheng Yin
|
e4696ed62d
|
[test] Report token tps in fwd occupancy kit and force ignore_eos (#29332)
|
2026-06-25 15:08:33 -07:00 |
|
|
Liangsheng Yin
|
c7734e6871
|
[Spec] Dissolve EagleDraftInputV2Mixin so spec-info dataclasses hold data only (#29220)
|
2026-06-24 18:08:30 -07:00 |
|
|
Even Zhou
|
4da23fdc35
|
[NPU] removes deprecated pr testing files (#27859)
|
2026-06-24 16:06:45 +08:00 |
|
|
Alex Tumanov
|
33373cbb12
|
[misc] Move bench_serving into sglang.benchmark (#28996)
|
2026-06-23 19:34:11 -07:00 |
|
|
Liangsheng Yin
|
b448b08401
|
[misc] Move bench_offline_throughput into sglang/benchmark/ with a back-compat shim (#28747)
|
2026-06-23 18:37:52 -07:00 |
|
|
Lianmin Zheng
|
34dd9c28ca
|
[Refactor] Introduce sock_send/sock_recv wrappers for zmq IPC (#29012)
|
2026-06-23 15:54:36 -07:00 |
|
|
Liangsheng Yin
|
c864c8d9c2
|
[misc] Move bench_one_batch into sglang/benchmark/ with a back-compat shim (#28687)
|
2026-06-23 14:48:35 -07:00 |
|
|
Liangsheng Yin
|
ed0a62e4dd
|
[Mem] Add KV-page double-free checks to the invariant checker (#27731)
|
2026-06-23 02:29:40 -07:00 |
|
|
cctryandcctry
|
0c065671c9
|
[Spec] Redo: split init_backends; account draft weights in --mem-fraction-static (#28855)
Co-authored-by: cctry <cctry@fb.com>
|
2026-06-21 20:45:16 -07:00 |
|
|
Lianmin Zheng
|
7942d546d1
|
Revert "[Spec] Split init_backends; account draft weights in --mem-fraction-static" (#28841)
|
2026-06-21 07:52:35 -07:00 |
|
|
cctry
|
9691a29fe0
|
[Spec] Split init_backends; account draft weights in --mem-fraction-static (#28683)
|
2026-06-21 01:22:26 -07:00 |
|
|
Liangsheng Yin
|
d271de64fe
|
[misc] Move bench_one_batch_server into sglang/benchmark/ with a back-compat shim (#28625)
|
2026-06-19 14:19:29 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
856b0dc74b
|
refactor(runner): move kernel warmup into the shared runner lifecycle (warmup()) (#28739)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-19 13:13:13 -07:00 |
|
|
|
ab0714d0ee
|
ci: run GB300 nightly suite in the standard Nvidia nightly workflow (#28536)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-19 12:24:38 -07:00 |
|
|
Liangsheng Yin
|
9bb9d17e1a
|
[Spec] Unify speculative grammar token-accept path in decode processing (#28682)
|
2026-06-19 02:49:40 -07:00 |
|
|
Cheng Wan
|
1c6331cbd6
|
refactor(runner): rename runner replay/load/can_run for the shared surface (#28384)
|
2026-06-19 01:45:04 -07:00 |
|
|
cctry
|
7976928c57
|
Abort during chunked prefill + PD peer-liveness abort (#28086)
|
2026-06-17 23:13:28 -07:00 |
|
|
Liangsheng Yin
|
cf93712937
|
[misc] Share bench HTTP-client base-URL resolution with IPv6-compatible formatting (#28598)
|
2026-06-17 20:50:49 -07:00 |
|
|
Cheng Wan
|
53318911ca
|
Add get_parallel(): a structured accessor for parallel-topology state (#28567)
|
2026-06-17 20:23:43 -07:00 |
|
|
Dongjun Na
|
462c01ea6b
|
[observability] add Ray metric backend wrappers (#26252)
Signed-off-by: Dongjun Na <kmu5544616@gmail.com>
|
2026-06-17 19:41:53 -07:00 |
|
|
Liangsheng Yin
|
d2b5488392
|
[misc] Centralize bench launch-vs-connect into a reusable acquire_endpoint (#28592)
|
2026-06-17 19:40:43 -07:00 |
|
|
Liangsheng Yin
|
a663500ea9
|
[Test] Fold EAGLE return_hidden_states regression into spec triton suite (#28577)
|
2026-06-17 16:42:02 -07:00 |
|
|
Liangsheng Yin
|
e053890b6f
|
[Fix] Reuse an already-running server in bench_one_batch_server instead of forking an orphan (#28563)
|
2026-06-17 15:14:44 -07:00 |
|
|
Ryan Zzzandzhujunyu
|
8fd1694dd2
|
Deepseek v4: support mixed dtype compression states (#27277)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
|
2026-06-17 00:56:41 -07:00 |
|
|
Lianmin ZhengandIan O'Connell
|
7e629a2f8c
|
Allow overriding tokenizer path in benchmark harness (#28280)
Co-authored-by: Ian O'Connell <ianoc@meta.com>
|
2026-06-15 13:07:50 -07:00 |
|