Commit Graph
24 Commits
Author SHA1 Message Date
Ata Fatahi 866ae6848f [PDD] Add true request retraction for PDD (#25372)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2026-07-09 15:33:01 +08:00
Liangsheng Yin 909123ddb8 [misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591) 2026-06-28 18:38:28 -07:00
Liangsheng Yin 9bb9d17e1a [Spec] Unify speculative grammar token-accept path in decode processing (#28682) 2026-06-19 02:49:40 -07:00
9fc9d37f6d Fix spec decoding with grammar in disagg (#24082)
Co-authored-by: jimmy.shong <jimmy.shong@radixark.ai>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Codex <codex@example.com>
2026-06-18 14:58:32 -07:00
cctry 7976928c57 Abort during chunked prefill + PD peer-liveness abort (#28086) 2026-06-17 23:13:28 -07:00
ybyang 1e71c1a859 fix(pd): disable overlap for spec+grammar in disagg decode loop (#28039) 2026-06-12 14:08:36 -07:00
Ye (Charlotte) Qi 03c77dc33d [PD] Deduplicate PD logprob normalization (#27085) 2026-06-03 19:08:15 +08:00
Jun Liu c47f0e7cdd [PD] Fix top logprobs crash in prefill path (#26299) 2026-05-26 22:01:10 +08:00
Liangsheng Yin b7d62bd724 [CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420) 2026-05-15 18:26:55 -07:00
Liangsheng Yin 22d3f3996c ci: decouple stage and runner for cuda registry (#25197) 2026-05-13 17:28:21 -07:00
sglang-botandsglang-bot da175b964d chore: update CI test est_time values (#23785)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-04-26 20:17:50 -07:00
Shangming Cai 1c06a3d072 [CI] Move disaggregation basic CI back to 2-gpu suite (#23447) 2026-04-22 17:50:33 +08:00
6ecd6f84db [CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-04-19 05:32:36 -07:00
Liangsheng Yin da6b8e1448 Extract pause_resume_in_place kit; rename test_abort to test_scheduler_control (#22647) 2026-04-12 18:49:37 -07:00
Lawrence Wu 28e40d873c fix(PD): respect pause_generation in disagg event loops (#20908) 2026-04-12 18:07:51 -07:00
265696b176 chore: update CI test est_time values (#22565)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-04-10 18:15:02 -07:00
Liangsheng Yin 95cdbce34f [Test] Extract common PD server setup into base fixture (#22080) 2026-04-03 16:37:12 -07:00
Lawrence Wu 9593d434c4 fix: pause_generation should not populate running_batch on prefill nodes (#20273) 2026-04-03 16:16:06 -07:00
Liangsheng Yin d7256eb69a Unify GSM8K eval path to Chat API for regression CI readiness (#21667) 2026-04-01 17:12:19 -07:00
Liangsheng Yin b6fe0cca99 Switch MooncakeSpec to EAGLE3 + Llama-3.1 (#21794) 2026-03-31 17:12:20 -07:00
Ke Bao 92492896a5 Fix disaggregation test bootstrap port conflict (#21271) 2026-03-24 21:14:41 -07:00
Lianmin Zheng 814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
shuwenn 3299c4f9c1 [CI] feat: add early exit to wait_for_server when process dies (#18602) 2026-02-13 16:46:09 -08:00
Alison Shao 63cc97f4ef ci: migrate 2-GPU tests to test/registered/ (#16529) 2026-01-07 20:28:16 -08:00