Commit Graph
29 Commits
Author SHA1 Message Date
Liangsheng Yin c0480a88be [Spec] Retire Spec V1 (#27964) 2026-06-11 16:15:15 -07:00
2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-09 21:36:57 -07:00
Liangsheng Yin 28c1a3cb45 [Spec] Deprecate Spec V1 (#25464) 2026-06-08 13:10:27 -07:00
Liangsheng Yin 030bd5d3ed [Test] test_session_latency: assert streaming tail/head stability (#26230) 2026-05-24 14:06:41 -07:00
MichaelandHAI 4ef9bad223 [AMD] ci: register 5 framework tests to run on AMD CI (#25208)
Co-authored-by: HAI <hixiao@gmail.com>
2026-05-16 22:56:57 -07:00
Liangsheng Yin b7d62bd724 [CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420) 2026-05-15 18:26:55 -07:00
ba214ef3d3 ci: tag-gated nightly migration — foundation + 40 whole-file moves (#24725)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-14 16:11:15 -07:00
Liangsheng Yin 22d3f3996c ci: decouple stage and runner for cuda registry (#25197) 2026-05-13 17:28:21 -07:00
Mick ff70aeac30 [diffusion] feat: add performance mode server args (#24491) 2026-05-14 00:57:46 +08:00
sglang-botandsglang-bot da175b964d chore: update CI test est_time values (#23785)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-04-26 20:17:50 -07:00
Liangsheng Yin a4cf2ea128 streaming session: spec v2 bonus accounting + comprehensive test matrix (#22651) 2026-04-15 17:12:41 -07:00
Liangsheng Yin aa78564e1a Refactor streaming session abort handling (#22790) 2026-04-15 00:13:05 -07:00
Liangsheng Yin 9e6d1c066e TestStreamingSessionAbortLeakRepro: inherit stdout/stderr instead of tempfile (#22668) 2026-04-13 00:37:29 -07:00
c1ab68b45e fix: streaming session race condition + some metrics (#21875)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-04-12 18:05:23 -07:00
Liangsheng Yin f1eb4ca90c Fix streaming session busy check double-counting; add compat CI tests (#22213) 2026-04-12 01:48:16 -07:00
265696b176 chore: update CI test est_time values (#22565)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-04-10 18:15:02 -07:00
Liangsheng Yin ac039bd04e Use CustomTestCase for TestSessionControl to enable CI retry (#21830) 2026-04-01 04:26:11 -07:00
Aurick Qiao c2b3e42ad6 Fix sessions with mm inputs (#21269) 2026-03-26 17:38:23 -07:00
Liangsheng Yin cd634abee4 [CI] Reduce session correctness test to 30 turns to fix flakiness (#21349) 2026-03-24 18:56:01 -07:00
Lianmin Zheng 814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
Liangsheng Yin 6ad78b008b Consolidate streaming session tests (4 files → 3, fewer server starts) (#20961) 2026-03-19 19:13:28 -07:00
Leon Gao 63c38aba5e Fix token leak with logprob_start_len=0 in streaming sessions (#20557) 2026-03-19 15:37:27 -07:00
b1246c50f8 Fix chunked prefill and KV cache leaks for streaming sessions (#20476)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-03-13 02:36:55 -07:00
Qiaolin Yu a3d88a247b Enable piecewise-cuda-graph when logprob_start_len = -1 (#19453) 2026-03-10 12:50:57 -07:00
36b557d2c9 Fix streaming session with paged KV cache (SWA/MLA) (#20070)
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
2026-03-08 03:00:32 -07:00
Liangsheng Yin 69ec15ad74 [CI] Re-enable streaming session tests with correctness and stress coverage (#20084) 2026-03-07 18:18:11 -08:00
Alison ShaoandAlison Shao c584158135 [CI] Temporarily disable flaky test_priority_metrics on CUDA (#20075)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
2026-03-06 20:34:45 -08:00
Liangsheng Yin e08ef06758 [Session] Gate streaming sessions with --enable-streaming-session and spec v2 guard (#19531) 2026-02-27 18:14:55 -08:00
Aurick Qiaoandhnyls2002 c6cb0c9649 [Session] Add streaming mode with SessionAwareCache fast path (#19171)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-02-27 16:31:08 -08:00