Commit Graph
75 Commits
Author SHA1 Message Date
Ratish P dbac464726 [Spec]: Make Triton standalone spec test deterministic (#25303) 2026-05-18 17:36:10 -07:00
52875ab6f4 [AMD][CI] Register Eagle constrained decoding test (#25260)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-05-16 23:02:35 -07:00
Liangsheng Yin b7d62bd724 [CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420) 2026-05-15 18:26:55 -07:00
ba214ef3d3 ci: tag-gated nightly migration — foundation + 40 whole-file moves (#24725)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-14 16:11:15 -07:00
Alison Shao 1e308aec66 ci: B200 conditional split + LPT_SLOP removal (stage-c partition 8→3) (#25203) 2026-05-13 18:40:45 -07:00
Liangsheng Yin 22d3f3996c ci: decouple stage and runner for cuda registry (#25197) 2026-05-13 17:28:21 -07:00
Mick ff70aeac30 [diffusion] feat: add performance mode server args (#24491) 2026-05-14 00:57:46 +08:00
Liangsheng YinandQiaolin Yu 538832c8b7 spec: STANDALONE skips hidden_states end-to-end (Optional schema + None-safe consumers) (#25037)
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
2026-05-12 12:27:21 -07:00
Liangsheng Yin 1613bae412 [Spec] Disambiguate verified_id into bonus_token(s) / accept_tokens (#24724) 2026-05-08 18:24:33 -07:00
Alison Shao 5fbec0e445 ci: prune per-commit CUDA tests — move 25 files + 13 testcases to test/manual/ (#24721) 2026-05-08 15:53:23 -07:00
shuwennandQiaolin-Yu d9dddd4d7d [SPEC V2][2/N] feat: adaptive spec support spec v2 (#23336)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2026-05-07 18:33:47 -07:00
Alison ShaoandAlison Shao 694ef516cb Revert "[ci] split stage-c-test-4-gpu-b200 to enable a low-disk runner pool" (#24163)
Co-authored-by: Alison Shao <alisonshao@radixark.ai>
2026-04-30 15:57:19 -07:00
Qiaolin Yu 79dbfe4505 Use spec v2 by default (#21062) 2026-04-29 13:40:42 -07:00
sglang-botandsglang-bot da175b964d chore: update CI test est_time values (#23785)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-04-26 20:17:50 -07:00
Kangyan-ZhouandClaude Opus 4.7 77fd86f89e [ci] split stage-c-test-4-gpu-b200 to enable a low-disk runner pool (#23417)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-21 18:33:33 -07:00
shuwennandQiaolin-Yu b65799cf83 [SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2026-04-20 14:25:04 -07:00
Alison ShaoandAlison Shao d6c9d9116b [CI] Update B200 est_times to prevent timeouts on slower machine (#22609)
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
2026-04-11 21:40:34 -07:00
265696b176 chore: update CI test est_time values (#22565)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-04-10 18:15:02 -07:00
45b0182205 [CI] Update est_time for 64 tests based on actual elapsed times (#22305)
Co-authored-by: Alison Shao <alison.shao@Mac.lan>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
2026-04-09 20:31:37 -07:00
YMbmzy 8a67fb20ea [Speculative] Support penalty for spec v2 overlap scheduling (#22049) 2026-04-09 01:59:04 -07:00
Qiaolin YuandLiangsheng Yin 117508dcd7 Switch eagle_infer_beta to EAGLE3 (#22303)
Co-authored-by: Liangsheng Yin <hnyls2002@users.noreply.github.com>
2026-04-07 18:43:48 -07:00
f08726fd56 [Feature] Add DFLASH speculative decoding support (#22077)
Co-authored-by: Jian Chen <141193260+jianc99@users.noreply.github.com>
Co-authored-by: Zhijian Liu <5782437+zhijian-liu@users.noreply.github.com>
Co-authored-by: Richard Gong <8001209+gongy@users.noreply.github.com>
Co-authored-by: David Wang <21328423+dcw02@users.noreply.github.com>
Co-authored-by: yilian49 <43861414+yilian49@users.noreply.github.com>
Co-authored-by: xm:D <38322020+xiaomin-d@users.noreply.github.com>
2026-04-07 14:48:51 -07:00
Liangsheng Yin cc35714b03 [tiny] migrate /get_server_info; print accept length in accuracy tests (#22282) 2026-04-07 13:08:35 -07:00
Liangsheng Yin be0277f9a0 [Spec][Ngram] Add output-as-corpus accept length benchmark for external SAM (#22199) 2026-04-06 19:09:52 -07:00
Khoa Pham 12272b6791 [Spec][Ngram] 6/N: Load an external corpus and construct a Suffix Automaton (#21425) 2026-04-06 00:11:14 -07:00
Liangsheng Yin 6de2ff2a80 [Spec][Ngram] Followup fixes for MatchState incremental advance (#22180) 2026-04-05 23:04:28 -07:00
Khoa Pham b2008bf9e0 [Spec][Ngram] 5/N: Store and advance anchor match state across decode steps (#21243) 2026-04-05 22:21:05 -07:00
Liangsheng Yin e9d92b0e33 Relax spec decoding accuracy threshold to fix flaky test (#22100) 2026-04-04 02:38:35 -07:00
Liangsheng YinandDarkSharpness 9d9537fbd3 Migrate ngram corpus from torch cpp_extension to TVM FFI jit_kernel (#21920)
Co-authored-by: DarkSharpness <2040703891@qq.com>
2026-04-02 02:18:11 -07:00
Khoa Pham f836658077 [Spec][Ngram] 4/N: Remove max_match_window_size and min_match_window_size, matching all suffixes of the Trie (#21225) 2026-04-01 22:09:46 -07:00
David Cheung ed427e1299 Migrate all callers from /get_server_info to /server_info (#21463) 2026-04-01 21:17:50 -07:00
Liangsheng YinandClaude Opus 4.6 875a615993 fix(ci): update est_time for 57 tests based on runtime analysis (#21896)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-01 20:16:13 -07:00
Liangsheng Yin d7256eb69a Unify GSM8K eval path to Chat API for regression CI readiness (#21667) 2026-04-01 17:12:19 -07:00
Qiaolin Yu 5f6250769a Reduce redundant speculative decoding CI tests (#21779) 2026-03-31 17:40:20 -07:00
Vladislav NosivskoyandLianmin Zheng c37200f5e4 Scope streaming backlog coalescing to incremental_streaming_output mode (#21037)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-03-27 17:29:54 -07:00
Liangsheng Yin fb90c9d298 [Test] Consolidate eval accuracy test mixins into eval_accuracy_kit (#21047) 2026-03-26 14:26:46 -07:00
Michael 6cb1c2d53d [AMD] Add 4-GPU test suite for MI325 runners (#20294) 2026-03-24 14:04:49 -07:00
Lianmin Zheng 814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
kpham-sglandClaude Opus 4.6 bc4aaab6a1 [Spec][Ngram] 2/N: Rename branch length to max trie depth (#21181)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-22 23:35:25 -07:00
kpham-sgl 6d160b42bb [Spec][Ngram] 1/N: Reference based Speculative Decoding refactor (#20393) 2026-03-22 00:55:10 -07:00
Pai Liu 65dd08153d Fix Test* mixin classes being collected as standalone pytest tests (#20417) 2026-03-12 18:18:45 -07:00
Alison ShaoandAlison Shao 7b44bc923e Relax flaky B200 GSM8K accuracy thresholds (#20304)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
2026-03-11 12:35:21 -07:00
Alison ShaoandAlison Shao f32882cee5 [CI] Relax Eagle infer_b spec accept length threshold (#20300)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
2026-03-10 15:40:52 -07:00
09a118fafe Support return_logprob for spec v2 (overlap safe) (#19801)
Co-authored-by: Ratish1 <ratish1501@gmail.com>
Co-authored-by: Ratish1 <formula733@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-03-10 15:38:27 -07:00
kpham-sglandhnyls2002 346a4131cf [Spec] Refactor NaN/OOB checks to async maybe_detect_* with env-var control (#19899)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-03-05 13:51:05 -08:00
Hubert Lu 441045a7bf [AMD] Fix EAGLE3 speculative decoding with aiter attention backend (#19362) 2026-03-03 16:12:13 -08:00
Liangsheng Yin dcea74d63f Add timeout abort kits for normal / eagle. (#18815) 2026-02-13 17:57:30 -08:00
Alison Shao bedade1ef0 Merge stage-c-test-large-4-gpu suites into partitioned suites (#18325) 2026-02-06 15:32:33 -08:00
495290aefd enable ut test for xpu devices (#11712)
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
2026-02-03 11:15:14 -08:00
Alison Shao 146b5fcc84 [CI] Reorganize stage-b 1-GPU tests for 5090 compatibility (#16826) 2026-01-15 15:23:35 -08:00