Commit Graph
100 Commits
Author SHA1 Message Date
Liangsheng Yin a7fd810842 Allow editable install without .git with add fallback version in pyproject.toml (#16435) 2026-01-05 11:17:20 +08:00
Liangsheng Yin 229938805f Make personal configs optional in SGLang's official docker image. (#16365) 2026-01-04 12:27:13 +08:00
Liangsheng Yin db6b51a838 Add CI_PERMISSION sort hook. (#16200) 2025-12-31 12:15:15 +08:00
Liangsheng Yin ba67e006a7 Refactor speculative algorithm registry. (#16168) 2025-12-31 01:24:22 +08:00
Liangsheng Yin 4de59d83a1 Reduce stages of pr-test from 4 to 3. (#16173) 2025-12-30 22:21:48 +08:00
Liangsheng Yin b6871ba7c9 [CI] set max-parallel to 4 by default. (#16154) 2025-12-30 17:27:48 +08:00
Liangsheng Yin c2601f0d21 Fix wrong assigning extend_input_len_per_req with eagle. (#16129) 2025-12-30 15:51:53 +08:00
Liangsheng Yin 3946dad6fa Add attack204 into CI_PERMISSION (#16131) 2025-12-30 13:55:00 +08:00
Liangsheng Yin ac03ec0851 Add PR review process into template. (#16133) 2025-12-30 13:45:56 +08:00
Liangsheng Yin a435f55d18 Tiny print launch command with shlex (#16010) 2025-12-29 11:26:46 +08:00
Liangsheng Yin be3828a13b Tiny cleanup duplicate code for multi-layer eagle worker. (#16004) 2025-12-28 18:08:20 +08:00
Liangsheng Yin c7e7bfa32c Add EAGLE3 test with MMLU dataset. (#15945) 2025-12-28 16:07:58 +08:00
Liangsheng Yin bf90ea9c5b Unify spec v2's naming manner. (#15990) 2025-12-28 14:14:52 +08:00
Liangsheng Yin 9ad546d7e8 Tiny cleanup the models' name in test_utils (#15920) 2025-12-27 14:13:23 +08:00
Liangsheng Yin e75657c839 [Bug] fix piggyback load report return None bug (#15870) 2025-12-26 14:48:45 +08:00
Liangsheng Yin cb1812954a Introduce ModelRunnerKVCacheMixin to simplify the code. (#15821) 2025-12-26 11:17:33 +08:00
Liangsheng Yin f4e835af2f Cleanup ModelRunner (#15802) 2025-12-25 18:13:30 +08:00
Liangsheng Yin b311c43d13 Clarify None handling in sglang's environ (#15770) 2025-12-25 11:40:17 +08:00
Liangsheng Yin 159b128357 Tiny add flush for CI crash locating (#15769) 2025-12-24 22:47:10 +08:00
Liangsheng Yin d5fbbfd988 Retry removing wrong logic about max total token in spec decoding (#15748) 2025-12-24 21:13:26 +08:00
Liangsheng Yin cb719c74ad [2/N] clean duplicate code of logprob processing in spec. (#15593) 2025-12-24 15:21:13 +08:00
Liangsheng Yin 6292c24437 Tiny fix test eagle infer b. (#15716) 2025-12-24 11:57:15 +08:00
Liangsheng Yin 5f5a567768 Tiny add flush in the suite partition status print. (#15719) 2025-12-24 11:55:59 +08:00
Liangsheng Yin 0d0367e9d0 Tiny fix CI (#15696) 2025-12-24 01:51:08 +08:00
Liangsheng Yin bd572360f3 Tiny apply gsm8k mixin to ngram test (#15606) 2025-12-24 01:30:26 +08:00
Liangsheng Yin 705287b2e5 Tiny add more information in retract logging. (#15694) 2025-12-24 00:43:36 +08:00
Liangsheng Yinandgemini-code-assist[bot] 3c882db3ad Adjust wrong mtp meaning introduce by mimo (#15632)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-23 02:06:46 +08:00
Liangsheng Yin beae3f961c Adapt fixture-kit to gsm8k mixin (#15599) 2025-12-22 14:19:35 +08:00
Liangsheng Yin 393e2f9b62 Revert "[FusedMoE] Fix fused w13 tp sharded weight loading" (#15579) 2025-12-22 04:15:24 +08:00
Liangsheng Yin 8766a1dd24 [1 / N] Clean up logprob utils (#15509) 2025-12-22 03:12:25 +08:00
Liangsheng Yin b9ebf0ed63 Clean hidden_states_before_norm (#15485) 2025-12-20 09:38:46 +08:00
Liangsheng Yin 5dccd9bdcc Enhance protection rules of code owners (#15406) 2025-12-20 00:25:57 +08:00
Liangsheng Yin 933cef16cc Tiny fix mimo model conflicts with main (#15483) 2025-12-19 23:20:59 +08:00
Liangsheng Yin 374ad4cce0 Fix gpt-oss yarn with truncate argument (#14270) 2025-12-18 16:31:15 +08:00
Liangsheng Yinandgemini-code-assist[bot] 8b0a68f1bf Monkey patch deepseek-ocr's v_head_dim (#15384)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-18 16:28:07 +08:00
Liangsheng Yin 0c00220795 tiny unify environ usage (#15335) 2025-12-17 23:31:43 +08:00
Liangsheng Yin ecb401ed42 Enhance runtime memory check in CI (#15192) 2025-12-16 21:40:38 +08:00
Liangsheng Yin 372507649d Tiny improve summary text in bench_one_batch_server.py (#15158) 2025-12-15 14:59:11 +08:00
Liangsheng Yin 5c75907e62 Introduce native kv cache move (#15108) 2025-12-14 17:23:28 +08:00
Liangsheng Yin ed52d01b0b Fix spec info's filter when reqs are finished right after prefill (#14742) 2025-12-14 00:32:54 +08:00
Liangsheng Yin 90e7d4f78f Tiny adjust CI run suite (#15074) 2025-12-14 00:05:19 +08:00
Liangsheng Yin d977dd2e07 Fix IMA with flashinfer + spec + topk & Add radix attention test cases for eagle (#13740) 2025-12-13 23:04:41 +08:00
Liangsheng Yin 01e3b3f3a3 Fix decode OOM caused by retraction (#14939) 2025-12-13 12:59:17 +08:00
Liangsheng Yin 7160283800 Tiny remove the duplicate function in spec v2 (#14957) 2025-12-13 11:08:27 +08:00
Liangsheng Yin c660d8dfd0 Re-org eagle unit tests (#14909) 2025-12-12 12:25:39 +09:00
Liangsheng Yin 543d62d11a Introduce server_fixtures in sglang.test (#14899) 2025-12-11 22:30:33 +09:00
Liangsheng Yin bd7824b24d Minor code style fix for dllm (#14836) 2025-12-11 10:35:42 +09:00
Liangsheng Yin 503880dbbe [CI] fix UT success check in test_eagle_infer_beta_dp_attention.py (#14831) 2025-12-11 01:00:50 +09:00
Liangsheng Yinandzhanghaotong cbc7dcdaa7 Re-add the API serving timing metrics. (#14744)
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
Co-authored-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
2025-12-10 10:17:48 +09:00
Liangsheng Yin 125e17efd5 Add small model test for spec v2 + dp + trtllm_mla (#14576) 2025-12-07 23:55:00 +08:00
Liangsheng Yin 88c459c6c8 Tiny remove wrong import from python.sglang (#14577) 2025-12-07 22:07:49 +08:00
Liangsheng Yinandgemini-code-assist[bot] 441420e149 Add mooncake transfer_engine_bench into maunal test (#14429)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-04 22:35:00 +08:00
Liangsheng Yin 24903b88ba Tiny adjust CI testcases (#14362) 2025-12-03 21:19:51 +08:00
Liangsheng Yin 427a19b643 Remove cargo config also in .zshenv (#14267) 2025-12-02 11:31:53 +08:00
Liangsheng Yin a2423052f6 Add cuda event based on waiting value (#14214) 2025-12-01 18:51:44 +08:00
Liangsheng Yin 0a9d64530d Support grammar + spec + reasoning (#14163) 2025-11-30 21:19:57 +08:00
Liangsheng Yin bab033b970 Adjust max-parallel for CUDA CI (#14057) 2025-11-27 20:48:37 +08:00
Liangsheng Yin 0dd759e087 Put pr-gate after check-changes (#14009) 2025-11-27 01:40:16 +08:00
Liangsheng Yin 6c190cbda0 Rename: --hooks to --forward-hooks (#13994) 2025-11-26 22:26:28 +08:00
Liangsheng Yin eff6a07c8f Fix get_load API (#13991) 2025-11-26 22:07:51 +08:00
Liangsheng Yin 3421d049aa [CI] rename: per_commit -> registered (#13928) 2025-11-25 23:05:06 +08:00
Liangsheng Yinandalisonshao d3d404d3d7 [CI] CI registry update (#13927)
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
2025-11-25 22:43:19 +08:00
Liangsheng Yin b60e769d0e Tiny unpin uvloop for other backends (#13858) 2025-11-25 01:34:57 +08:00
Liangsheng Yin 981ca8313f [misc] Rename minilb install env & remove files & fix lint (#13831) 2025-11-24 13:50:00 +08:00
Liangsheng Yin b2f7b08c49 Refactor cache init logic (#13800) 2025-11-24 11:41:46 +08:00
Liangsheng Yin 5c2915494c [Scheduler] Tiny organize code style (#13806) 2025-11-23 23:41:34 +08:00
Liangsheng Yin 863124684c [Spec v2] Remove allocate_lens and enable over-allocation (#13478) 2025-11-22 22:49:10 +08:00
Liangsheng Yin 3397bcee84 Tiny support different prompts in send_one.py (#13768) 2025-11-22 21:59:58 +08:00
Liangsheng Yin 3e804bb0ba Update mem checker during busy (#13704) 2025-11-22 21:15:02 +08:00
Liangsheng Yin ac43822634 Refactor eagle bigram key matching (#13714) 2025-11-22 20:40:42 +08:00
Liangsheng Yin 964cdedc50 [CI] minor hot fix of model validation list (#13737) 2025-11-22 01:00:41 +08:00
Liangsheng Yin 4528cb7d40 [CI] apply pr-gate for XPU (#13663) 2025-11-20 23:07:04 +08:00
Liangsheng Yin 852eb6ce2a [CI] optimize CI workflow info (#13634) 2025-11-20 18:12:51 +08:00
Liangsheng Yinandgemini-code-assist[bot] 19729f723e [CI] Align metric units for CI rate limit (#13633)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-20 16:25:57 +08:00
Liangsheng Yin 196b940aed [3/N] CI refactor: move some manually triggered tests. (#13448) 2025-11-19 23:06:53 +08:00
Liangsheng Yin a1e1e533b9 Tiny enhance test suites sanity check (#13589) 2025-11-19 22:43:58 +08:00
Liangsheng Yin 97ba2c2d1e [CI] Fix CUDA workflow's dependency. (#13568) 2025-11-19 19:06:42 +08:00
Liangsheng Yin ba9102f924 Add lmsys/gpt-oss-20b-bf16 to model validation check (#13557) 2025-11-19 14:23:01 +08:00
Liangsheng Yin f7be98e113 [CI] fix amd 1 gpu basic test (#13551) 2025-11-19 11:47:41 +08:00
Liangsheng Yin f5566acc2a [CI] fix CI skipped on main (#13527) 2025-11-19 01:19:08 +08:00
Liangsheng Yin 6e9b154981 [CI] fix skipping pr-gate on main (#13525) 2025-11-19 00:57:22 +08:00
Liangsheng Yin 109f27ba3a [CI] update pr-gate to be compatible with new slash triggering mananer. (#13522) 2025-11-19 00:49:13 +08:00
Liangsheng Yin 33905005ee [CI] fix lint yml (syntax error) (#13496) 2025-11-18 15:53:33 +08:00
Liangsheng Yin 595adf6d93 [CI] Add input for pr-gate (#13491) 2025-11-18 15:35:49 +08:00
Liangsheng Yin 4e41edcb9c [CI] remove auto-labeling run-ci label. (#13486) 2025-11-18 14:59:46 +08:00
Liangsheng Yin 67071f55a8 [CI] fix triggered by a non-run-ci label (#13393) 2025-11-18 14:24:58 +08:00
Liangsheng Yin 4ce8fb3cc2 Fix lora test (#13479) 2025-11-18 12:21:57 +08:00
Liangsheng Yin e486308c99 Temporarily disable model hooks CI (#13450) 2025-11-18 02:35:13 +08:00
Liangsheng Yin 6042010964 [2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447) 2025-11-18 02:08:19 +08:00
Liangsheng Yin ae7698fbd5 Remove deprecated scripts (#13399) 2025-11-17 16:54:39 +08:00
Liangsheng Yin ab63f3c50b [1/N] CI refactor: introduce CI register. (#13345) 2025-11-17 12:21:20 +08:00
Liangsheng Yin 1869f25ca5 Tiny deprecate the --range-begin in run_suite.py (#13381) 2025-11-16 23:15:36 +08:00
Liangsheng Yin e019f233f9 Remove unused code / testcases in lang (#13335) 2025-11-16 22:48:35 +08:00
Liangsheng Yin daf494b681 tiny fix lint (#13337) 2025-11-15 23:05:08 +08:00
Liangsheng Yin 85b8c5c4cd Set max parallel for 1-gpu runner (#13215) 2025-11-14 01:36:43 +08:00
Liangsheng Yin ad8d24c39e Fix re-trigger actor of CI rate limit (#13136) 2025-11-12 16:10:27 +08:00
Liangsheng YinandHubert Lu 5f662e786f Revert "[AMD] Add PD test for AMD CI (#11938)" (#13088)
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
2025-11-12 01:23:55 +08:00
Liangsheng Yin f09eee036d Tiny simplify evcition metrics collector (#12983) 2025-11-11 23:23:48 +08:00
Liangsheng Yin 56c83e0fb3 [CI] Limit the CI trigger frequency of low-privilege actors (#13010) 2025-11-10 11:27:10 -08:00
Liangsheng Yin 1086473111 Enhance retract test (page cases, long output cases) (#12781) 2025-11-11 03:03:26 +08:00