Commit Graph
100 Commits
Author SHA1 Message Date
Liangsheng Yin b9ebf0ed63 Clean hidden_states_before_norm (#15485) 2025-12-20 09:38:46 +08:00
Liangsheng Yin 5dccd9bdcc Enhance protection rules of code owners (#15406) 2025-12-20 00:25:57 +08:00
Liangsheng Yin 933cef16cc Tiny fix mimo model conflicts with main (#15483) 2025-12-19 23:20:59 +08:00
Liangsheng Yin 374ad4cce0 Fix gpt-oss yarn with truncate argument (#14270) 2025-12-18 16:31:15 +08:00
Liangsheng Yinandgemini-code-assist[bot] 8b0a68f1bf Monkey patch deepseek-ocr's v_head_dim (#15384)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-18 16:28:07 +08:00
Liangsheng Yin 0c00220795 tiny unify environ usage (#15335) 2025-12-17 23:31:43 +08:00
Liangsheng Yin ecb401ed42 Enhance runtime memory check in CI (#15192) 2025-12-16 21:40:38 +08:00
Liangsheng Yin 372507649d Tiny improve summary text in bench_one_batch_server.py (#15158) 2025-12-15 14:59:11 +08:00
Liangsheng Yin 5c75907e62 Introduce native kv cache move (#15108) 2025-12-14 17:23:28 +08:00
Liangsheng Yin ed52d01b0b Fix spec info's filter when reqs are finished right after prefill (#14742) 2025-12-14 00:32:54 +08:00
Liangsheng Yin 90e7d4f78f Tiny adjust CI run suite (#15074) 2025-12-14 00:05:19 +08:00
Liangsheng Yin d977dd2e07 Fix IMA with flashinfer + spec + topk & Add radix attention test cases for eagle (#13740) 2025-12-13 23:04:41 +08:00
Liangsheng Yin 01e3b3f3a3 Fix decode OOM caused by retraction (#14939) 2025-12-13 12:59:17 +08:00
Liangsheng Yin 7160283800 Tiny remove the duplicate function in spec v2 (#14957) 2025-12-13 11:08:27 +08:00
Liangsheng Yin c660d8dfd0 Re-org eagle unit tests (#14909) 2025-12-12 12:25:39 +09:00
Liangsheng Yin 543d62d11a Introduce server_fixtures in sglang.test (#14899) 2025-12-11 22:30:33 +09:00
Liangsheng Yin bd7824b24d Minor code style fix for dllm (#14836) 2025-12-11 10:35:42 +09:00
Liangsheng Yin 503880dbbe [CI] fix UT success check in test_eagle_infer_beta_dp_attention.py (#14831) 2025-12-11 01:00:50 +09:00
Liangsheng Yinandzhanghaotong cbc7dcdaa7 Re-add the API serving timing metrics. (#14744)
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
Co-authored-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
2025-12-10 10:17:48 +09:00
Liangsheng Yin 125e17efd5 Add small model test for spec v2 + dp + trtllm_mla (#14576) 2025-12-07 23:55:00 +08:00
Liangsheng Yin 88c459c6c8 Tiny remove wrong import from python.sglang (#14577) 2025-12-07 22:07:49 +08:00
Liangsheng Yinandgemini-code-assist[bot] 441420e149 Add mooncake transfer_engine_bench into maunal test (#14429)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-04 22:35:00 +08:00
Liangsheng Yin 24903b88ba Tiny adjust CI testcases (#14362) 2025-12-03 21:19:51 +08:00
Liangsheng Yin 427a19b643 Remove cargo config also in .zshenv (#14267) 2025-12-02 11:31:53 +08:00
Liangsheng Yin a2423052f6 Add cuda event based on waiting value (#14214) 2025-12-01 18:51:44 +08:00
Liangsheng Yin 0a9d64530d Support grammar + spec + reasoning (#14163) 2025-11-30 21:19:57 +08:00
Liangsheng Yin bab033b970 Adjust max-parallel for CUDA CI (#14057) 2025-11-27 20:48:37 +08:00
Liangsheng Yin 0dd759e087 Put pr-gate after check-changes (#14009) 2025-11-27 01:40:16 +08:00
Liangsheng Yin 6c190cbda0 Rename: --hooks to --forward-hooks (#13994) 2025-11-26 22:26:28 +08:00
Liangsheng Yin eff6a07c8f Fix get_load API (#13991) 2025-11-26 22:07:51 +08:00
Liangsheng Yin 3421d049aa [CI] rename: per_commit -> registered (#13928) 2025-11-25 23:05:06 +08:00
Liangsheng Yinandalisonshao d3d404d3d7 [CI] CI registry update (#13927)
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
2025-11-25 22:43:19 +08:00
Liangsheng Yin b60e769d0e Tiny unpin uvloop for other backends (#13858) 2025-11-25 01:34:57 +08:00
Liangsheng Yin 981ca8313f [misc] Rename minilb install env & remove files & fix lint (#13831) 2025-11-24 13:50:00 +08:00
Liangsheng Yin b2f7b08c49 Refactor cache init logic (#13800) 2025-11-24 11:41:46 +08:00
Liangsheng Yin 5c2915494c [Scheduler] Tiny organize code style (#13806) 2025-11-23 23:41:34 +08:00
Liangsheng Yin 863124684c [Spec v2] Remove allocate_lens and enable over-allocation (#13478) 2025-11-22 22:49:10 +08:00
Liangsheng Yin 3397bcee84 Tiny support different prompts in send_one.py (#13768) 2025-11-22 21:59:58 +08:00
Liangsheng Yin 3e804bb0ba Update mem checker during busy (#13704) 2025-11-22 21:15:02 +08:00
Liangsheng Yin ac43822634 Refactor eagle bigram key matching (#13714) 2025-11-22 20:40:42 +08:00
Liangsheng Yin 964cdedc50 [CI] minor hot fix of model validation list (#13737) 2025-11-22 01:00:41 +08:00
Liangsheng Yin 4528cb7d40 [CI] apply pr-gate for XPU (#13663) 2025-11-20 23:07:04 +08:00
Liangsheng Yin 852eb6ce2a [CI] optimize CI workflow info (#13634) 2025-11-20 18:12:51 +08:00
Liangsheng Yinandgemini-code-assist[bot] 19729f723e [CI] Align metric units for CI rate limit (#13633)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-20 16:25:57 +08:00
Liangsheng Yin 196b940aed [3/N] CI refactor: move some manually triggered tests. (#13448) 2025-11-19 23:06:53 +08:00
Liangsheng Yin a1e1e533b9 Tiny enhance test suites sanity check (#13589) 2025-11-19 22:43:58 +08:00
Liangsheng Yin 97ba2c2d1e [CI] Fix CUDA workflow's dependency. (#13568) 2025-11-19 19:06:42 +08:00
Liangsheng Yin ba9102f924 Add lmsys/gpt-oss-20b-bf16 to model validation check (#13557) 2025-11-19 14:23:01 +08:00
Liangsheng Yin f7be98e113 [CI] fix amd 1 gpu basic test (#13551) 2025-11-19 11:47:41 +08:00
Liangsheng Yin f5566acc2a [CI] fix CI skipped on main (#13527) 2025-11-19 01:19:08 +08:00
Liangsheng Yin 6e9b154981 [CI] fix skipping pr-gate on main (#13525) 2025-11-19 00:57:22 +08:00
Liangsheng Yin 109f27ba3a [CI] update pr-gate to be compatible with new slash triggering mananer. (#13522) 2025-11-19 00:49:13 +08:00
Liangsheng Yin 33905005ee [CI] fix lint yml (syntax error) (#13496) 2025-11-18 15:53:33 +08:00
Liangsheng Yin 595adf6d93 [CI] Add input for pr-gate (#13491) 2025-11-18 15:35:49 +08:00
Liangsheng Yin 4e41edcb9c [CI] remove auto-labeling run-ci label. (#13486) 2025-11-18 14:59:46 +08:00
Liangsheng Yin 67071f55a8 [CI] fix triggered by a non-run-ci label (#13393) 2025-11-18 14:24:58 +08:00
Liangsheng Yin 4ce8fb3cc2 Fix lora test (#13479) 2025-11-18 12:21:57 +08:00
Liangsheng Yin e486308c99 Temporarily disable model hooks CI (#13450) 2025-11-18 02:35:13 +08:00
Liangsheng Yin 6042010964 [2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447) 2025-11-18 02:08:19 +08:00
Liangsheng Yin ae7698fbd5 Remove deprecated scripts (#13399) 2025-11-17 16:54:39 +08:00
Liangsheng Yin ab63f3c50b [1/N] CI refactor: introduce CI register. (#13345) 2025-11-17 12:21:20 +08:00
Liangsheng Yin 1869f25ca5 Tiny deprecate the --range-begin in run_suite.py (#13381) 2025-11-16 23:15:36 +08:00
Liangsheng Yin e019f233f9 Remove unused code / testcases in lang (#13335) 2025-11-16 22:48:35 +08:00
Liangsheng Yin daf494b681 tiny fix lint (#13337) 2025-11-15 23:05:08 +08:00
Liangsheng Yin 85b8c5c4cd Set max parallel for 1-gpu runner (#13215) 2025-11-14 01:36:43 +08:00
Liangsheng Yin ad8d24c39e Fix re-trigger actor of CI rate limit (#13136) 2025-11-12 16:10:27 +08:00
Liangsheng YinandHubert Lu 5f662e786f Revert "[AMD] Add PD test for AMD CI (#11938)" (#13088)
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
2025-11-12 01:23:55 +08:00
Liangsheng Yin f09eee036d Tiny simplify evcition metrics collector (#12983) 2025-11-11 23:23:48 +08:00
Liangsheng Yin 56c83e0fb3 [CI] Limit the CI trigger frequency of low-privilege actors (#13010) 2025-11-10 11:27:10 -08:00
Liangsheng Yin 1086473111 Enhance retract test (page cases, long output cases) (#12781) 2025-11-11 03:03:26 +08:00
Liangsheng Yin 665416f6dd Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224) 2025-11-11 02:56:22 +08:00
Liangsheng Yin f1f4c451ab Add process_prefill_chunk back to fix PP event loop (#13009) 2025-11-11 00:51:36 +08:00
Liangsheng Yin dc8a5a1ce7 [Refactor / Style] Unify all event loops (except for PP) (#12959) 2025-11-10 14:49:12 +08:00
Liangsheng Yin 61c7fe7aed Minor code cleanup / improvement for PREBUILT_EXTEND mode (#12948) 2025-11-10 11:59:54 +08:00
Liangsheng Yin 4e916f9840 [lint] tiny fix unimported packages. (#12927) 2025-11-10 00:59:10 +08:00
Liangsheng Yinandcctry 4f65a64666 Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
2025-11-10 00:42:50 +08:00
Liangsheng Yin 210a9cab6d [CI] Fix matrix.part in pr-test. (#12920) 2025-11-09 18:53:18 +08:00
Liangsheng Yin 877cb52840 [CI] increase ut buckets & adjust estimation time. (#12919) 2025-11-09 18:17:50 +08:00
Liangsheng Yin 49543be9da Tiny simplify can_run_dp_cuda_graph gather logic (#12891) 2025-11-09 11:15:36 +08:00
Liangsheng Yin 243ea585fc [DP-Attn] Clarify MLP sync / idle batch preparation logic (#12843) 2025-11-08 23:23:14 +08:00
Liangsheng Yin 6fee2c535c [CI] Tiny adjust CI esitmation time (#12886) 2025-11-08 23:02:19 +08:00
Liangsheng Yin 44b1b394a4 [PD-Disagg] Check finish after pop tranferred (#12638) 2025-11-05 11:18:09 +08:00
Liangsheng Yin befa41a152 Fix output_ids inconsistency (#12628) 2025-11-05 01:43:08 +08:00
Liangsheng Yin 30b26ee9d0 Add io struct naming check back (#12634) 2025-11-05 01:15:01 +08:00
Liangsheng Yin aa797d013d [Test] Merge all constrained decoding tests. (#12633) 2025-11-05 00:43:06 +08:00
Liangsheng Yin 0678beaaee [sepc-v2] Fix imcompatibility with constrained decoding (#12615) 2025-11-04 17:27:31 +08:00
Liangsheng Yin edb2569356 [hot-fix] Fix broken CI (#12564) 2025-11-04 00:03:25 +08:00
Liangsheng Yin 3529c061bb [spec v2] Fix output repetition by speculative sampling error (#12561) 2025-11-03 23:00:17 +08:00
Liangsheng Yin 9632e48f5d [hot fix] Remove from python.sglang.xxx (#12483) 2025-11-01 11:00:05 +08:00
Liangsheng Yin 2c9aebea70 Simplify watchdog (#12463) 2025-10-31 21:17:38 +08:00
Liangsheng YinandLianmin Zheng 300b4c212e [CI] fix possible port conflicts. (#12452)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
2025-10-31 17:20:20 +08:00
Liangsheng Yin 5cc0d25a0d Add trait for BasePrefixCache (#12436) 2025-10-31 14:03:27 +08:00
Liangsheng Yin 9416ee60dd Reserved abortion API when retracting (#12425) 2025-10-31 10:56:05 +08:00
Liangsheng Yin d4a09ec9dc [CI] fix tests' time estimation (#12401) 2025-10-30 19:20:35 -07:00
Liangsheng Yin 73dfd2dfb1 [Test] Enhance radix cache test for spec cases (#12394) 2025-10-30 18:46:28 +08:00
Liangsheng Yin 42f8ea4030 [Test] Fix session control test (#12336) 2025-10-29 18:28:04 +08:00
Liangsheng Yin 14cbe42fd3 Refactor abortion in event loop (#12312) 2025-10-29 18:25:20 +08:00
Liangsheng Yin ea385ae85a Fix ITL metrics when using openai endpoint with spec (#12156) 2025-10-26 18:06:25 +08:00
Liangsheng Yin 5994e6c373 Do not use MagicMock to mock server_args in tests (#12154) 2025-10-26 16:00:46 +08:00
Liangsheng Yin 8491c794ad [misc] depdencies & enviroment flag (#12113) 2025-10-26 14:52:35 +08:00