Liangsheng Yin
|
b9ebf0ed63
|
Clean hidden_states_before_norm (#15485)
|
2025-12-20 09:38:46 +08:00 |
|
Liangsheng Yin
|
5dccd9bdcc
|
Enhance protection rules of code owners (#15406)
|
2025-12-20 00:25:57 +08:00 |
|
Liangsheng Yin
|
933cef16cc
|
Tiny fix mimo model conflicts with main (#15483)
|
2025-12-19 23:20:59 +08:00 |
|
Liangsheng Yin
|
374ad4cce0
|
Fix gpt-oss yarn with truncate argument (#14270)
|
2025-12-18 16:31:15 +08:00 |
|
![gemini-code-assist[bot]](/assets/img/avatar_default.png) Liangsheng Yinandgemini-code-assist[bot]
|
8b0a68f1bf
|
Monkey patch deepseek-ocr's v_head_dim (#15384)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 16:28:07 +08:00 |
|
Liangsheng Yin
|
0c00220795
|
tiny unify environ usage (#15335)
|
2025-12-17 23:31:43 +08:00 |
|
Liangsheng Yin
|
ecb401ed42
|
Enhance runtime memory check in CI (#15192)
|
2025-12-16 21:40:38 +08:00 |
|
Liangsheng Yin
|
372507649d
|
Tiny improve summary text in bench_one_batch_server.py (#15158)
|
2025-12-15 14:59:11 +08:00 |
|
Liangsheng Yin
|
5c75907e62
|
Introduce native kv cache move (#15108)
|
2025-12-14 17:23:28 +08:00 |
|
Liangsheng Yin
|
ed52d01b0b
|
Fix spec info's filter when reqs are finished right after prefill (#14742)
|
2025-12-14 00:32:54 +08:00 |
|
Liangsheng Yin
|
90e7d4f78f
|
Tiny adjust CI run suite (#15074)
|
2025-12-14 00:05:19 +08:00 |
|
Liangsheng Yin
|
d977dd2e07
|
Fix IMA with flashinfer + spec + topk & Add radix attention test cases for eagle (#13740)
|
2025-12-13 23:04:41 +08:00 |
|
Liangsheng Yin
|
01e3b3f3a3
|
Fix decode OOM caused by retraction (#14939)
|
2025-12-13 12:59:17 +08:00 |
|
Liangsheng Yin
|
7160283800
|
Tiny remove the duplicate function in spec v2 (#14957)
|
2025-12-13 11:08:27 +08:00 |
|
Liangsheng Yin
|
c660d8dfd0
|
Re-org eagle unit tests (#14909)
|
2025-12-12 12:25:39 +09:00 |
|
Liangsheng Yin
|
543d62d11a
|
Introduce server_fixtures in sglang.test (#14899)
|
2025-12-11 22:30:33 +09:00 |
|
Liangsheng Yin
|
bd7824b24d
|
Minor code style fix for dllm (#14836)
|
2025-12-11 10:35:42 +09:00 |
|
Liangsheng Yin
|
503880dbbe
|
[CI] fix UT success check in test_eagle_infer_beta_dp_attention.py (#14831)
|
2025-12-11 01:00:50 +09:00 |
|
 Liangsheng Yinandzhanghaotong
|
cbc7dcdaa7
|
Re-add the API serving timing metrics. (#14744)
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
Co-authored-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
|
2025-12-10 10:17:48 +09:00 |
|
Liangsheng Yin
|
125e17efd5
|
Add small model test for spec v2 + dp + trtllm_mla (#14576)
|
2025-12-07 23:55:00 +08:00 |
|
Liangsheng Yin
|
88c459c6c8
|
Tiny remove wrong import from python.sglang (#14577)
|
2025-12-07 22:07:49 +08:00 |
|
![gemini-code-assist[bot]](/assets/img/avatar_default.png) Liangsheng Yinandgemini-code-assist[bot]
|
441420e149
|
Add mooncake transfer_engine_bench into maunal test (#14429)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-04 22:35:00 +08:00 |
|
Liangsheng Yin
|
24903b88ba
|
Tiny adjust CI testcases (#14362)
|
2025-12-03 21:19:51 +08:00 |
|
Liangsheng Yin
|
427a19b643
|
Remove cargo config also in .zshenv (#14267)
|
2025-12-02 11:31:53 +08:00 |
|
Liangsheng Yin
|
a2423052f6
|
Add cuda event based on waiting value (#14214)
|
2025-12-01 18:51:44 +08:00 |
|
Liangsheng Yin
|
0a9d64530d
|
Support grammar + spec + reasoning (#14163)
|
2025-11-30 21:19:57 +08:00 |
|
Liangsheng Yin
|
bab033b970
|
Adjust max-parallel for CUDA CI (#14057)
|
2025-11-27 20:48:37 +08:00 |
|
Liangsheng Yin
|
0dd759e087
|
Put pr-gate after check-changes (#14009)
|
2025-11-27 01:40:16 +08:00 |
|
Liangsheng Yin
|
6c190cbda0
|
Rename: --hooks to --forward-hooks (#13994)
|
2025-11-26 22:26:28 +08:00 |
|
Liangsheng Yin
|
eff6a07c8f
|
Fix get_load API (#13991)
|
2025-11-26 22:07:51 +08:00 |
|
Liangsheng Yin
|
3421d049aa
|
[CI] rename: per_commit -> registered (#13928)
|
2025-11-25 23:05:06 +08:00 |
|
 Liangsheng Yinandalisonshao
|
d3d404d3d7
|
[CI] CI registry update (#13927)
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
|
2025-11-25 22:43:19 +08:00 |
|
Liangsheng Yin
|
b60e769d0e
|
Tiny unpin uvloop for other backends (#13858)
|
2025-11-25 01:34:57 +08:00 |
|
Liangsheng Yin
|
981ca8313f
|
[misc] Rename minilb install env & remove files & fix lint (#13831)
|
2025-11-24 13:50:00 +08:00 |
|
Liangsheng Yin
|
b2f7b08c49
|
Refactor cache init logic (#13800)
|
2025-11-24 11:41:46 +08:00 |
|
Liangsheng Yin
|
5c2915494c
|
[Scheduler] Tiny organize code style (#13806)
|
2025-11-23 23:41:34 +08:00 |
|
Liangsheng Yin
|
863124684c
|
[Spec v2] Remove allocate_lens and enable over-allocation (#13478)
|
2025-11-22 22:49:10 +08:00 |
|
Liangsheng Yin
|
3397bcee84
|
Tiny support different prompts in send_one.py (#13768)
|
2025-11-22 21:59:58 +08:00 |
|
Liangsheng Yin
|
3e804bb0ba
|
Update mem checker during busy (#13704)
|
2025-11-22 21:15:02 +08:00 |
|
Liangsheng Yin
|
ac43822634
|
Refactor eagle bigram key matching (#13714)
|
2025-11-22 20:40:42 +08:00 |
|
Liangsheng Yin
|
964cdedc50
|
[CI] minor hot fix of model validation list (#13737)
|
2025-11-22 01:00:41 +08:00 |
|
Liangsheng Yin
|
4528cb7d40
|
[CI] apply pr-gate for XPU (#13663)
|
2025-11-20 23:07:04 +08:00 |
|
Liangsheng Yin
|
852eb6ce2a
|
[CI] optimize CI workflow info (#13634)
|
2025-11-20 18:12:51 +08:00 |
|
![gemini-code-assist[bot]](/assets/img/avatar_default.png) Liangsheng Yinandgemini-code-assist[bot]
|
19729f723e
|
[CI] Align metric units for CI rate limit (#13633)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-11-20 16:25:57 +08:00 |
|
Liangsheng Yin
|
196b940aed
|
[3/N] CI refactor: move some manually triggered tests. (#13448)
|
2025-11-19 23:06:53 +08:00 |
|
Liangsheng Yin
|
a1e1e533b9
|
Tiny enhance test suites sanity check (#13589)
|
2025-11-19 22:43:58 +08:00 |
|
Liangsheng Yin
|
97ba2c2d1e
|
[CI] Fix CUDA workflow's dependency. (#13568)
|
2025-11-19 19:06:42 +08:00 |
|
Liangsheng Yin
|
ba9102f924
|
Add lmsys/gpt-oss-20b-bf16 to model validation check (#13557)
|
2025-11-19 14:23:01 +08:00 |
|
Liangsheng Yin
|
f7be98e113
|
[CI] fix amd 1 gpu basic test (#13551)
|
2025-11-19 11:47:41 +08:00 |
|
Liangsheng Yin
|
f5566acc2a
|
[CI] fix CI skipped on main (#13527)
|
2025-11-19 01:19:08 +08:00 |
|
Liangsheng Yin
|
6e9b154981
|
[CI] fix skipping pr-gate on main (#13525)
|
2025-11-19 00:57:22 +08:00 |
|
Liangsheng Yin
|
109f27ba3a
|
[CI] update pr-gate to be compatible with new slash triggering mananer. (#13522)
|
2025-11-19 00:49:13 +08:00 |
|
Liangsheng Yin
|
33905005ee
|
[CI] fix lint yml (syntax error) (#13496)
|
2025-11-18 15:53:33 +08:00 |
|
Liangsheng Yin
|
595adf6d93
|
[CI] Add input for pr-gate (#13491)
|
2025-11-18 15:35:49 +08:00 |
|
Liangsheng Yin
|
4e41edcb9c
|
[CI] remove auto-labeling run-ci label. (#13486)
|
2025-11-18 14:59:46 +08:00 |
|
Liangsheng Yin
|
67071f55a8
|
[CI] fix triggered by a non-run-ci label (#13393)
|
2025-11-18 14:24:58 +08:00 |
|
Liangsheng Yin
|
4ce8fb3cc2
|
Fix lora test (#13479)
|
2025-11-18 12:21:57 +08:00 |
|
Liangsheng Yin
|
e486308c99
|
Temporarily disable model hooks CI (#13450)
|
2025-11-18 02:35:13 +08:00 |
|
Liangsheng Yin
|
6042010964
|
[2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447)
|
2025-11-18 02:08:19 +08:00 |
|
Liangsheng Yin
|
ae7698fbd5
|
Remove deprecated scripts (#13399)
|
2025-11-17 16:54:39 +08:00 |
|
Liangsheng Yin
|
ab63f3c50b
|
[1/N] CI refactor: introduce CI register. (#13345)
|
2025-11-17 12:21:20 +08:00 |
|
Liangsheng Yin
|
1869f25ca5
|
Tiny deprecate the --range-begin in run_suite.py (#13381)
|
2025-11-16 23:15:36 +08:00 |
|
Liangsheng Yin
|
e019f233f9
|
Remove unused code / testcases in lang (#13335)
|
2025-11-16 22:48:35 +08:00 |
|
Liangsheng Yin
|
daf494b681
|
tiny fix lint (#13337)
|
2025-11-15 23:05:08 +08:00 |
|
Liangsheng Yin
|
85b8c5c4cd
|
Set max parallel for 1-gpu runner (#13215)
|
2025-11-14 01:36:43 +08:00 |
|
Liangsheng Yin
|
ad8d24c39e
|
Fix re-trigger actor of CI rate limit (#13136)
|
2025-11-12 16:10:27 +08:00 |
|
 Liangsheng YinandHubert Lu
|
5f662e786f
|
Revert "[AMD] Add PD test for AMD CI (#11938)" (#13088)
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
|
2025-11-12 01:23:55 +08:00 |
|
Liangsheng Yin
|
f09eee036d
|
Tiny simplify evcition metrics collector (#12983)
|
2025-11-11 23:23:48 +08:00 |
|
Liangsheng Yin
|
56c83e0fb3
|
[CI] Limit the CI trigger frequency of low-privilege actors (#13010)
|
2025-11-10 11:27:10 -08:00 |
|
Liangsheng Yin
|
1086473111
|
Enhance retract test (page cases, long output cases) (#12781)
|
2025-11-11 03:03:26 +08:00 |
|
Liangsheng Yin
|
665416f6dd
|
Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)
|
2025-11-11 02:56:22 +08:00 |
|
Liangsheng Yin
|
f1f4c451ab
|
Add process_prefill_chunk back to fix PP event loop (#13009)
|
2025-11-11 00:51:36 +08:00 |
|
Liangsheng Yin
|
dc8a5a1ce7
|
[Refactor / Style] Unify all event loops (except for PP) (#12959)
|
2025-11-10 14:49:12 +08:00 |
|
Liangsheng Yin
|
61c7fe7aed
|
Minor code cleanup / improvement for PREBUILT_EXTEND mode (#12948)
|
2025-11-10 11:59:54 +08:00 |
|
Liangsheng Yin
|
4e916f9840
|
[lint] tiny fix unimported packages. (#12927)
|
2025-11-10 00:59:10 +08:00 |
|
 Liangsheng Yinandcctry
|
4f65a64666
|
Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
|
2025-11-10 00:42:50 +08:00 |
|
Liangsheng Yin
|
210a9cab6d
|
[CI] Fix matrix.part in pr-test. (#12920)
|
2025-11-09 18:53:18 +08:00 |
|
Liangsheng Yin
|
877cb52840
|
[CI] increase ut buckets & adjust estimation time. (#12919)
|
2025-11-09 18:17:50 +08:00 |
|
Liangsheng Yin
|
49543be9da
|
Tiny simplify can_run_dp_cuda_graph gather logic (#12891)
|
2025-11-09 11:15:36 +08:00 |
|
Liangsheng Yin
|
243ea585fc
|
[DP-Attn] Clarify MLP sync / idle batch preparation logic (#12843)
|
2025-11-08 23:23:14 +08:00 |
|
Liangsheng Yin
|
6fee2c535c
|
[CI] Tiny adjust CI esitmation time (#12886)
|
2025-11-08 23:02:19 +08:00 |
|
Liangsheng Yin
|
44b1b394a4
|
[PD-Disagg] Check finish after pop tranferred (#12638)
|
2025-11-05 11:18:09 +08:00 |
|
Liangsheng Yin
|
befa41a152
|
Fix output_ids inconsistency (#12628)
|
2025-11-05 01:43:08 +08:00 |
|
Liangsheng Yin
|
30b26ee9d0
|
Add io struct naming check back (#12634)
|
2025-11-05 01:15:01 +08:00 |
|
Liangsheng Yin
|
aa797d013d
|
[Test] Merge all constrained decoding tests. (#12633)
|
2025-11-05 00:43:06 +08:00 |
|
Liangsheng Yin
|
0678beaaee
|
[sepc-v2] Fix imcompatibility with constrained decoding (#12615)
|
2025-11-04 17:27:31 +08:00 |
|
Liangsheng Yin
|
edb2569356
|
[hot-fix] Fix broken CI (#12564)
|
2025-11-04 00:03:25 +08:00 |
|
Liangsheng Yin
|
3529c061bb
|
[spec v2] Fix output repetition by speculative sampling error (#12561)
|
2025-11-03 23:00:17 +08:00 |
|
Liangsheng Yin
|
9632e48f5d
|
[hot fix] Remove from python.sglang.xxx (#12483)
|
2025-11-01 11:00:05 +08:00 |
|
Liangsheng Yin
|
2c9aebea70
|
Simplify watchdog (#12463)
|
2025-10-31 21:17:38 +08:00 |
|
 Liangsheng YinandLianmin Zheng
|
300b4c212e
|
[CI] fix possible port conflicts. (#12452)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
|
2025-10-31 17:20:20 +08:00 |
|
Liangsheng Yin
|
5cc0d25a0d
|
Add trait for BasePrefixCache (#12436)
|
2025-10-31 14:03:27 +08:00 |
|
Liangsheng Yin
|
9416ee60dd
|
Reserved abortion API when retracting (#12425)
|
2025-10-31 10:56:05 +08:00 |
|
Liangsheng Yin
|
d4a09ec9dc
|
[CI] fix tests' time estimation (#12401)
|
2025-10-30 19:20:35 -07:00 |
|
Liangsheng Yin
|
73dfd2dfb1
|
[Test] Enhance radix cache test for spec cases (#12394)
|
2025-10-30 18:46:28 +08:00 |
|
Liangsheng Yin
|
42f8ea4030
|
[Test] Fix session control test (#12336)
|
2025-10-29 18:28:04 +08:00 |
|
Liangsheng Yin
|
14cbe42fd3
|
Refactor abortion in event loop (#12312)
|
2025-10-29 18:25:20 +08:00 |
|
Liangsheng Yin
|
ea385ae85a
|
Fix ITL metrics when using openai endpoint with spec (#12156)
|
2025-10-26 18:06:25 +08:00 |
|
Liangsheng Yin
|
5994e6c373
|
Do not use MagicMock to mock server_args in tests (#12154)
|
2025-10-26 16:00:46 +08:00 |
|
Liangsheng Yin
|
8491c794ad
|
[misc] depdencies & enviroment flag (#12113)
|
2025-10-26 14:52:35 +08:00 |
|