minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
18,691 Commits 2 Branches 0 Tags
dsv41-pd
Commit Graph
43 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yuwei An 65ef55e2a8 [Scheduler] Add shortest-prefill-first scheduling (#40024) 2026-09-17 21:18:58 -07:00
Yuwei AnandClaude Fable 5 07d84ebd6d [2/N][Mixed] Mixed chunk prefill with spec enabled (#36933) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-31 10:48:07 -07:00
Yuwei AnandClaude Fable 5 ff5578eb4e [1/N][Mix] Mixed Chunk Prefill Base (#36288) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-27 12:59:56 -07:00
Yuwei AnandClaude Opus 5 955704544c [Fix] Skip padded state slots in the chunked GDN kernel (#33431) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-18 13:07:19 -07:00
Yuwei AnandClaude Opus 5 a508d60295 [BCG][6/N] Allow prefill breakable CUDA graph for the Kimi archs (#34245) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-16 15:57:14 -07:00
Yuwei AnandClaude Opus 5 06f32bab6b [BCG][5/N] MLA Fully Support (#33661) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-09 23:52:14 -07:00
Yuwei An db8f3cdd11 fix(gdn): skip the -1 padding sentinel in the chunked extend kernel (#33810) 2026-08-06 18:48:47 -07:00
Yuwei AnandClaude Opus 5 92087ef4d2 fix(mem_cache): state the MLA KV bound in the DCP index space (#33432) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-03 19:07:49 -07:00
Yuwei AnandClaude Opus 5 8cc941a672 [BCG][4/N] Enable bcg on megamoe & flashinfer a2a backend (#33150) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-02 14:56:03 -07:00
Yuwei AnandClaude Opus 5 1a3bea77f2 [Feat] DCP + HiCache L2 Support (ported from kimi-k3) (#33112) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-02 23:35:27 +08:00
Yuwei AnandClaude Fable 5 3e0f7c3f30 [BCG][3/N] Enable bcg on dsa & deepep a2a backend (#31987) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-31 16:45:18 -07:00
Yuwei An 86c59ac1aa Revert "[Tiny] Enable Full Cuda Graph with Page size = 1" (#31062) 2026-07-13 14:23:44 -05:00
Yuwei AnandClaude Fable 5 b44ac5d49a [Tiny] Enable Full Cuda Graph with Page size = 1 (#30835) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-14 01:07:02 +08:00
Yuwei AnandClaude Fable 5 0562ccb1a8 Move breakable CUDA graph back into model_executor/runner_backend_utils (#30586) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-09 14:19:16 +08:00
Yuwei AnandClaude Opus 4.8 49109d4267 [Tiny] Fix Import Error for Pure TP config with flashinfer_mxfp4 (#30426) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-07 18:17:52 -07:00
Yuwei An 3cbb7568bd [Experimental] Full Cuda Graph Support for Prefill (#27988) 2026-07-06 18:13:03 -07:00
Yuwei An 0543246184 Enable Breakable Cuda Graph as Default (#29458) 2026-07-01 22:04:44 -07:00
Yuwei An 2ce32366a0 [Fix][BCG][Spec] Restore EAGLE prefill plumbing dropped by #23906 (#28870) 2026-06-22 01:54:54 -07:00
Yuwei AnandClaude Fable 5 6c3e429ba1 [Tiny] Cuda Graph Refactor Code Style Follow up (#28107) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-06-12 18:38:13 -07:00
Yuwei An 880e6f66fc [BCG] Share output buffers across capture sizes + typed ShapeKey (#27857) 2026-06-11 11:58:05 -07:00
Yuwei AnBBufCheng WanLianmin Zheng
 		2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906) 
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2026-06-09 21:36:57 -07:00
Yuwei AnandClaude Opus 4.7 7582237f8e [Tiny Fix] Disable BCG when inner layer_model unresolved (#25021) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-12 14:51:27 +08:00
Yuwei AnandClaude Opus 4.7 5207f074a4 Breakable Cuda Graph Support for bs > 1 (#24662) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-11 13:28:49 +08:00
Yuwei AnandClaude Opus 4.6 60bbb800db [Experimental] Breakable Piecewise Cuda Graph (#22218) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-24 04:33:05 -07:00
Yuwei An d8ece7fb22 [Tiny Fix] Filter lru related warning with pcg (#20940) 
Signed-off-by: yuweia <ayw.sirius19@gmail.com>
 2026-03-19 13:20:49 -07:00
Yuwei An 834795adb8 [CI] Refactor PCG related CI (#19994) 
Signed-off-by: yuweia <ayw.sirius19@gmail.com>
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-03-10 14:49:25 +08:00
Yuwei AnandWenyao Gao 0abb9f4176 Piecewise Cuda Graph Docs (#19738) 
Signed-off-by: yuweia <ayw.sirius19@gmail.com>
Co-authored-by: Wenyao Gao <wgao11@u.rochester.edu>
 2026-03-03 11:51:17 +08:00
Yuwei An c64274c746 Piecewise Cuda Graph set default (#16331) 2026-03-02 23:18:07 +08:00
Yuwei An 8c0f2d40bd [CI] Nutanix LoRA adapter removed from HuggingFace (#19533) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-02-27 17:46:24 -08:00
Yuwei An 0be30d4b0d Fix PCG MoE Error (#17739) 2026-02-19 16:48:06 +08:00
Yuwei An 2bd8363486 [PCG] GPT OSS Triton Kernel Support (#18405) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-02-12 09:23:55 +08:00
Yuwei An 2a9344d320 [tiny remove] remove torch_compile in parallel_state (#16865) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-10 16:04:25 -08:00
Yuwei An 145bd54f1b Piecewise Cuda Graph Memory Usage (#15927) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-10 19:29:13 +08:00
Yuwei An 154740bd4d Disable PCG TP Unittest (#16693) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-07 19:59:47 -08:00
Yuwei An 2a8d5493f3 PCG Unit Test Adjustment (#16609) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-07 10:57:15 +08:00
Yuwei An 5c243ba588 Custom All Reduce for Piecewise Cuda Graph (#15356) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2025-12-25 23:55:15 +08:00
Yuwei An e254cdf326 [CI] Remove pcg-omni-ci (#15656) 2025-12-24 13:28:05 +08:00
Yuwei An 9d0347b33a EP Support for Piecewise Cuda Graph (#14164) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2025-12-20 01:59:27 +08:00
Yuwei An eae59b337e Piecewise Cuda Graph Support for gpt-oss model (#13045) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2025-11-15 09:28:00 +08:00
Yuwei An 1d726528f7 Eager Compiler for Torch Compile (#11803) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2025-10-18 15:18:52 +08:00
Yuwei An 932e263725 Compilation Folder Reset (#11539) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2025-10-14 09:19:12 +08:00
Yuwei An 4ac8e09df0 Piecewise CUDA Graph Support & Torch Compile Backend (#10062) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2025-10-12 11:55:57 +08:00
Yuwei AnandZhiqiang Xie 9a7ced4e4d [Feature] LMCache Connector Integration (#9741) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
Signed-off-by: YuhanLiu11 <yliu738@wisc.edu>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2025-09-06 20:14:55 -07:00