minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
14,814 Commits 2 Branches 0 Tags
10f258257fbdf9ba57a84c211827150f1706c0b6
Commit Graph
10026 Commits
Author SHA1 Message Date
Cheng WanandClaude Fable 5 10f258257f [refactor] Add the resolved-flags tier + resolvable-field metadata (stack 4/15) (#30066) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:20:58 -07:00
Cheng WanandClaude Fable 5 ff57171f98 [refactor] Soft-deprecate the legacy global ServerArgs accessors + ratchet (stack 3/15) (#30065) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:20:46 -07:00
Cheng WanandClaude Fable 5 def20782cf [refactor] Move ServerArgs ownership into the runtime context (stack 2/15) (#30064) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:20:34 -07:00
Cheng WanandClaude Fable 5 6d662c9245 [refactor] Add a read-through server_args accessor to RuntimeContext (stack 1/15) (#30063) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:19:46 -07:00
Mick 03962d4238 [diffusion] feat: enable compile warmup for vae decode (#29306) 2026-07-04 15:25:26 +08:00
san-tian 576dc31e33 Avoid logits multimem all-gather on cross-node TP groups (#29881) 2026-07-04 00:24:58 -07:00
Pranjal Shankhdharandpranjalssh ad744c6c6b [trtllm_mha] Fuse cuda-graph metadata rebuild into one triton kernel (#29843) 
Co-authored-by: pranjalssh <pranjalssh@fb.com>
 2026-07-03 22:24:28 -07:00
Cheng Wan 4028304579 [DSA] Disable indexer fusion by default to restore DeepSeek-V3.2 accuracy (#30088) 2026-07-03 20:50:37 -07:00
Mick 5af1f949ca [diffusion] CI: prefer official diffusion consistency GT (#29831) 2026-07-04 10:09:33 +08:00
Cheng Wan 5f623ad24e Revert "Fix wrong RMSNorm fallback to old Flashinfer CUDA kernel when in PCG" (#30083) 2026-07-03 19:05:20 -07:00
Cheng Wan c21f6f19cf [MoE] Fix moe_fused_gate out-of-range expert id on all-NaN rows (fixes eagle_dp_attention crash) (#30079) 2026-07-03 18:48:51 -07:00
Alison Shao b28bc1060f fix(mimo-vl): pass padded_context_dim to Qwen2_5_VisionPatchMerger (#29994) 2026-07-04 08:08:25 +08:00
Khoa PhamandKhoa Pham 6ce02b95ad fix: reorder DSA indexer dual-stream ops to avoid CUDA graph stream explosion (#30025) 
Co-authored-by: Khoa Pham <264503018+kpham-sgl@users.noreply.github.com>
 2026-07-03 13:53:16 -07:00
Baizhou Zhang 1f0f353d92 [CI] Add GLM52 NVFP4 MTP B200 tests (#30021) 2026-07-03 13:43:38 -07:00
ThanhhaoHao PhanClaude Opus 4.8
 		0203c60fdf [CP] Consolidate decode-context-parallel (DCP) helpers into layers/dcp/ (#29365) 
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-03 12:25:39 -07:00
Mick 486bcb48e7 [diffusion] CI: fix AMD diffusion CI import (#30039) 2026-07-03 22:26:08 +08:00
Jzz1943 1058d00fe0 [diffusion] feat: support cache-dit for Ideogram 4 (#29631) 2026-07-03 19:58:48 +08:00
Mick 42acfd1550 [diffusion] feat: performance_mode=speed enables torch.compile by default (#30016) 2026-07-03 19:12:17 +08:00
khalilzhk 430418e218 [NPU] bugfix for dsv4 memory pool (#30001) 2026-07-03 16:41:39 +08:00
Baizhou Zhang e3258d3b54 [Fix] Turn off dsa indexer fusion by default (#30018) 2026-07-03 01:08:06 -07:00
Polisetty V R K Jyothendra VarmaandMa Mingfei 4dddb04325 [Intel GPU] DeepSeek V4 6/N: use sgl-kernel implemetation of flash_mla_with_kvcache on XPU (#27914) 
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-07-03 15:59:38 +08:00
Polisetty V R K Jyothendra VarmaRahul VijayaraghavanMa Mingfei
 		e90fec4868 [Intel GPU] DeepSeek V4 10/N : Add sqrtsoftplus support to fused_topk_torch_native (#28048) 
Signed-off-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-07-03 15:59:12 +08:00
Cao E 9df16b5ba9 [XPU] Remove redundant xpu graph backend and make xpu graph opt-in by default (#29911) 2026-07-03 15:58:56 +08:00
McZyWu 8416544ab0 [NPU] bugfix for Base class add mamba_track_indices parameter (#29999) 2026-07-03 15:10:41 +08:00
Chandrakant Khandelwal fe60764f54 [diffusion] fix: add profiling support and fix VBench dataset handling in bench_offline_throughput (#27704) 2026-07-03 15:08:38 +08:00
Cheng Wan 76f7f7c006 [Spec] Remove the ServerArgs clone + global save/restore hack from DFlashWorkerV2 (#29995) 2026-07-02 23:37:04 -07:00
xutizhou d364cd8ead Support DSV4 shared expert fusion for DeepEP and MegaMOE (#27349) 2026-07-02 23:18:25 -07:00
YAMY e81f05cf4f [dsv4] Trigger MHC prenorm prewarm at weight-load time with rank sync (#29988) 2026-07-02 23:05:03 -07:00
YAMY a6ee64d237 [DeepSeek-V4] Add an opt-in non-paged indexer for long-context prefill (#29619) 2026-07-02 22:54:40 -07:00
san-tianandSan Tian 70b6c06793 fix: avoid DSA indexer CPU seq lens fallback (#29798) 
Co-authored-by: San Tian <san-tian@users.noreply.github.com>
 2026-07-02 22:50:24 -07:00
Yiqi YangandMick e878c6ebdd [diffusion] feat: shard qwen-image dit across tp ranks (#29774) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-07-03 13:17:53 +08:00
Yiqi Yang f011d8c2e5 [Anthropic] Fix missing cache_read_input_tokens in streaming responses (#29703) 2026-07-03 12:46:45 +08:00
Ke Bao 372a893744 Move deferred mamba cow and clear (#29945) 2026-07-03 11:29:05 +08:00
Xiaoyu ZhangandClaude Opus 4.8 a2d7eb303e [MoE] Consolidate ungrouped + grouped gate/topk onto one Triton router (#26771) — faster than AOT on B200/H100/H200, at parity with flashinfer (#29771) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-03 11:18:59 +08:00
Michael bee0f34e68 [AMD] Accept ROCm tensors in JIT kernel TensorMatcher + register 4 kernel tests (#29822) 2026-07-02 19:29:47 -07:00
YC Yen-Ching Tseng 05bc3f2aa7 [AMD] Gate broken CK block-FP8 GEMM shapes to aiter-triton-GEMM to fix ROCm 7.0 Qwen3.5 accuracy (#29918) 2026-07-02 18:18:37 -07:00
Po-Han Huang (NVIDIA) 17cce6a85f Fix shared logits buffer for reduced-vocab draft models (#29943) 2026-07-02 16:08:56 -07:00
Michael 8519be82e8 [AMD][DeepSeek V4] Fix default FlashMLA sparse prefill off on ROCm/HIP (#29982) 2026-07-02 16:00:09 -07:00
Oxana Korzh f3904f0293 [bugfix][AMD] Disable aiter allreduce+RMSNorm fusion under DP attention / EP (#27835) 2026-07-02 15:31:25 -07:00
YukioZzzandDuyi-Wang caf2e5da2d [AMD] Fix MiniMax M3 state transfer in Mori PD (#29756) 
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
 2026-07-02 15:02:10 -07:00
Rain Jiang ae1f0c6d07 session_id dataclass field should not put in msgpack struct (#29977) 2026-07-02 14:10:12 -07:00
Mohammad Miadh Angkad cfb9c574d3 Fix UE8M0 scale rounding for DeepGEMM (#29956) 2026-07-02 13:42:17 -07:00
Cheng Wanandlch1475369 bc25abb786 perf(triton): avoid per-step D2H .item() sync in cuda-graph loc translate (#29921) 
Co-authored-by: lch1475369 <lch1475369@gmail.com>
 2026-07-02 13:20:00 -07:00
Zhiqiang Xie f19246e59a [HiCache] write_back policy refinement (#29817) 2026-07-02 12:16:03 -07:00
Brayden ZhongandBrayden Zhong 1b6d1e9752 Fix wrong RMSNorm fallback to old Flashinfer CUDA kernel when in PCG (#29702) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-07-03 00:49:49 +08:00
Xinyuan Tong 9588cacaa1 Remove transformers 5.12.1 dead-code workarounds (#29758) 2026-07-03 00:03:06 +08:00
McZyWu c05c48b35e bugfix for npu Grok2 model --detokenizer without all special ids (#29853) 2026-07-02 22:12:48 +08:00
McZyWu bdd3515389 NPU case rl update weights for tensor load_format == None and flatten bucket (#29503) 2026-07-02 22:12:05 +08:00
Ke Bao a375e9f3da Fix SWA eviction tombstoning the last leaf (#29860) 2026-07-02 21:42:30 +08:00
Mick 3c1adddff9 [diffusion] refactor: refactor cuda attention backend resolver (#29852) 2026-07-02 21:34:54 +08:00