minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
13,143 Commits 2 Branches 0 Tags
c47f0e7cdde48ddc718e3c6ee8bc87bebee2e8ff
Commit Graph
13143 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jun Liu c47f0e7cdd [PD] Fix top logprobs crash in prefill path (#26299) 2026-05-26 22:01:10 +08:00
Shangming Cai c8c1aed5e9 [PD] Fix cross-rank queue divergence by gating metadata readiness before all-reduce (#26394) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-05-26 21:59:42 +08:00
Yongfei Xu 98eb84497d [PP] Skip PP output communication for pure chunked prefill batches (#26148) 2026-05-26 21:59:18 +08:00
zijiexia a26913158b fix(ci): enforce legacy docs/ gate in Lint workflow (#26322) 2026-05-26 20:06:54 +08:00
Michael 9409969fd5 Revert "[perf][spec decoding] Skip full-vocab softmax in EAGLE draft when topk == 1 (#26235)" (#26358) 2026-05-26 02:47:52 -07:00
fzyzcjy d9c82934c8 Extract Scheduler init methods and add skills to enforce the splitting requirements (#26271) 2026-05-26 17:45:09 +08:00
Chao Shi 48f3264807 [HiCache]: Check return code of cudaHostRegister (#26301) 2026-05-26 17:44:15 +08:00
YC Yen-Ching Tseng d25a220fdb [AMD] Relaxing timeout for AMD CI (#26392) 2026-05-26 17:25:05 +08:00
roikoren755 e958f4561f [feat] Support extra_buffer in Mamba2-based models (#15829) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2026-05-26 16:03:29 +08:00
Liangsheng Yin 7e6e5efe51 Revert "fix(tool_call): normalize non-standard JSON Schema types in tool params" (#26379) 2026-05-26 00:49:41 -07:00
Zhonghua Deng dabdd91ef3 [EPD] Cross-request batching for image/audio encoder (#25964) 2026-05-26 15:38:59 +08:00
Yuan Luoandluoyuan.luo d34d4d9f5f [GDN] Support SM100 CuTeDSL GDN Prefill Kernel (#26200) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-05-26 15:38:29 +08:00
Xinyuan Tong 64c7c6851b fix(tool_call): normalize non-standard JSON Schema types in tool params (#23476) 2026-05-26 15:23:59 +08:00
chengchao23 137168539a [Perf][Moe]improve cutlass_moe_fp4 performance by using apply_router_weight_on_i… (#19493) 2026-05-26 00:07:49 -07:00
+2
kkwunhuangThomas WangXinyi SongHaiShawamd-danli103Lin, SogaRaiden-MakotoHubert Luyichiche@amd.comyctseng0211Bingxu Chen
 		3f5e2c7688 [AMD] Dsv4/pr2 compressor opt (#26208) 
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: amd-danli103 <danli103@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
Co-authored-by: yichiche@amd.com <jacky.cheng>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-05-25 23:54:40 -07:00
Shaojun Zhou 7c0fbc8c2e fix: fix fa3 cross-attention batched-decode for per-request varlen encoder (#25045) 2026-05-26 14:26:15 +08:00
Baizhou Zhang f0ba651d66 [Doc] Update pip install commands for Cuda12 (#26344) 2026-05-25 22:28:27 -07:00
Mick 63a89bf1a9 [kernel] reuse wna16 marlin moe workspace (#26112) 2026-05-26 13:19:13 +08:00
Yuxuan Zhang 7ef06bfc06 GLM-4.7-Flash: standalone MLA impl and MLA NextN/MTP (#26088) 2026-05-26 13:17:39 +08:00
xutizhou 59cad671e2 Support DeepSeek V4 DeepEP Waterfill (#25391) 2026-05-25 21:04:26 -07:00
mispa-msandMick 3142278c5f [diffusion] feat: layerwise NVTX markers for Nsight Systems profiling (#25683) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-05-26 11:24:27 +08:00
Liangsheng Yin 1953565ba1 Signal CUDA coredumps to tracker issue (#26338) 2026-05-25 20:21:19 -07:00
Chetan Kumar Verma 156d1af23a [Intel GPU] Fix incorrect KV-cache page table for local attention when page_size > 1 (#23757) 2026-05-26 11:02:21 +08:00
Baizhou Zhang 29e245e6a7 [misc] Update permission (#26336) 2026-05-25 19:50:06 -07:00
Mick 8f2a4e70f8 [SRT] minor: reuse req input id array for unpadded ids (#26232) 2026-05-26 08:58:32 +08:00
Liangsheng Yin 8805f4cf16 Fail-fast on PD subprocess exit and scheduler exception (#26298) 2026-05-25 16:42:50 -07:00
Ke Bao e7b12fe6fa Fix stale forward_metadata leak in DP attn unpadded idle batch (#26313) 2026-05-25 16:04:00 -07:00
Ziang Li 2b9dd9c8b3 [FlashInfer v0.6.10] [RL] [DSv32] [GLM-5] Add --dsa-topk-backend and integrate FlashInfer and pytorch topk (#22851) 2026-05-25 13:08:03 -07:00
Ke Bao b13d3d18c6 Refactor HiCache stack dispatch into strategies (#26295) 2026-05-26 00:06:17 +08:00
Shangming Cai 2aa6995308 [CI] Enable EPD CI for EPD architecture enhancements (#26281) 2026-05-25 23:52:58 +08:00
Xiaoyu ZhangandBBuf 121cc09405 [diffusion] Add CFG gating for denoising (#25848) 
Co-authored-by: BBuf <bbuf@example.com>
 2026-05-25 22:57:09 +08:00
Xiaoyu ZhangandBBuf 85f9522e36 [diffusion] Cache fp32 layernorm params (#25847) 
Co-authored-by: BBuf <bbuf@example.com>
 2026-05-25 22:56:39 +08:00
Makcum888eandronnie_zheng 0801cc05ed [Diffusion][NPU] Disaggregation diffusion stages support for NPU (#25895) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-05-25 13:51:25 +03:00
Liangsheng Yin 3e67398a96 Zero req_pool_indices padding in cuda-graph populate (#26292) 2026-05-25 03:29:05 -07:00
Xiaoyu Zhang 533ef41112 [Diffusion] Default NVFP4 backend to FlashInfer TRTLLM (#25523) 2026-05-25 18:14:06 +08:00
Mick c05756da7a [SRT] fix flashInfer allreduce fusion not used on blackwell (#26197) 2026-05-25 18:07:15 +08:00
Zhanghengand晟海 a4db563c87 [hisparse]: update user guide (#26249) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
 2026-05-25 17:54:55 +08:00
Shangming Cai bc8d64bf36 [CI] Align score threshold in dsv4 disaggregation test (#26268) 2026-05-25 17:48:45 +08:00
Qiaolin Yu a77449f86d [perf][spec decoding] Skip full-vocab softmax in EAGLE draft when topk == 1 (#26235) 2026-05-25 02:06:48 -07:00
Kangyan-ZhouandClaude Opus 4.7 7c04b9e942 fix(docker): generate Cargo.lock in chef stage for sgl-router build (#26279) 
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-25 16:54:47 +08:00
Shangming Cai 7f2829af39 chore: bump mooncake version to 0.3.11.post1 (#25989) 2026-05-25 16:51:03 +08:00
xdtbynd 0942011665 [NPU] Add torchaudio dependency for NPU platform (#26267) 2026-05-25 16:30:12 +08:00
Kangyan-ZhouandClaude Opus 4.7 81704ad602 ci: add nightly Docker workflow for experimental sgl-router (#26273) 
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
 2026-05-25 16:19:07 +08:00
Jincong Chen e27d4fb70f [Perf][Qwen3.5] Add case 512 to topkGatingSoftmaxKernelLauncher, (#25775) 2026-05-25 16:08:21 +08:00
fzyzcjy b0cf01eb85 Lazy-load speculative-naming via skill instead of always-on rule (#26270) 2026-05-25 15:58:29 +08:00
Kangyan-ZhouandClaude Opus 4.7 6e8fe176be sgl-router: experimental Rust HTTP router for SGLang worker pools (#25851) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-25 15:34:05 +08:00
Junlin Wu aae04b1241 📝 docs(diffusion): add MXFP4 quantization docs (#25904) 2026-05-25 10:24:30 +03:00
Yuhui Liang ca029e816b Fix missing idle-batch handling in prepare_mlp_sync_batch_raw (#25404) 2026-05-24 23:53:54 -07:00
Erik Wijmans 87e69d57c4 [lora] Fix overlap loading for cancelled requests (#25413) 2026-05-25 15:18:36 +09:00
Xia WeiwenandMa Mingfei 2bd3ac0b5d [XPU] fix correctness issue of GDN triton kernel for XPU (#26065) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-05-25 13:18:11 +08:00