minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
18,694 Commits 3 Branches 0 Tags
dsv41-pd
Commit Graph
5089 Commits
Author SHA1 Message Date
Brayden ZhongandBrayden Zhong e4253b39e2 Support JIT fused A GEMM (MLA down projection) and support GLM-5 hidden size, SM120 (#27397) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-06-27 13:32:06 -07:00
Xinyuan Tongandhzh0425 592f6c849b [minimax-m3] Split 2/4: mem-cache / HiCache / sparse KV pool (#28713) 
Co-authored-by: hzh0425 <hzh0425@apache.org>
 2026-06-28 00:19:38 +08:00
Aditya KamatandMick 1589603114 model: support baidu unlimited-ocr (#29186) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-06-27 23:36:19 +08:00
ishandhananiZhanghengShangming Cai
 		b030b1a5f3 hisparse: support NIXL DRAM KV destinations for HiSparse (#27563) 
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-06-27 22:32:29 +08:00
hjzhanghjzhanghzh0425
 		c1b5c7e499 Fix DeepSeek V4 PP HiCache SWA allocation and layer mapping (#29106) 
Co-authored-by: hjzhang <zhanghjzzz@qq.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
 2026-06-27 22:19:14 +08:00
jonah-bermanandXinyuan Tong 2f34dbe372 Add native Exa-backed web_search support (#29342) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-06-27 14:41:09 +01:00
Xiaoyu ZhangandClaude Opus 4.8 495f13fa12 [KDA-Pilot] Add diffusion residual-gate CUDA fast path for LTX2 (#29361) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-06-27 12:59:41 +08:00
IvanShan177andClaude Opus 4.8 13b5bd962a fix(spec): track current_token in ReasonerGrammarObject (#29102) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-26 16:43:35 -07:00
Michael c470acde2b [AMD] Register 1 kernel unit test for AMD nightly CI (#29333) 2026-06-26 16:06:02 -07:00
Lianmin Zheng 9c3227b689 Fix IPv6 wildcard bootstrap address resolution in disagg (#29459) 2026-06-26 16:05:36 -07:00
YC Yen-Ching Tseng 5eebb4b2e8 [AMD] Fix fused append+remap DeepEP equivalence test on aiter path (#29377) 2026-06-26 16:04:20 -07:00
Jimmy Shong e745b3af22 [Fix] compressed-tensors block FP8: requantize weight scales to UE8M0 for DeepGEMM on Blackwell (#28662) 2026-06-26 21:41:18 +00:00
Rain JiangandLianmin Zheng be1930133a Convert IPC dataclasses to msgspec.Struct with opt-in msgpack transport (#28688) 
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2026-06-26 12:04:03 -07:00
meinieGuohao ShaoBrayden Zhong
 		714011a40f [JIT Kernel] Migrate dsv3_router_gemm from AOT sgl-kernel to JIT kernel (#21531) 
Co-authored-by: Guohao Shao <shao.gh.98@gmail.com>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-06-26 11:52:18 -07:00
Xiaoyu Zhang 18b0e5757e [Diffusion] Fuse LTX2 Ada values (#29390) 2026-06-26 23:13:15 +08:00
Yan Ru Pei c0d4d1897c fix: batch BlockRemoved events per radix node (#29265) 2026-06-26 16:13:40 +08:00
Xiaoyu ZhangandClaude Opus 4.8 5996b54bd3 [KDA-Pilot] Add diffusion causal Conv3D cat-pad CUDA fast path for Cosmos3 (#29281) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-06-26 15:06:49 +08:00
Yuan Luoandluoyuan.luo a10a24e9a7 [GDN][KDA] ReplaySSM buffered output-only decode for Linear Attention (#28451) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-06-26 14:17:02 +08:00
Wang, MengniPeng ZhangMa MingfeiWeiwei
 		cfc0a0e0e0 Add Intel Quantization Support in SGLang (#18139) 
Signed-off-by: Mengni Wang <mengni.wang@intel.com>
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Weiwei <weiwei1.zhang@intel.com>
 2026-06-26 09:54:35 +08:00
Khoa PhamandClaude Opus 4.7 6c92f9f328 fix(bench): pass DCP_RANK/DCP_WORLD_SIZE to set_mla_kv_buffer_kernel (#29356) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-06-25 18:13:57 -07:00
hhhh1252023 781537b61d [NPU] Nightly CI refactor and enhancement (#27433) 2026-06-26 08:52:06 +08:00
Xinyuan Tong ed71fb8f95 fix(anthropic): detect-and-passthrough mid-conversation system messages (#28906) 2026-06-25 17:14:12 -07:00
Yibo Cai 4ce1c180bd [sgl-kernel/cpu]: fix arm64 w8a8 moe kernel signature (#29270) 2026-06-26 08:11:57 +08:00
Lijuan Tang 623300a589 [MLX] Fix FutureMap relay unit test to use RelayPayload (#29311) 2026-06-25 16:53:58 -07:00
Ma Mingfei 1ba7c79761 [CPU] add indices in chunk_gated_delta_rule (#29267) 2026-06-26 07:51:07 +08:00
Khoa PhamandClaude Opus 4.7 c8c6757bed test(dp-attn): drop --enable-torch-compile from TestDPAttentionDP2TP2 (#29345) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-06-25 16:41:35 -07:00
Augusto Yao ea8f4e9f3f [feature] implement dcp for deepseek_v2 (#14194) 2026-06-25 15:15:04 -07:00
Mohammad Miadh Angkad 212c30d008 [MoE Refactor] Centralize FlashInfer CUTLASS MoE runner (#28211) 2026-06-25 13:40:33 -07:00
Michael e6efe10072 [AMD] Register 5 JIT kernel unit tests for AMD nightly CI (#29197) 2026-06-25 13:12:58 -07:00
Baizhou Zhang 3344b73c80 Add DeepSeek V4 Pro GB300 nightly and expand Kimi K25 nightly test (#28103) 2026-06-25 12:13:52 -07:00
Brayden ZhongandBrayden Zhong 9495737d82 Fix CI broken by #28450 (#29308) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-06-25 10:35:34 -07:00
Rita Brugarolas 3d3a7ec031 [AMD] fix(moe): correct fused shared-expert scaling on aiter/DeepEP path (mori all-to-all) (#28237) 
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
 2026-06-25 01:56:30 -07:00
Michael ec12a28a87 [AMD] Register 7 JIT kernel unit tests for AMD nightly CI (#28967) 2026-06-25 01:51:30 -07:00
Michael 4ba8634780 [AMD] Register scripted-core chunked-prefill test for AMD extra-a CI (#29058) 2026-06-25 01:50:08 -07:00
Rita Brugarolas de2d01c8da [AMD] Fuse shared-expert append + DeepEP remap into one Triton kernel (#28450) 
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
 2026-06-25 01:22:57 -07:00
Raiden MakotoandRaiden-Makoto 9215da2515 [AMD] [GLM5] skip redundant -inf pre-fill of HIP indexer MQA-logits (#28757) 
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
 2026-06-24 23:21:39 -07:00
Liangsheng Yin c7734e6871 [Spec] Dissolve EagleDraftInputV2Mixin so spec-info dataclasses hold data only (#29220) 2026-06-24 18:08:30 -07:00
fzyzcjy 2b64fc7a2c Remove Req.extend_logprob_start_len field and make it pure (#27625) 2026-06-25 09:06:14 +08:00
Ma Mingfei 2c3f007a65 [CPU] optimize GDN prefill performance (#29117) 2026-06-25 09:04:34 +08:00
fzyzcjy 7002a37ea1 Inline extend_range accessors and remove the extend_input_len/fill_len properties (#27611) 2026-06-25 08:56:44 +08:00
fzyzcjy d0524d6433 Avoid scattered assignment of extend_input_len and fill_len by merging them into Req.extend_range (#27610) 2026-06-25 08:33:28 +08:00
fzyzcjy 563c3418a7 Avoid dual semantics of extend_input_len by computing the candidate on the fly (#27616) 2026-06-25 08:17:37 +08:00
Brayden ZhongandBrayden Zhong 5d4e63d49e Sync the changes in #23402 (#29063) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-06-24 17:01:02 -07:00
Lianmin ZhengandRain Jiang fd87a85388 Convert SamplingParams to msgspec Struct (#29198) 
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
 2026-06-24 13:42:45 -07:00
Kaixi d5e9176f65 [BCG][GLM5] perf: BCG support and prefill enhancements (#27053) 2026-06-24 13:13:35 -07:00
Lianmin Zheng d5c566e59b Extract profile request cleanups (#29098) 2026-06-24 11:22:58 -07:00
qiaozpandishandhanani 03773ae35b [HiCache] Add NIXL FILE cache cleaner (#28258) 
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
 2026-06-24 08:13:55 -07:00
hirakunaramuka2andClaude Fable 5 7430c56b20 [Misc] Use logger instead of print() in utils/common.py (#29004) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-06-24 09:45:01 +00:00
Yuhao Yang 0fc815aa2c [CI] Temporarily disable openbmb MiniCPM tests (#29095) 2026-06-24 01:39:44 -07:00
jundu e04ed05193 [CI] reduce CPU CI scope with base-c suite (#28623) 2026-06-24 16:18:06 +08:00