minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
16,123 Commits 2 Branches 0 Tags
65d5a0ec2596d314fbcd88bf179d2ea912aaaa02
Commit Graph
11036 Commits
Author SHA1 Message Date
Mohammad Miadh Angkad 65d5a0ec25 Support ModelOpt MXFP8 checkpoints (#32538) 2026-08-05 17:44:32 -07:00
Liangsheng Yin 3869fe556f [CI] Collapse the EAGLE launch matrix and the scoring engine boots on the per-commit runners (#33756) 2026-08-05 16:43:19 -07:00
Mohammad Miadh Angkad 5424d2039c [CI] Fix GLM-Image usage unit tests (#33731) 2026-08-05 16:20:08 -07:00
Polisetty V R K Jyothendra Varma a1cc286062 [Intel GPU] DeepSeek V4 4/N: use sgl-kernel implementation of fused_q_norm_rope on XPU (#27790) 
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
 2026-08-05 16:04:35 -07:00
Liangsheng Yin c0ef548eef [misc] Unify MLA scaling init and remove dead buffer / scaling code (#33363) 2026-08-05 15:59:33 -07:00
YAMY 990a446773 Fix padded positions in breakable CUDA Graph attention (#33253) 
TestBreakableCUDAGraphBasic and all NVIDIA CI tests pass.
 2026-08-05 15:53:28 -07:00
YAMYandChunan Zeng 7bc90ab394 Select DeepGEMM standard layouts by memory budget (#33474) 
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
 2026-08-05 15:50:43 -07:00
yvbbrjdrandhnyls2002 02cd44c59a feat(dgx-spark): add inkling-small MoE support for sm_121 (#33108) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-08-05 15:06:59 -07:00
cctry a3a1ebc7b7 Warn on risky serving-time Triton work (#33120) 2026-08-05 14:55:03 -07:00
Ziang Li 988c6e6aeb Pin online NVFP4 4over6 quantization settings (#33621) 2026-08-05 21:29:32 +00:00
Brayden ZhongandBrayden Zhong a14c870886 Fix broken Nemotron DP attention (#33123) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-08-05 14:27:05 -07:00
Hank Han 9436de717f [Spec][PD] Enable fused TopK for GLM-5.2 MTP IndexShare (#31477) 2026-08-05 14:17:42 -07:00
Zhiqiang Xie 106bcc1293 Observability enhancement for HiCache (#32388) 2026-08-05 14:13:06 -07:00
Shu Wang 55b1c09e73 [core] Consolidate compiled-kernel caches under SGLANG_CACHE_DIR (#32434) 2026-08-05 13:54:27 -07:00
Jialin Ouyang 717a559f02 [Scheduler] Align WAR fences with CUDA graph metadata reads (#33587) 2026-08-05 13:52:20 -07:00
Leon Hibnikjaron1990jaron1990Copilot Autofix powered by AIcopilot-swe-agent[bot]alexnails
 		ea65f8ddc9 Feat/spectrum (#31491) 
Co-authored-by: jaron1990 <jaron1990@gmail.com>
Co-authored-by: jaron1990 <34618972+jaron1990@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: alexnails <alex.nails@radixark.ai>
 2026-08-05 13:23:17 -07:00
JohnyixiaodapengAlex Nails
 		5c4f72f92a [Build] Add srt_empty extra group for device-agnostic install (#31300) 
Co-authored-by: yixiaodapeng <yixiaodapeng@example.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
 2026-08-05 13:17:46 -07:00
Liangsheng Yin de34dd11e9 [CI] Fold duplicate-server suites and prune the retract matrix on 1-gpu-5090 (#33745) 2026-08-05 12:41:51 -07:00
Jason Mancuso 36853b8ffc [Spec] Support logprobs with DFlash (#33459) 2026-08-05 12:37:12 -07:00
Khoa Pham 5f79cf3511 [DCP] Match the replicated draft KV pool's page granularity to its allocator (#33348) 2026-08-05 11:40:28 -07:00
Jialin Ouyang b1bd871df5 [Unified Radix Cache] Complete the tree-core interface boundary (#33580) 2026-08-05 11:39:28 -07:00
cctry 96c89863a3 Measure prefill busy time between launches (#33595) 2026-08-05 11:26:27 -07:00
WenhaoZhang acaab22d09 [diffusion] feat: add SageAttention packed varlen path for minimax-h3 (#33703) 2026-08-06 01:19:58 +08:00
zhaozx-cn 4e7209caa8 [NPU] Add causal conv1d (#28267) 2026-08-05 22:22:49 +08:00
Xiaoyu ZhangandClaude Fable 5 3425c93666 [diffusion] Wan VAE RMSNorm+SiLU fusion behind quality=high (H200 FastWan2.2 e2e 9.611 -> 9.125 s) (#33546) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-05 21:33:35 +08:00
silencejade 593777c046 [FIX] [benchmark] Fix flush_cache failure after warmup by waiting for server idle (#33527) 2026-08-05 21:27:43 +08:00
Xuan LiaoandMa Mingfei 3b4fac5b99 [XPU] DeepSeek V4: use sgl-kernel-xpu implemetation of flash_mla_sparse_fwd for prefill (#31865) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-08-05 21:05:53 +08:00
Mick 99709f734d [VLM] split multimodal scheduling from mm_utils (#32415) 2026-08-05 20:24:12 +08:00
Xiaoyu ZhangandClaude Fable 5 a5888c956f [diffusion] Pack Ulysses Q/K/V input all-to-all into one collective + reusable a2a staging buffers (#33667) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-05 19:15:46 +08:00
Seraphim Volochaevgemini-code-assist[bot]ronnie_zheng
 		2f22ed58ea [NPU] Adding a fast layernorm for diffusion models and fix BSA (#29027) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-08-05 14:06:00 +03:00
Yuefeng Wuwuyuefengronnie_zheng
 		22d558b103 [Feature] Add GLM Image usage report (#33378) 
Co-authored-by: wuyuefeng <wuyuefeng@noreply.gitcode.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-08-05 13:59:49 +03:00
Alex NailsandClaude Fable 5 6fa3f9df11 [Bugfix] Treat unsharded model.safetensors as HF weights in Mistral-native format detection (#33671) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-05 01:54:46 -07:00
paulzhang-tmhnyls2002Liangsheng Yin
 		a6e5fa7081 [Scheduler] Honor explicit min-free-slots thresholds (#33403) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-08-05 01:44:18 -07:00
Trevor Morris 81c7a54ecd [NVIDIA] Use sm_100f instead of sm_100a for sgl-kernel and FlashMLA (#33433) 2026-08-05 01:36:46 -07:00
Xinyi Song 1478cdec9f [AMD] Fuse Kimi-K3 attn-residual aggregation (#33599) 
HIP Gated changes
 2026-08-04 23:20:04 -07:00
Артем СавкинandXiaoyu Zhang d96df7bed5 [Diffusion] Batch GLM-Image AR requests (#30683) 
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-05 08:47:06 +03:00
Mohammad Miadh AngkadXinyuan TongDavid Orman
 		059269594c [DSV4] Add official DSV4 reasoning effort support (#33140) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: David Orman <ormandj@corenode.com>
 2026-08-05 12:50:41 +08:00
Liangsheng Yin 198a3bc29b [Test] Route GEMM backend UTs through real layer modules and weight loaders (#33615) 2026-08-04 20:53:26 -07:00
Liangsheng Yin 1033cae8d5 [CI] Speed up dependency install: dual-ABI Rust ext cache and prevalidation pruning (#33619) 2026-08-04 20:33:48 -07:00
Kaixi 6c05aaae7e [trtllm_mha] perf: Stop allocating per-layer scratch inside the decode CUDA graph (#33063) 2026-08-04 19:27:26 -07:00
Cao EChandrakant KhandelwalClaude Opus 4.8
 		4949b5fccf [XPU] Add qknorm_rope support for Flux (#30883) 
Co-authored-by: Chandrakant Khandelwal <Chandrakant.Khandelwal@intel.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-08-05 10:12:24 +08:00
gjsheu 5dc4102960 [npu] [bugfix] Fix PD‑disaggregation error (#33523) 2026-08-05 09:54:00 +08:00
Connor CarpenterishandhananiAlex Nails
 		a0b04dbe4c feat(grpc): add generation request semantics (#32588) 
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
 2026-08-04 18:53:45 -07:00
Polisetty V R K Jyothendra VarmaandMa Mingfei d2c405f19d [Intel GPU] DeepSeek V4 8/N: use sgl-kernel implementation of fused_k_norm_rope_flashmla on XPU (#28040) 
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-08-05 09:28:43 +08:00
Xiaozhu MengmxzLianmin Zheng
 		211ee64249 [rotary] Rebuild the shared RoPE cache entry when its buffers are dead (#33575) 
Co-authored-by: mxz <mxz@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2026-08-04 17:24:42 -07:00
Liangsheng Yin a0b3f1dde6 [Test] Replace GEMM backend e2e matrices with layer-level unit tests (#33596) 2026-08-04 15:50:41 -07:00
Lianmin Zheng b0fd31ba07 Multiple flexibility fixes for DP attention (#33537) 2026-08-04 15:40:40 -07:00
cctry c8822fd990 Clarify post-capture KV reservation logs (#33598) 2026-08-04 15:06:11 -07:00
FilipandClaude Opus 4.8 19d3f86895 [LoRA] Laguna: per-layer LoRA hidden-dim resolution for packed attention (#30298) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-08-04 14:48:05 -07:00
Xinyuan TongandAlex Nails a9c3b55435 [Refactor] Keep chat template validation out of ServerArgs dispatcher (#33392) 
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
 2026-08-04 14:45:47 -07:00