minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
18,185 Commits 2 Branches 0 Tags
9ffe548738d8a4ef52d76eec269f9e5ce3ab5a54
Commit Graph
18185 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
MickMick QianClaude Opus 5
 		9ffe548738 [diffusion] fix: don't route an unreadable checkpoint into the native fallback (#39292) 
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-13 20:30:24 +08:00
Shuwen Wang 14b647cf27 chore: add HiSparse coordinator and allocator code owners (#38682) 2026-09-13 18:42:33 +08:00
Hritik Raj d24eacaecd [Test] Add unit test for muse_glimmer_format (#37015) 
Signed-off-by: Hritik003 <hritik.raj@nutanix.com>
 2026-09-13 18:40:02 +08:00
Jundong LiuandShuwen Wang 7078e5ffbc [HiCache] Publish a host store event for storage-prefetch refills (#38486) 
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
 2026-09-13 10:29:14 +00:00
huangtingweiandhzh0425 a7cf4a6fbc [Unified Cache][7/N] Support MTP, EAGLE, and DSpark draft KV caches in the external linker (#37914) 
Co-authored-by: hzh0425 <hzh0425@apache.org>
 2026-09-13 18:22:06 +08:00
Jimmy ShongClaude Fable 5.1rdxaYangmin LiManriqueyhyang201
 		cebca698e2 [Qwen3.8] Enable NVIDIA NVFP4 on DGX Spark with file-backed PLE and PDL router fix (#39126) 
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: rdxa <rdxa@rdxa-int-spark-01.yvb.moe>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Manrique <nanomlm@gmail.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
 2026-09-13 16:23:41 +08:00
jacky.chengandHAI d6fabb74b4 [AMD][Fix] Fix aiter bpreshuffle GEMM for output sizes it cannot dispatch for qwen3.5 mxfp-attn-fp8-v2 TP4 (#37564) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-09-12 23:11:44 -07:00
MickMick QianClaude Opus 5
 		d2f054d916 [diffusion] CI: make diffusion GT generation usable without the publish token, and cover the 5090 lane (#39255) 
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-13 13:59:43 +08:00
MickMick QianClaude Opus 5
 		492f346d88 [diffusion] CI: set an explicit x264 preset for video output (#38657) 
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-13 13:47:41 +08:00
William HuandXinyuan Tong 6d6d42d1c0 [Fix] Preserve GLM tool argument types across JSON Schema unions (#39136) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-09-13 13:47:13 +08:00
Byron HsuByron HsuManik Singhal
 		34b2904741 [Session] Work with PD and Fix empty continuations (#39038) 
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Manik Singhal <3400497+Manikvsin@users.noreply.github.com>
 2026-09-12 22:24:32 -07:00
cctry 24b6c1c7f5 Fix multimodal embedding cache retaining full batches through views (#39120) 2026-09-12 21:37:14 -07:00
cctryandcctry 7e3d18bbcc Add a provider hook for prefill-buffer ceilings (#39182) 
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
 2026-09-12 21:37:10 -07:00
Baizhou Zhang 7763f666f3 Fix DeepGEMM release MegaMoE validation without RDMA (#39245) 2026-09-12 20:27:29 -07:00
Thomas Wang ec5fba5777 [AMD] Add dspark config and agentic workload section for deepseek-v4 model (#39252) 2026-09-12 19:32:01 -07:00
cctryandcctry 206034e520 Keep graph-pool borrows on their allocation stream (#39180) 
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
 2026-09-12 19:26:09 -07:00
cctryandcctry 18cc55dc0b Expose a capacity check for graph-pool borrows (#39178) 
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
 2026-09-12 19:24:57 -07:00
Xiaoyu ZhangandMick Qian 23bc4c6ed9 [Diffusion] Return Qwen-Image-Layered outputs and preserve CFG2 rounding (#38549) 
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
 2026-09-13 09:15:47 +08:00
Xiaoyu ZhangandMick Qian 3e035a3513 [Diffusion] Optimize Qwen-Image-Edit attention on Hopper (#38584) 
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
 2026-09-13 09:15:01 +08:00
Cheng Wan fa663e7297 config: delete the redundant full stamp in initialize_model_parallel (#39202) 2026-09-12 17:27:21 -07:00
Cheng Wan fa260f26da config: delete dead ensure_model_parallel_initialized (#39137) 2026-09-12 17:27:12 -07:00
Cheng Wan 6804eeaabe config: an out-of-tree replacement point for every resolution-pipeline step (#39134) 2026-09-12 17:26:54 -07:00
Baizhou Zhang a8b5616303 Fix DeepGEMM release dependencies and bound GPU validation (#39241) 2026-09-12 17:00:58 -07:00
xiaobochen-amdJohnQinAMDRuibinCheungZhang, Jiejing
 		6657f7d844 [MoE][ROCm] Admit the unified Triton router on ROCm, including single-group routing (#38328) 
Co-authored-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: RuibinCheung <ruibzhan@amd.com>
Co-authored-by: Zhang, Jiejing <jiejing.zhang@amd.com>
 2026-09-12 16:21:28 -07:00
Baizhou ZhangXinyuan TongzRzRzRzRzRzRzRShijin Zhangzanes-ops
 		a66451c058 [GLM-5.3 Flash] Restore and enable KPool metadata fusion (#38845) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2@liverpool.ac.uk>
Co-authored-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: zanes-ops <zanes@nvidia.com>
 2026-09-12 16:01:11 -07:00
Zhang, Jiejing 288627e400 [AMD] Document GLM-5.2 MXFP4 recipe update on MI355X (#39230) 2026-09-12 15:57:15 -07:00
Xinyi Song 21289cfd50 [AMD] Fix Dspark accept length and reduce host bubble on DSV4 (#39116) 2026-09-12 15:21:43 -07:00
Xinyuan Tong b5a2aebc7e [Docs] GLM-5.3-Flash cookbook: fixed MTP 5/1/6, EP1 + flashinfer_trtllm on Blackwell (#39213) 2026-09-12 12:56:57 -07:00
cctryandcctry 7ae4af8187 Scope graph-pool borrowing to the runtime and reduce fragmentation (#39177) 
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
 2026-09-12 11:45:17 -07:00
cctryandcctry 2784a86062 Reuse live CUDA graph executables during dedup registration (#39176) 
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
 2026-09-12 11:44:17 -07:00
Byron HsuByron HsuManik Singhal
 		25a5641cf2 [Session + MM] Fix text positions in session continuations (#39144) 
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Manik Singhal <3400497+Manikvsin@users.noreply.github.com>
 2026-09-12 10:31:55 -07:00
jlqibmClaude Opus 4.8Xinyuan TongXinyuan Tong
 		ae1acf822d [GraniteMoE] Load split per-expert quantized MoE weights (#37679) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-09-12 23:10:20 +08:00
MickMick QianClaude Opus 5
 		7b89b95168 [diffusion] feat: pick the attention backend by measuring it (#38689) 
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-12 21:52:16 +08:00
MickandMick Qian dc3171c322 [diffusion] CI: remove mova ulysses two-gpu CI case (#39097) 
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
 2026-09-12 21:48:04 +08:00
Shijin ZhangXinyuan TongXinyuan Tong
 		925e684a88 [Feat][Responses API] Support custom tools, encrypted reasoning replay, developer tier and model validation (#38690) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-09-12 21:29:12 +08:00
desmond-intel 6dc7b3421b Inference Support Mamba 2 and 1 (#34556) 2026-09-12 20:51:18 +08:00
KunalandClaude Fable 5.1 fd32226706 Fix gpt-oss RunAI streamer weight ownership (#38908) 
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-12 20:21:59 +08:00
Shuwen Wang bd45cd50ca [Unified Tree] Port SWA Branching-Point Caching to the Rust TreeCore (#37584) 2026-09-12 18:37:57 +08:00
Yanbin JiangandShuwen Wang 0b415fa573 [HiCache][LoRA] Isolate storage pages by extra key (#38577) 
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
 2026-09-12 18:18:14 +08:00
Shuwen Wang b9cb96496d [Unified Tree] Preserve aux LRU recency when splitting nodes (#38482) 2026-09-12 18:17:38 +08:00
Qiaolin Yu 6953dae005 [Qwen 3.8 Next] Remove unused tokenwise QSA implementation and tests (#38960) 2026-09-12 01:32:01 -07:00
ChangLiu0709 7bc4eb3740 [AMD] Update MI355X MXFP4 HiCache defaults and quick-reduce quantization for Qwen3.5 cookbook (#39104) 2026-09-12 00:59:32 -07:00
Tuan Nguyen Gia 7c195b9151 [AMD] Fix Quark load of MiniMax-M3 MXFP4 index_qkv_proj (#37254) 2026-09-12 00:50:41 -07:00
MickandClaude Opus 5 bf3305b65e [diffusion] feat: read mapped layers directly when the host cannot cache them (#39022) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-12 15:48:03 +08:00
Xiaoyu ZhangandCursor 0a57403468 [Perf] Optimize Qwen3-VL unique-image serving on H100 (#36411) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-12 15:16:59 +08:00
Khoa PhamandClaude Fable 5.1 6ba96d329f [DCP] Resolve --dcp-comm-backend to fi_a2a/a2a by default for every model (#39165) 
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-11 23:48:42 -07:00
Shangming CaiandClaude Fable 5 981b947568 [Fix] Seed raw tokenizer_path for smg-grpc-servicer in gRPC mode (#39105) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-09-12 14:41:15 +08:00
Baizhou Zhang 56a4f47ca6 [CI] Fix base-a wait for skipped CPU matrix (#39195) 2026-09-11 23:39:53 -07:00
Baizhou Zhang 3bb2a5231a [CI] Extend DeepGEMM SM90 test timeout to four hours (#39194) 2026-09-11 23:36:54 -07:00
ehuaa 1cdc5bca5e fix(qsa): clamp the compress gather to the rows this forward has (#38346) 2026-09-11 23:24:17 -07:00