minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
14,965 Commits 2 Branches 0 Tags
ca8f15cd70f50e54b45be505be19249980824ff4
Commit Graph
14965 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Lianmin Zheng ca8f15cd70 Fix FlashInfer A2A IMA by DP-synchronizing the decode graph bucket (#30242) (#30450) 2026-07-08 14:34:49 -07:00
Michael c55190a638 [AMD] Register 2 CPU-bound 1-GPU tests (phase_checker, scripted_runtime_core) for AMD PR CI (#30446) 2026-07-08 14:04:23 -07:00
Liangsheng Yin 10e7f2925f [Fix] Chain the seq_lens publish event records so prebuilt seeding keeps the forward fence (#30435) 2026-07-08 13:43:09 -07:00
Michael 47a6dfd708 [AMD] Register 3 ROCm-portable JIT kernel tests for AMD CI (#30212) 2026-07-08 13:38:17 -07:00
Xinyuan TongandEazyReal 45019b56ce [Bugfix] Map reasoning_effort=low to Nemotron-3 Super low_effort + warn on unsupported levels (#30463) 
Co-authored-by: EazyReal <8047065+EazyReal@users.noreply.github.com>
 2026-07-08 12:19:44 -07:00
sonle5andsunxxuns 8d2b66fd90 Fix gfx95 bpreshuffle FP8 activation scale layout (#29275) 
Co-authored-by: sunxxuns <126995791+sunxxuns@users.noreply.github.com>
 2026-07-08 10:55:09 -07:00
YC Yen-Ching Tseng fc378f843e [AMD] Temporarily reduce AMD scheduled test frequency to save resource (#30534) 2026-07-08 09:30:59 -07:00
Mohammad Miadh Angkad 04e4fadff3 Use FP32 logits in MoEGate fallbacks (#30323) 2026-07-08 23:43:45 +08:00
Xiaoyu Zhang b8ca06fdad Fix zero expert routed ids for MoE backends (#30387) 2026-07-08 21:23:25 +08:00
shuwenn 108a183f6b [mem_cache][6/N] refactor: move MHA host-pool into pool_host/mha.py (#30249) 2026-07-08 20:12:52 +08:00
Jimmy ShongandClaude Opus 4.8 4c5fe42be4 [DSA] Fix IMA in fused top-k v2: write all output slots on tie overflow (#30512) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-08 19:49:26 +08:00
HuangJi 3d96bb9721 [diffusion] chore: rename lingbot world v2 (#30518) 2026-07-08 19:06:44 +08:00
amote-i 042228a195 [NPU] [DOC] Remove unsupported options of features on Ascend NPU (#30504) 2026-07-08 17:35:06 +08:00
jacky.cheng 96368a5f77 [AMD] Fuse shared-expert sigmoid + bf16->fp32 cast into the MoE append kernel (3 kernels -> 1) (#28658) 2026-07-08 02:34:20 -07:00
YC Yen-Ching Tseng 669b4bc72b [AMD] Gate stage-c on stage-b-test-1-gpu-large-amd (#30496) 2026-07-08 15:41:21 +08:00
YAMY 8a868f8c00 [NVIDIA] Allow modelopt_mixed quantization with flashinfer_cutedsl MoE runner (#30443) 2026-07-07 23:50:52 -07:00
Mohammad Miadh Angkad fda87173ab Revert "Increase the KV cache pool when using indexShare by 15% (#30310)" (#30472) 2026-07-07 23:48:35 -07:00
Xiaoyu ZhangBBufClaude Opus 4.8BBuf
 		33c3dfd7e0 [diffusion] Enable breakable CUDA graph (BCG) for diffusion DiTs (#27436) 
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: BBuf <bbuf@sglang.local>
 2026-07-08 14:45:48 +08:00
amote-i c9303a08da Fix scheduler crash on prefill-unreachable decode abort (#29834) 2026-07-08 14:06:37 +08:00
Cheng Wan 7709a1f358 [refactor] ctx.resources: named slots, stream leases, and workspace buffer leases (#30348) 2026-07-07 21:30:10 -07:00
Cheng Wan b7cca0bf8f [refactor] Collect MoE and DP-attention runtime state into typed flag groups (#30347) 2026-07-07 21:29:27 -07:00
Cheng Wan be32c57598 [refactor] Read resolved config from server_args fields; retire the flags mirror tier (#30346) 2026-07-07 21:28:34 -07:00
Cheng Wan b14f7b4f75 [refactor] Move model-capability adjustments into the resolution pipeline (#30299) 2026-07-07 21:26:55 -07:00
Rahul VijayaraghavanandMa Mingfei d4963f5c55 Fix prefill CUDA graph disabled for deeply-nested multimodal models (#30006) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-07-08 12:11:58 +08:00
Brayden ZhongandBrayden Zhong 455ab36eeb Increase the KV cache pool when using indexShare by 15% (#30310) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-07-07 20:59:13 -07:00
weireweireandweireweire c7ca332fb0 Fix DSV4 prefill large Triton recompilation idle across context lengths (#30255) 
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
 2026-07-07 20:35:33 -07:00
Baizhou Zhang fa278a762c Fix FA3 prefill CP NaNs (#30439) 2026-07-07 20:16:09 -07:00
Alison Shao f3c3eea608 ci: make multi-GPU jit test hangs attributable from the CI log (#29925) 2026-07-07 19:56:32 -07:00
ThanhhaoHao PhanClaude Opus 4.8
 		7bc343470f [Spec] DFlash: support pure-MLA targets with an fp8 KV cache (Kimi-K2.x-NVFP4) (#29218) 
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-07 19:52:14 -07:00
HuangJi db40fd83d2 [diffusion] model: support LingBot-World 2.0 (#30361) 2026-07-08 10:42:50 +08:00
Yihao WangandClaude Opus 4.8 68901ba387 [diffusion] Support SP for Krea-2 (#29777) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-07 19:39:00 -07:00
YC Yen-Ching Tsengandbingxche 9bf122a455 [AMD] Run MI355X disaggregation Nightly Test with runtime checkout code mechanism (#30386) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-07-08 09:27:49 +08:00
Yuchen Tian 9f5948c391 feat(mem_cache): add client-side metadata cache for HiCacheFile storage (#29716) 2026-07-07 18:21:46 -07:00
Yuwei AnandClaude Opus 4.8 49109d4267 [Tiny] Fix Import Error for Pure TP config with flashinfer_mxfp4 (#30426) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-07 18:17:52 -07:00
Chi McIsaacandMick fa185ed84d [diffusion] fix: fix z-Image accuracy (#29742) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-07-08 09:08:32 +08:00
Kaixiliqichaochenbong
 		d7dcdf3efd [DSV4] perf: Make FP8 quant output tensor contiguous (#27926) 
Co-authored-by: liqichao <liqichao@baidu.com>
Co-authored-by: chenbong <bhchen@stu.xmu.edu.cn>
 2026-07-07 17:40:59 -07:00
Michael b363249423 [AMD] ci: run multimodal_gen unit suite on AMD (#30309) 2026-07-07 16:02:58 -07:00
YAMY 48ad6a83cf [DeepSeek-V4] Enable non-paged indexer by default for large prefill chunks (#30140) 2026-07-07 15:51:24 -07:00
averyjones4averyjones4Zijie XiaClaude Opus 4.8
 		631213c3bf Add DeepReinforce Ornith-1.0 to cookbook (#29404) 
Co-authored-by: averyjones4 <averyjones4@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-07 15:14:37 -07:00
Alex NailsandClaude Opus 4.7 3d2e7cc601 [gRPC] Native server: launcher + HTTP + server args wiring (3/4) (#23508) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-07-07 14:57:25 -07:00
Qiaolin Yu 801571e949 [spec decoding] support rejection sampling in multi layer eagle (#30303) 2026-07-07 14:50:24 -07:00
Michael 60f502a4fd [AMD] Register 2 hardware-agnostic 1-GPU PR tests for AMD CI (#30207) 2026-07-07 14:46:22 -07:00
Michael 090efa27a2 [AMD] Register 5 CI-verified 1-GPU kernel/attention unit tests for AMD PR CI (#30290) 2026-07-07 14:44:45 -07:00
Wang, FangYuan 40a68521c9 [AMD] Fix DeepSeekV4 server cutlass error (#30374) 2026-07-07 14:43:05 -07:00
DarkSharpnessziyi.xuClaude Fable 5
 		bbc537035a [DSA] Re-enable fused top-k v2 for MTP: clamp padded-row seq_lens to >= 0 (#30378) 
Co-authored-by: ziyi.xu <ziyi.xu@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-07 13:44:01 -07:00
Brayden ZhongandBrayden Zhong 6875df3378 [Cherry pick to release/v0.5.15] Fix NVILA weight loading (#30400) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-07-07 13:21:55 -07:00
Brayden ZhongandBrayden Zhong e2ea7aafad [Cherry pick to release/v0.5.15] Fix NVFP4 online quantization (#30397) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-07-07 13:20:36 -07:00
sglang-botandsglang-bot d88644b430 docs: sync LMSYS SGLang blog cards (#30395) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-07-07 12:30:47 -07:00
zijiexia 0bf7ddb481 docs(install): add nightly install + docker tag guidance, and auto-bump version on release tag (#30308) 2026-07-07 12:10:05 -07:00
cctry 2ad9a243f5 Size KV pool after CUDA graph capture (opt-in) (#30157) 2026-07-07 12:05:01 -07:00