minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
12,067 Commits 2 Branches 0 Tags
ddcacaf1bd4eb87f36d7bf110640fc8c812b521e
Commit Graph
12067 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zheng Wengang 91825b8808 [FEAT][EPD] support encoder real health (#23343) 2026-04-27 13:21:28 +08:00
AMD-yanfeiwang 5141d8ae21 [AMD]fix: use CUDA event for targeted draft-to-verify sync in EAGLE overlap (#21940) 2026-04-26 21:58:34 -07:00
Bingxu Chen d84470079d [AMD] Fix Grok-2 nightly: avoid multimodal misdetection from auto-populated vision_config (#23383) 2026-04-26 21:54:36 -07:00
zijiexia c74b345e3a [docs] Update FA4 support SWA (#23793) 2026-04-26 20:40:36 -07:00
Jia GuoandClaude Opus 4.7 bead2e3470 perf: optimize PCG inductor path for FP8 models (redo of #21734) (#23227) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-26 20:34:27 -07:00
Byron HsuByron HsuClaude Opus 4.7
 		85376a6119 refactor(moe): centralize post-experts all-reduce skip predicate (#23748) 
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-26 20:29:59 -07:00
sglang-botandsglang-bot da175b964d chore: update CI test est_time values (#23785) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-26 20:17:50 -07:00
iridiumine 32c3513816 [NPU] Support MTP for Qwen3.5 (#20918) 2026-04-27 10:44:17 +08:00
Baizhou ZhangandClaude Opus 4.7 977830e91e ci(deepseek-v4): add b300/grace-blackwell dev-branch build options (#23778) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-26 16:44:16 -07:00
Kangyan-ZhouandClaude Opus 4.7 35591c7d51 fix(lora): don't assert on non-LoRA lm_head adapter weights (#23433) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-26 12:10:07 -07:00
zijiexia 3d95ca7546 docs(DeepSeek-V4): mark gb200|big|low-latency verified (#23737) 2026-04-26 11:15:59 -07:00
Mick a392ae8879 [diffusion] feat: accelerate multiple-outputs generation (#23759) 2026-04-27 01:47:33 +08:00
jianan-guZheng, BeileiMa MingfeiXinyuan Tong
 		10fd0faccd [CPU] Add Qwen3.5 model optimization for CPU (#19484) 
Co-authored-by: Zheng, Beilei <beilei.zheng@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-04-26 10:12:36 -07:00
Liwansi 7d49564431 [NPU]Fix support_triton bug (#23604) 2026-04-26 21:34:56 +08:00
Cheng WanandClaude Opus 4.7 c7878dbb6d [MoE] Deprecate act_and_mul_triton; fold filter_expert into JIT silu/gelu_and_mul (#23707) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-26 01:41:35 -07:00
Mick d49a0377de [diffusion] refactor: make timestep scheduler request-local (#23716) 2026-04-26 15:59:53 +08:00
sglang-botsglang-botKangyan ZhouClaude Opus 4.7
 		9003f24e2b chore: bump sglang-kernel version to 0.4.1.post1 (#23733) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 23:23:49 -07:00
Kangyan-ZhouandClaude Opus 4.7 8efa177f1e [CI] release-pypi-nightly: install protoc before building wheel (#23750) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 22:37:29 -07:00
Kangyan-ZhouandClaude Opus 4.7 4be853e1c6 [CI] release-whl-kernel: strip +cu129 local version before PyPI upload (#23749) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 22:14:45 -07:00
Ethan (Yusheng) Su 3cfd1561df docs(DeepSeek-V4): add h200|big verified recipes + tune H200 Pro parameters (#23742) 2026-04-25 21:44:51 -07:00
Kangyan-ZhouandClaude Opus 4.7 282b47fcfd [CI] release-whl-kernel: clean root-owned build artifacts before checkout (#23747) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 21:39:41 -07:00
Yuhao Yang 049f1bf6fb docs(DeepSeek-V4): add GB200 platform to cookbook recipe (#23725) 2026-04-25 20:54:55 -07:00
Byron HsuByron HsuClaude Opus 4.7Kangyan-Zhou
 		ba4e9d2ac2 Apply should_use_dp_reduce_scatterv guard to remaining MoE models (follow-up to #23731) (#23732) 
Co-authored-by: Byron Hsu <byronhsu@noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-04-25 20:36:16 -07:00
Byron HsuByron HsuClaude Opus 4.7
 		71029abd64 Fix Qwen3 MoE: also guard EP all-reduce with not use_reduce_scatter (follow-up to #23731) (#23734) 
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 20:35:52 -07:00
sglang-botsglang-botKangyan ZhouClaude Opus 4.7
 		714173555c chore: bump sgl-kernel version to 0.4.1.post1 (#23720) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 17:13:02 -07:00
Byron HsuandByron Hsu 99b59b279c Fix Qwen3 MoE double-reduce when DP attention + EP + reduce_scatterv (#23729) (#23731) 
Co-authored-by: Byron Hsu <byronhsu@noreply.github.com>
 2026-04-25 15:28:28 -07:00
Kangyan-ZhouandClaude Opus 4.7 921e14dcac [CI] release-docker-deepseek-v4: select which flavors to push (#23730) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 14:09:34 -07:00
Kangyan-Zhou 0c826374a8 ci: add docker release workflow for deepseek_v4 branch (#23728) 2026-04-25 11:45:23 -07:00
Kangyan-ZhouandClaude Opus 4.7 acaa35664d [CI] sgl-kernel: prune dangling images before each wheel build (#23723) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 10:44:47 -07:00
AlbeeSo e0a4522370 [typo] fix typo in parallel_state (#23710) 2026-04-25 09:33:33 -07:00
Mick 03849496ad jit_kernel: tolerate FA3 kernels without out arg (#23717) 2026-04-25 23:42:33 +08:00
fzyzcjy d4c1665626 docs(DeepSeek-V4): mark h200|big|pd-disagg verified + recipe fixes (#23715) 2026-04-25 22:49:12 +08:00
1874.andronnie_zheng 046c14a3ed [NPU] Support GGUF quantization for Ascend NPU (dense + MoE) (#17883) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-04-25 17:16:47 +03:00
gjsheuandgengjinsong e708ea6d94 [diffusion] fix: restore cache-dit support for LTX2 (#23235) 
Co-authored-by: gengjinsong <gengjinsong@huawei.com>
 2026-04-25 18:10:43 +08:00
Aleksi Vesanto 50ce2708ca [diffusion] fix: Fix FLUX.1/2 graph breaks (#23648) 2026-04-25 17:54:52 +08:00
fzyzcjy 880599cd43 docs(DeepSeek-V4): bump GB300 Pro PD decode --mem-fraction-static 0.83 → 0.9 (#23698) 2026-04-25 16:35:44 +08:00
amote-i 11d77a60df [NPU] [DOC] Update supported models and features of npu (#23564) 2026-04-25 15:37:07 +08:00
kkandroot 393252f514 [AMD] fused qk gemma norm kernels to reduce four kernels (#23575) 
Co-authored-by: root <root@smci355-ccs-aus-g12-26.cs-aus.dcgpu>
 2026-04-25 00:30:01 -07:00
Артем Савкинandronnie_zheng bd523dd60d [NPU] [Bugfix] [Diffusion] Fixed gray images at the generation output (#23266) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-04-25 10:20:38 +03:00
Yujing 6175946db7 [Feature]Add MSProbe dump support in SGLang (#18349) 2026-04-25 10:12:50 +03:00
Yujun Dongandhzh0425 21835fb0af [HiCache] Prevent move_hybrid_indices from polluting radix-tree node host state (#23427) 
Co-authored-by: hzh0425 <hzh0425@apache.org>
 2026-04-25 14:27:42 +08:00
DarkSharpnessCheng WanCheng WanClaude Opus 4.7
 		82254bd9c5 [JIT Kernel] Reland JIT activation (#22094) 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-24 23:00:28 -07:00
ishandhananiandBaizhou Zhang 0d224e5053 update: b300 container for dsv4 (#23697) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-04-24 22:59:20 -07:00
YC Yen-Ching Tseng adc59325bc [AMD] Optimize MiniMax-M2.5 - enable fused Triton kernel for FP8 KV cache write in aiter decode path (#23620) 2026-04-24 22:23:49 -07:00
YC Yen-Ching Tseng fb272d27db [AMD] Optimize MiniMax-M2.5 - use aiter biased_grouped_topk for sigmoid scoring in MoE routing (#23611) 2026-04-24 22:18:08 -07:00
Shenxiu Liu 8471c9ebe6 Skip torch.cuda.empty_cache() in weight update flush path (#22998) 2026-04-25 12:41:39 +08:00
Baizhou Zhang 69485a176c Small udpate gb300 recipe for deepseek v4 (#23690) 2026-04-24 21:35:16 -07:00
fzyzcjy 8a395994ed docs(DeepSeek-V4): mark gb300|{small,big}|{cp,pd-disagg} verified + GB300-specific fixes (#23691) 2026-04-25 12:21:57 +08:00
fzyzcjy d2c61acf25 docs(DeepSeek-V4): mark b200|small|pd-disagg + h200|small|{cp,pd-disagg} verified (#23689) 2026-04-25 11:57:25 +08:00
fzyzcjy fd401c2fb4 docs(DeepSeek-V4): note SGLANG_FIX_DSV4_BASE_MODEL_LOAD for base models (#23684) 2026-04-25 11:27:00 +08:00