minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
16,281 Commits 2 Branches 0 Tags
891445676cdfd48841662957d6793ea67c55e783
Commit Graph
1351 Commits
Author SHA1 Message Date
Mick d747bd052e feat(vlm): auto-select cuda vmm on multi-node mnnvl (#33936) 2026-08-08 16:00:58 +08:00
Haocheng XiClaude Opus 4.8Mick
 		f64328c7f6 [diffusion] feat: support quant-videogen prq kv-cache quantization (memory-saving) for causal-dit (#32581) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-08-08 12:56:54 +08:00
MickandClaude Fable 5 24c84dfa68 [diffusion] doc: add parallelism overview (#33704) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-08 11:36:06 +08:00
MickandClaude Fable 5 a25c330eb1 [diffusion] feat: cross-node sequence parallelism (Ulysses x Ring) (#33327) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-08 10:56:28 +08:00
Douglas YangandClaude Opus 5 86f373daff docs(cookbook): DeepSeek-V4-Flash-0731 — drop chunked-prefill/autotune flags on B300 low-latency (#34044) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-07 23:12:56 +00:00
Faradawn Yang 115cd7bde1 docs: update checkpoint to Qwen3.5 NVFP4 V2 for InfX (#32945) 2026-08-07 15:26:07 -07:00
Xinyuan Tong 0da25ee6f7 Docs: Ling-3.0-flash cookbook — serve native 256K, drop YaRN override (#33882) 2026-08-07 21:46:51 +00:00
Yifei SuosuoyfMick
 		bc148dfdc8 [diffusion] feat: make scheduler rpc deadlines explicit (#33965) 
Co-authored-by: suoyf <suoyf@nscc-tj.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-08-07 21:33:23 +08:00
Lennox FuandMick 7af3d000f2 [diffusion] feat: gate /health and /health_generate on warmup completion and add liveness endpoint (#33787) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-08-07 17:59:23 +08:00
amote-i 470807ef74 [NPU] [DOC] Upgrade recommendeded sglang version on Ascend NPU (#33976) 2026-08-07 17:45:00 +08:00
Mick c2657cc4bf [diffusion] refactor: gate fast vae paths by quality (#33849) 2026-08-07 12:39:55 +08:00
WenhaoZhang 914644e81c [diffusion] fix: fix 4/8-step distilled minimax-h3 turbo lora merge (#33875) 2026-08-07 12:38:37 +08:00
Brayden ZhongandBrayden Zhong 0c3a76fa0a Clean GLM-5.2 NVFP4 cookbook (#33935) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-08-07 11:51:34 +08:00
MickandClaude Fable 5 1e08b865f9 [diffusion] feat: support K/V-gather style sequence parallel (CP-like) attention (#32667) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-07 09:39:28 +08:00
Mohammad Miadh AngkadandBrayden Zhong 434e646282 [Deps] Upgrade CUDA PyTorch stack to 2.13 (#28836) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2026-08-06 12:08:44 -07:00
Ziang LiandBrayden Zhong 4ad990ba7d [ModelOpt FP4] Support online MoE weight quantization (#33115) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2026-08-06 11:01:55 -07:00
Mick 7195b8e4c7 [diffusion] refactor: validate and document spectrum controls (#33851) 2026-08-06 23:23:11 +08:00
Mick 44bde3911a [diffusion] fix: resolve IPC A2A peers from process groups (#33848) 2026-08-06 23:22:41 +08:00
Mick c212a6938c [diffusion] chore: retire released warmup and decoder flags (#33850) 2026-08-06 23:02:32 +08:00
mohbasitBasitHAI
 		f8f2870a84 Profiling Enhancements [1/3]: cuda graph profile traces (#24370) 
Co-authored-by: Basit <mohbasit@ctr2-alola-ctrl-01.amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
 2026-08-06 03:19:35 -07:00
Thomas Wang dea07b348b [AMD] Update amd k3 cookbook for fp8 kv cache (#33825) 2026-08-05 23:35:38 -07:00
MickandClaude Fable 5 604d3561b0 [diffusion] feat: data-parallel serving (--dp-size) (#33725) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 11:50:13 +08:00
Khoa PhamandClaude Opus 5 beabc5949b Enable MoE deferred finalize by default and drop its expert_weights dtype workaround (#33618) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-05 17:56:47 -07:00
Xiaoyu ZhangandClaude Fable 5 4c0a8940fa [Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-06 08:52:09 +08:00
Shu Wang 55b1c09e73 [core] Consolidate compiled-kernel caches under SGLANG_CACHE_DIR (#32434) 2026-08-05 13:54:27 -07:00
Xinyuan TongandZijie Xia b3cdd016ba Add Ling-3.0-flash cookbook (#33556) 
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
 2026-08-05 22:53:34 +08:00
Артем СавкинandXiaoyu Zhang d96df7bed5 [Diffusion] Batch GLM-Image AR requests (#30683) 
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-05 08:47:06 +03:00
Mohammad Miadh AngkadXinyuan TongDavid Orman
 		059269594c [DSV4] Add official DSV4 reasoning effort support (#33140) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: David Orman <ormandj@corenode.com>
 2026-08-05 12:50:41 +08:00
Baizhou Zhang 87ed82ff7e Remove custom all-reduce disable from Kimi-K3 B300 recipe (#33612) 2026-08-04 16:07:31 -07:00
+26
Liangsheng YinDarkSharpnessXiaoyu ZhangMickYuhao YangCheng WanKe BaoBaizhou ZhangChunan ZengKhoa PhamZiyi XuZijie XiaYuwei AnzhangxiaohaoYangmin LiJulien LinHao PhanThomas WangRolaoDenthupigeonsoupHaiShawXinyuan TongPranjal ShankhdharLee NauHMINGelvischenvByron HsuByron HsuClaude Opus 5Thomas WangXinyi SongMohammad Miadh AngkadCheng WanBBufHanming LuXinyi Song
 		abddb1c7e9 [Kimi] Support kimi-k3 (#32541) 
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Ziyi Xu <ziyi.xu@radixark.ai>
Co-authored-by: Zijie Xia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: zhangxiaohao <1024393531@qq.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: RolaoDenthu <xinyisong0111@gmail.com>
Co-authored-by: pigeonsoup <32922982+pigeonsoup@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
Co-authored-by: Lee Nau <lee.nau@gmail.com>
Co-authored-by: HMING <126185151+Hearum@users.noreply.github.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: BBuf <xiaoyu.zhang@radixark.ai>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
Co-authored-by: Xinyi Song <xinyis10@illinois.edu>
 2026-08-04 13:22:49 -07:00
Sugar920Claudesglang-npu-bot
 		e76d0acdc9 migrate NPU PR/nightly test cases to a3-560T (#33346) 
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-08-05 01:17:58 +08:00
Xiaoyu ZhangandClaude Fable 5 c6f2a9c1d4 [diffusion] Restrict request-level quality to two validated tiers: lossless (default) and high (#33453) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-04 11:43:16 +08:00
Jinchen HanandMick 614825fd38 [vla] fix: pi05 models does not apply scale factor for language embeddings (#33367) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-08-04 11:25:54 +08:00
zijiexiaandClaude Opus 4.8 b819d2fb5b [Docs] Rename docs_new/ to docs/ (#32123) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-08-03 16:51:00 -07:00
zijiexia 50ed4c011f Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964) 2026-07-13 15:06:08 -07:00
Liangsheng Yin 186f1e300a [CI] Move JIT kernel tests + benchmarks to test/registered/jit; add in-package guard (#27644) 2026-06-09 12:37:39 -07:00
Dawid Majchrowski c317beda99 [diffusion] model: support a new model (#24994) 2026-05-27 08:51:03 +08:00
roikoren755 e958f4561f [feat] Support extra_buffer in Mamba2-based models (#15829) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2026-05-26 16:03:29 +08:00
+2
kkwunhuangThomas WangXinyi SongHaiShawamd-danli103Lin, SogaRaiden-MakotoHubert Luyichiche@amd.comyctseng0211Bingxu Chen
 		3f5e2c7688 [AMD] Dsv4/pr2 compressor opt (#26208) 
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: amd-danli103 <danli103@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
Co-authored-by: yichiche@amd.com <jacky.cheng>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-05-25 23:54:40 -07:00
Ziang Li 2b9dd9c8b3 [FlashInfer v0.6.10] [RL] [DSv32] [GLM-5] Add --dsa-topk-backend and integrate FlashInfer and pytorch topk (#22851) 2026-05-25 13:08:03 -07:00
Xiaoyu Zhang 533ef41112 [Diffusion] Default NVFP4 backend to FlashInfer TRTLLM (#25523) 2026-05-25 18:14:06 +08:00
Zhanghengand晟海 a4db563c87 [hisparse]: update user guide (#26249) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
 2026-05-25 17:54:55 +08:00
Alex O. P. ae7c4226eb [diffusion] model: support FLUX.2-klein-base (#25661) 2026-05-22 11:24:46 +08:00
silencejade e603beab55 [NPU] Add Qwen3.5-397B-A17B best practice doc (#25594) 2026-05-21 10:02:12 +08:00
Cheng WanandClaude Sonnet 4.6 8131641bc6 [Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821) 
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
 2026-05-20 00:18:04 -07:00
Arseniy MironovandNapkin-AI 45a85efc3a [Diffusion][NPU]Add attention backends for diffusion models for Ascend NPU (#23482) 
Co-authored-by: Napkin-AI <arseniy.mironov.dev@gmail.com>
 2026-05-19 12:46:55 +03:00
Ziang Li 78cb38ed5e [FlashInfer v0.6.11] [RL] Support FlashInfer per-token NVFP4 MoE (#22918) 2026-05-19 01:04:48 -07:00
Артем Савкинgemini-code-assist[bot]Cheng Wan
 		a080358cac [Refactor] Refactor DeepEP dispatcher (#22822) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2026-05-18 04:36:42 +03:00
Mick 416fdbbb3d [diffusion] feat: generalize layerwise offload residency mixin to all components (#24593) 2026-05-16 11:44:46 +08:00
Lewisand百麒 0680f1b3d1 Add IntraNode NVLink configration in PD disaggregation docs (#23329) 
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
 2026-05-13 23:23:57 -07:00