minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
13,583 Commits 2 Branches 0 Tags
bba8de8cb48b4bcf1306293147585bb8585599b0
Commit Graph
204 Commits
Author SHA1 Message Date
sglang-botandsglang-bot bba8de8cb4 docs: sync LMSYS SGLang blog cards (#27322) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-06-04 17:42:09 -07:00
Brayden ZhongMartin VitClaude Opus 4.7Brayden Zhong
 		e76d36214b Changes for SM120 perf and usability for NVFP4 (#26496) 
Co-authored-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
 2026-06-04 15:29:25 -07:00
Faradawn Yangandzijiexia 0e4aa081ba Add --enable-symm-mem for Qwen3.5 (#27296) 
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
 2026-06-04 15:23:37 -07:00
Ziang Li 4cfebbb95f [FlashInfer v0.6.12] Support FlashInfer 4over6 NVFP4 (#25239) 2026-06-04 14:35:07 -07:00
Douglas YangandClaude Opus 4.8 75be922451 docs(cookbook): add Docker install option for Gemma 4 (#27287) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-04 12:45:32 -07:00
Jinyan ChenandJinyan Chen 10b6b45cad docs: add DeepSeek V4 FP4 indexer usage (#27035) 
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
 2026-06-04 00:44:21 -07:00
zijiexia b89686710d [Docs] re-organize nemotron cookbook (#27240) 2026-06-04 00:40:13 -07:00
Zhenghang (Max) XuClaude Opus 4.7Baizhou ZhangJiajun Li
 		1463e5fbdd docs: add Nemotron 3 Ultra cookbook entry (#26969) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Jiajun Li <48857426+guapisolo@users.noreply.github.com>
 2026-06-04 00:14:19 -07:00
Mick 5dbc52c2b7 [diffusion] doc: add ernie Image diffusion (#27195) 2026-06-04 08:45:56 +08:00
Yihao Wang 8980eb82de [Docs] Update Nemotron3-Nano-Omni cookbook to reflect new model paths (#25198) 2026-06-03 14:55:30 -07:00
Jiajun Liandzijiexia 90985117a5 docs: fix Nemotron Super MTP deployment command (spec-v2 + B200) (#27184) 
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
 2026-06-03 14:52:47 -07:00
fxmarty-amdBowen BaoColin Zeng
 		293816ab14 [AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005) 
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Colin Zeng <Colin.Zeng@amd.com>
 2026-06-03 12:55:24 -07:00
Xinyuan Tong 45a66f4088 [Docs] Update unified Text/Vision/Audio model cookbook: install + sgl-eval accuracy (#27171) 2026-06-03 09:32:08 -07:00
Xinyuan Tong fa5c8a3101 [model] support encoder-free unified Text/Vision/Audio model (#27167) 2026-06-03 23:58:06 +08:00
Feng SuMu HuaiShangming Cai
 		e67810bea7 [SGLang Tracing] Add pd disaggregation mooncake backend tracing (#23755) 
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-06-03 16:43:29 +08:00
xutizhou ac16dbf412 docs: add DeepSeek-V4 EPLB Waterfill tips (#27049) 2026-06-03 00:37:45 -07:00
Shaun Kotek b8d7351a74 Feat/add w4a16 moe support to nemotron (#25655) 2026-06-02 22:42:26 -07:00
Mick 2d8cb87de7 docs: tag new diffusion cookbooks (#27094) 2026-06-03 09:50:27 +08:00
MingxuZh b678448b8a ci(xeon): merge 2 partitions into 1 job to reduce runner contention (#26904) 2026-06-03 09:46:27 +08:00
littleyellowbicycle 7271318dc3 【docs】The remote weight download function has been adjusted to be unsupported until the PTA interface is fixed. (#27050) 2026-06-02 20:55:23 +08:00
Mick a6985e1be0 [diffusion] doc: add cookbook for lingbot-world (#26958) 2026-06-02 14:35:22 +08:00
Kurkur f27fa0da93 [NPU][Docs] Kimi-K2.5 best practice (#26774) 2026-06-02 13:14:14 +08:00
ThanhhaoHao PhanZijie XiaClaude Opus 4.8
 		1c0019da75 [Docs] GLM-4.7 cookbook: add NVIDIA Blackwell (B200, GB200) + NVFP4 sections (#26384) 
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-01 20:47:51 -07:00
Teng MaandZijie Xia b562da0d9f [PD] docs: clarify disaggregation IB device formats (#25521) 
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
 2026-06-02 11:38:33 +08:00
Prabhu Prakash KagithaClaude Sonnet 4.6zijiexiaZijie Xia
 		98a1b58c47 docs(cookbook): port popular model usage guides into cookbook pages (#25813) 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
 2026-06-01 17:41:49 -07:00
Baizhou Zhang 2fdae94e46 docs: update RTX PRO 6000 deployment snippet (#26968) 2026-06-01 14:34:27 -07:00
eeechoandClaude Opus 4.6 524ba10eda feat: SM120 (Blackwell Desktop) support for DeepSeek-V4 inference (#24692) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-06-01 14:05:20 -07:00
shuwennClaude Opus 4.7Jarrod Barnes
 		a0670b5ba3 [SPEC] feat: add adaptive speculative decoding metrics (#25940) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Jarrod Barnes <jbarnes850@gmail.com>
 2026-06-01 13:53:30 -07:00
Shu Wangandzijiexia 106092123f Update Qwen3-Coder docs_new NVIDIA guidance (#24435) 
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
 2026-06-01 13:38:34 -07:00
Mick 1988a2c9ea [diffusion] feat: improve cosmos3 serve API support (#26926) 2026-06-02 00:53:39 +08:00
Lukas HumbelandClaude Opus 4.7 d8a5a25c36 Refactor NIXL hicache. Add O_DIRECT support (#25173) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-06-01 17:28:53 +02:00
amote-i d078cb72bd [NPU] [DOC] clarify Ascend NPU exclusive supported values for speculative args (#26903) 2026-06-01 16:40:11 +08:00
shadowxz109 4d20dc44fc 【NPU】add MiniMax2.5 best practice docs (#26725) 2026-06-01 10:09:12 +08:00
Haichuan Hu acd689b407 feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667) 
Signed-off-by: Haichuan Hu <kaisennhu@gmail.com>
 2026-05-30 02:19:50 -07:00
silencejade 23a825c694 [DOC] [NPU] add qwen3.5-397b best practice to doc_new (#26709) 2026-05-30 14:20:24 +08:00
Chao Shi 6ce49e5f4c [Utils] Support configure log level at runtime (#26583) 2026-05-29 14:49:06 -07:00
zijiexiaClaude Opus 4.7gemini-code-assist[bot]
 		7fb7b41a3e [docs] Qwen3.5 cookbook: multi-node, MTP TP overrides, dense mamba flag (#26695) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-29 12:10:14 -07:00
Aditya SharmaandXiaodong Ye b2eed9e16d [Apple Silicon] Add custom Metal RoPE kernel with fused KV cache store (#22868) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2026-05-29 15:09:33 +08:00
Baizhou Zhang 69362cbc2c [Doc] Update benchmark instruction for dsv4 (#26668) 2026-05-28 23:37:35 -07:00
Xu Zouxz-kegxuzou
 		40f91e6697 [Bugfix] [DSA] [Hisparse] Broadcast TP Rank 0 Topk Indexes to other TPs (#24654) 
Co-authored-by: xz-keg <xuzou_keg@outlook.com>
Co-authored-by: xuzou <xu.zou@aminer.cn>
 2026-05-28 21:14:46 -07:00
Yuhao Yang a8cfae0b30 doc: update step-3.7-flash docker image tag (#26625) 2026-05-29 08:40:17 +08:00
Yuhao Yangyhyang201luotingdan
 		3bdea78ad1 model: support Step-3.7-Flash (#26565) 
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>
 2026-05-29 08:00:54 +08:00
Jimmy Shong f838adb7d4 bench_serving: add Zipfian shared-prefix sampling to generated-shared-prefix (#26378) 2026-05-28 14:39:46 -07:00
Jonathan MamouzijiexiaKhoa Pham
 		97d129f8c6 # feat(bench): add SPEED-Bench dataset support to bench_serving (#24149) 
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
 2026-05-28 14:37:00 -07:00
Brayden Zhongandb8zhong 50e0b3b77f Support Flashinfer Cute-DSL MLA attention (#24737) 
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
 2026-05-28 00:21:32 -07:00
Brayden Zhong 97dd6aad60 Add a little env var for disabling Flashinfer autotune cache (#26193) 2026-05-27 23:59:59 -07:00
Shaoting 14c1bb2721 [Feat][LMCache] Support LMCache mp mode (#24089) 
Signed-off-by: Shaoting-Feng <stfeng@uw.edu>
 2026-05-28 10:15:09 +08:00
Qiaolin Yu 561e54f803 Update kimi k25 launch command in cookbook (#26511) 2026-05-27 16:04:04 -07:00
loading66 a1ebc4917a [NPU][DOCS]Add faq and feature Compatibilit (#26464) 2026-05-27 17:48:47 +08:00
Baizhou ZhangandClaude Opus 4.7 d6032c04b6 [docs] Fix V4 Pro balanced recipe (#26451) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-26 23:50:26 -07:00