minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 15 Packages Projects Releases Wiki Activity
14,325 Commits 3 Branches 0 Tags
db12bfcdc8a686efc8ee0a2899bdb43be9cedcf8
Commit Graph
43 Commits
Author SHA1 Message Date
Oguz Ulgen 3af991fb3e [AMD] Make breakable CUDA graph run on ROCm/HIP (#28173) 2026-06-19 07:16:00 -07:00
Junlin Wuandronnie_zheng 2a8ea70059 ✨ [llm][npu][quant] Add W8A8 MXFP8 quantization support for Qwen3 Dense on Ascend NPU (#22352) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-06-16 09:45:18 +03:00
McZyWu 8bdb007e58 [NPU] Docs op performance optimize (#28277) 2026-06-15 20:28:18 +08:00
Lianmin Zheng f18d38d040 Revert "[AMD][Quantization] Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs" (#28213) 2026-06-14 13:34:06 -07:00
Mohammad Miadh Angkad 91c63aeb4d Fix stale CUDA graph benchmark and docs refs (#28041) 2026-06-13 21:51:42 -07:00
fxmarty-amdBowen BaoHAI
 		3f4a338212 [AMD][Quantization] Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs (#18182) 
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
 2026-06-13 16:08:19 -07:00
IBRAHIM IBRAHIMandClaude Opus 4.8 45f8d48994 docs: add llm-d page under Advanced Features (#28078) 
Signed-off-by: IBRAHIM IBRAHIM <66755652+Ibrahim2595@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-12 18:40:31 -07:00
Yuwei AnandClaude Fable 5 6c3e429ba1 [Tiny] Cuda Graph Refactor Code Style Follow up (#28107) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-06-12 18:38:13 -07:00
Liangsheng Yin c0480a88be [Spec] Retire Spec V1 (#27964) 2026-06-11 16:15:15 -07:00
Baizhou Zhang 3c1b0fb226 [1/n] [CP] Simplify prefill context parallel server args (#27312) 2026-06-10 14:11:38 -07:00
Ziang Li 01f10acd06 Implement online nvfp4 quantization (#26083) 2026-06-10 00:26:51 -07:00
Yuwei AnBBufCheng WanLianmin Zheng
 		2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906) 
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2026-06-09 21:36:57 -07:00
EduardDurech e9dbbd19e9 [model] Apertus Tool/Function and Reasoning parser (#25100) 2026-06-06 00:04:31 -07:00
maoyuhan坤钧alphabetc1EanWang211123shuwennshuwenn
 		6b180959a8 [SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055) 
Co-authored-by: 坤钧 <maoyuhan.myh@antgroup.co>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
Co-authored-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: shuwenn <2508695655@qq.com>
 2026-06-05 15:43:02 -07:00
zijiexiaandClaude Opus 4.8 c6c1f1a29a docs: sync legacy docs/-only updates into docs_new (Mintlify) (#27308) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-04 19:45:13 -07:00
Brayden ZhongMartin VitClaude Opus 4.7Brayden Zhong
 		e76d36214b Changes for SM120 perf and usability for NVFP4 (#26496) 
Co-authored-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
 2026-06-04 15:29:25 -07:00
Jinyan ChenandJinyan Chen 10b6b45cad docs: add DeepSeek V4 FP4 indexer usage (#27035) 
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
 2026-06-04 00:44:21 -07:00
fxmarty-amdBowen BaoColin Zeng
 		293816ab14 [AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005) 
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Colin Zeng <Colin.Zeng@amd.com>
 2026-06-03 12:55:24 -07:00
Feng SuMu HuaiShangming Cai
 		e67810bea7 [SGLang Tracing] Add pd disaggregation mooncake backend tracing (#23755) 
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-06-03 16:43:29 +08:00
Shaun Kotek b8d7351a74 Feat/add w4a16 moe support to nemotron (#25655) 2026-06-02 22:42:26 -07:00
Teng MaandZijie Xia b562da0d9f [PD] docs: clarify disaggregation IB device formats (#25521) 
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
 2026-06-02 11:38:33 +08:00
Prabhu Prakash KagithaClaude Sonnet 4.6zijiexiaZijie Xia
 		98a1b58c47 docs(cookbook): port popular model usage guides into cookbook pages (#25813) 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
 2026-06-01 17:41:49 -07:00
Chao Shi 6ce49e5f4c [Utils] Support configure log level at runtime (#26583) 2026-05-29 14:49:06 -07:00
Brayden Zhongandb8zhong 50e0b3b77f Support Flashinfer Cute-DSL MLA attention (#24737) 
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
 2026-05-28 00:21:32 -07:00
Shaoting 14c1bb2721 [Feat][LMCache] Support LMCache mp mode (#24089) 
Signed-off-by: Shaoting-Feng <stfeng@uw.edu>
 2026-05-28 10:15:09 +08:00
Ziang Li 2b9dd9c8b3 [FlashInfer v0.6.10] [RL] [DSv32] [GLM-5] Add --dsa-topk-backend and integrate FlashInfer and pytorch topk (#22851) 2026-05-25 13:08:03 -07:00
Zhanghengand晟海 a4db563c87 [hisparse]: update user guide (#26249) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
 2026-05-25 17:54:55 +08:00
Cheng WanandClaude Sonnet 4.6 8131641bc6 [Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821) 
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
 2026-05-20 00:18:04 -07:00
Артем Савкинgemini-code-assist[bot]Cheng Wan
 		a080358cac [Refactor] Refactor DeepEP dispatcher (#22822) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2026-05-18 04:36:42 +03:00
Zheng Luo 435ea41cf0 Delegate ModelExpress loading to package (#24723) 
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
 2026-05-16 11:16:44 -07:00
Lewisand百麒 0680f1b3d1 Add IntraNode NVLink configration in PD disaggregation docs (#23329) 
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
 2026-05-13 23:23:57 -07:00
shuwenn 5495026a3b [HiCache] feat: default storage prefetch timeout (#23309) 2026-05-11 18:49:35 -07:00
egvenediktov 2473659e76 [NPU]Documentation update for communications quantization feature (#24668) 2026-05-10 23:49:21 +03:00
Brayden Zhongandb8zhong 8f33bee31b Reland Cute-DSL FP4 dense GEMM (#23590) 
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
 2026-05-09 02:20:58 -07:00
Revanth Reddy Airre be088f8076 fix(router): configure HTTP client connection settings (#24330) 
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
 2026-05-07 11:42:45 -07:00
Revanth Reddy Airre d363315de9 fix(router): make HTTP pool idle timeout configurable (#24329) 
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
 2026-05-06 22:11:11 -07:00
Glen Liu 76b9c8de6f [Feature] add LoRADrainer to address high P99 TTFT (#17913) 2026-05-02 16:13:43 -07:00
AlonKejzman 66ea0aee7f tokenizer: Add fastokens support (#23753) 2026-04-28 11:43:10 -07:00
1874. 47b8eadbc4 [Docs] Update Ascend NPU GGUF quantization documentation (#23845) 2026-04-27 17:30:24 +03:00
zijiexia c74b345e3a [docs] Update FA4 support SWA (#23793) 2026-04-26 20:40:36 -07:00
shuwenn f30a6f4d7e [DOC] Add DFLASH speculative decoding documentation (#23553) 2026-04-24 17:18:46 -07:00
zijiexiaandMingyi 900aad5f72 [Docs] Sync docs_new with legacy docs and update migration redirects (#23337) 
Co-authored-by: Mingyi <wisclmy0611@gmail.com>
 2026-04-21 00:15:17 -07:00
+15
MingyiAdityaVKocharmintlify[bot]adhyan-jainAdhyan JainMaitri-shah29Adarsh ShirawalmathMaitri ShahAditya Vardhan KocharRishit ShivamRishitshivamIshhanKheriaIshita JoshiRichard ChenlongGGGGGGRichardNakul SinhaDivyam AgrawalRichardczl98Krishang ZinzuwadianimeshasClaude Opus 4.6github-actions[bot]Jignas Paturuzijiexia
 		a3291b5654 Add new Mintlify documentation site (docs_new/) (#23001) 
Co-authored-by: AdityaVKochar <adityavardhankochar@gmail.com>
Co-authored-by: mintlify[bot] <109931778+mintlify[bot]@users.noreply.github.com>
Co-authored-by: adhyan-jain <adhyanjain2006@gmail.com>
Co-authored-by: Adhyan Jain <71976554+adhyan-jain@users.noreply.github.com>
Co-authored-by: Maitri-shah29 <maitrirajivshah@gmail.com>
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
Co-authored-by: Maitri Shah <shah29maitri@gmail.com>
Co-authored-by: Aditya Vardhan Kochar <80113212+AdityaVKochar@users.noreply.github.com>
Co-authored-by: Rishit Shivam <164783543+pokymono@users.noreply.github.com>
Co-authored-by: Rishitshivam <164783543+Rishitshivam@users.noreply.github.com>
Co-authored-by: IshhanKheria <ishhankheria06@gmail.com>
Co-authored-by: Ishita Joshi <ishitata.joshi@gmail.com>
Co-authored-by: Richard Chen <104477092+Richardczl98@users.noreply.github.com>
Co-authored-by: longGGGGGG <553746008@qq.com>
Co-authored-by: Richard <richardchen@radixark.ai>
Co-authored-by: Nakul Sinha <nakul.new4socials@gmail.com>
Co-authored-by: Divyam Agrawal <ludicrouslytrue@gmail.com>
Co-authored-by: Richardczl98 <Zhenlinc@stanford.edu>
Co-authored-by: Krishang Zinzuwadia <krishangzinzuwadia@gmail.com>
Co-authored-by: nimeshas <nimesha.s106@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jignas Paturu <86356085+JignasP@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
 2026-04-20 15:10:22 -07:00