minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,832 Commits 2 Branches 0 Tags
efa71ce5ab2a2fd669d09c7fd166967c3b442e41
Commit Graph
11832 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
huangtingweihzh0425flyerming
 		efa71ce5ab [HiCache]Fix hybrid model move_indices (#22940) 
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: flyerming <flyerming@163.com>
 2026-04-21 00:15:39 -07:00
zijiexiaandMingyi 900aad5f72 [Docs] Sync docs_new with legacy docs and update migration redirects (#23337) 
Co-authored-by: Mingyi <wisclmy0611@gmail.com>
 2026-04-21 00:15:17 -07:00
Xinyuan TongClaude Opus 4.7Ma Mingfei
 		f63def8510 [XPU] Fix DeepSeek-OCR tests under transformers 5.x (#23044) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-04-21 14:57:56 +08:00
kkwunhuangHaiShawLzy17
 		c122d343ad [ROCm] Uniform docker to support AMD AINIC, BRCM Thor2 IBGDA NIC for MoRI-EP (#23263) 
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Lzy17 <36555117+Lzy17@users.noreply.github.com>
 2026-04-20 23:39:19 -07:00
jianan-gu 2cf3ac515b [Diffusion][CPU] Init CPU platform support for SGLang Diffusion (#20816) 2026-04-21 14:25:54 +08:00
Liangsheng Yin 2b2cad70d6 [Refactor] Move radix-cache utils onto RadixKey as methods (#23209) 2026-04-20 23:11:58 -07:00
Liangsheng YinianliuyWen-xuan-Xu
 		a490632416 Opt-in strip of thinking tokens from radix cache (#23315) 
Co-authored-by: ianliuy <ianl@alumni.usc.edu>
Co-authored-by: Wen-xuan-Xu <lilmeep727@gmail.com>
 2026-04-20 22:59:50 -07:00
jsheng_LinkedinChanh NguyenSundara Raman Ramachandran
 		a8e3a534a4 [Score API] Add Multi-Item Scoring with pre-computed delimiter indices (#22544) 
Co-authored-by: Chanh Nguyen <chanhnguyen@gmail.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
 2026-04-20 22:50:40 -07:00
Divyam Agrawal cfd49e233c Fix formatting for ACM-VIT in README acknowledgements section (#23325) 2026-04-20 22:28:45 -07:00
jsheng_Linkedin 6d47dc8f6d [CI][MLA] Enable deterministic inference for MGSM MLA FP8 test (#23303) 2026-04-20 22:26:26 -07:00
Shangming Cai a58c7f381e [PD] Fix clip logic when state indices lens are mismatch (#23323) 2026-04-21 13:22:20 +08:00
Yuhao Yang 5595f6e988 Fix trtllm mla chunked-prefill zero-length bug (#22291) (#22688) 2026-04-20 22:10:13 -07:00
Mingyi 82beaf1748 Docs/url redirect (#23312) 2026-04-20 21:26:18 -07:00
Liangsheng Yin 6cc2eee50d [misc] CI hygiene: enforce __main__ entry, drop silent-skipped tests, fix rerun-test protoc (#23305) 2026-04-20 21:16:24 -07:00
Alison Shao 6b19e8a452 ci: reduce scheduled PR test from 4x to 3x daily (#23313) 2026-04-20 20:53:13 -07:00
amote-i 301604f953 [NPU] [DOC] Quick start doc for Ascend NPU (#23238) 2026-04-21 11:19:09 +08:00
Lewisand百麒 0d0405273b [Fix] Solve the error lead by _commit_transfer_to_req() when using IntraNode NVLink in PD disaggregation (#23252) 
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
 2026-04-21 11:02:18 +08:00
Ke Bao 50fc2c9e23 Fix hybrid swa chunked prefill oom (#23174) 2026-04-21 10:46:45 +08:00
Zhangheng ab3ce02de9 [Hybrid-Cache]: Refactor hybrid_pool_assembler.py (#23243) 2026-04-21 10:45:23 +08:00
ishandhananiandjthomson04 3c007ee5d4 fix(hicache): emit KV events for L2 host cache insertions (#22894) 
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
 2026-04-20 19:07:03 -07:00
ChangLiu0709 ac08ebed65 [AMD] Resolve Qwen3.5 MTP (speculative decoding) radix cache conflict. (#22908) 2026-04-20 18:17:11 -07:00
Liangsheng Yin c7a4ebf3c8 [Refactor] Replace page_align_keys helper with RadixKey.page_aligned method (#23107) 2026-04-20 18:10:42 -07:00
Mingyi 712b01d875 Update CODEOWNERS to include new documentation paths for docs and doc… (#23293) 2026-04-20 16:48:41 -07:00
Tarushii Goel 3e367f9bcd [sgl] fix incorrect behavior in cuda graph draft extend (#22832) 2026-04-20 16:29:16 -07:00
Tarushii Goel 100b0f86dd [sgl] add support for weight update function in spedec (#22088) 2026-04-20 16:26:20 -07:00
Tarushii Goel 28f3a2d8ed [sgl] multilayereagleworkerv2 fix (#22954) 2026-04-20 16:22:16 -07:00
Thomas Wang 57ecce9807 [AMD] Enable MTP for GLM-5-mxfp4 model (#23219) 2026-04-20 16:09:07 -07:00
+15
MingyiAdityaVKocharmintlify[bot]adhyan-jainAdhyan JainMaitri-shah29Adarsh ShirawalmathMaitri ShahAditya Vardhan KocharRishit ShivamRishitshivamIshhanKheriaIshita JoshiRichard ChenlongGGGGGGRichardNakul SinhaDivyam AgrawalRichardczl98Krishang ZinzuwadianimeshasClaude Opus 4.6github-actions[bot]Jignas Paturuzijiexia
 		a3291b5654 Add new Mintlify documentation site (docs_new/) (#23001) 
Co-authored-by: AdityaVKochar <adityavardhankochar@gmail.com>
Co-authored-by: mintlify[bot] <109931778+mintlify[bot]@users.noreply.github.com>
Co-authored-by: adhyan-jain <adhyanjain2006@gmail.com>
Co-authored-by: Adhyan Jain <71976554+adhyan-jain@users.noreply.github.com>
Co-authored-by: Maitri-shah29 <maitrirajivshah@gmail.com>
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
Co-authored-by: Maitri Shah <shah29maitri@gmail.com>
Co-authored-by: Aditya Vardhan Kochar <80113212+AdityaVKochar@users.noreply.github.com>
Co-authored-by: Rishit Shivam <164783543+pokymono@users.noreply.github.com>
Co-authored-by: Rishitshivam <164783543+Rishitshivam@users.noreply.github.com>
Co-authored-by: IshhanKheria <ishhankheria06@gmail.com>
Co-authored-by: Ishita Joshi <ishitata.joshi@gmail.com>
Co-authored-by: Richard Chen <104477092+Richardczl98@users.noreply.github.com>
Co-authored-by: longGGGGGG <553746008@qq.com>
Co-authored-by: Richard <richardchen@radixark.ai>
Co-authored-by: Nakul Sinha <nakul.new4socials@gmail.com>
Co-authored-by: Divyam Agrawal <ludicrouslytrue@gmail.com>
Co-authored-by: Richardczl98 <Zhenlinc@stanford.edu>
Co-authored-by: Krishang Zinzuwadia <krishangzinzuwadia@gmail.com>
Co-authored-by: nimeshas <nimesha.s106@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jignas Paturu <86356085+JignasP@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
 2026-04-20 15:10:22 -07:00
jsheng_Linkedin 575fdc2c4c [CI][LoRA] Drop flaky all-None batch from multi-LoRA parity test (#23287) 2026-04-20 14:43:25 -07:00
shuwennandQiaolin-Yu b65799cf83 [SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599) 
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
 2026-04-20 14:25:04 -07:00
shuwenn dbcf7459b5 fix: reset empty prefill batch fullness (#23138) 2026-04-20 14:14:00 -07:00
mispa-msandClaude Opus 4.7 d8d9d32b29 [docker] Fix stray backslash dropping sgl-model-gateway COPY (#23097) 
Signed-off-by: misunp <misunp@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-20 13:44:05 -07:00
ishandhanani 6f6843c582 [Docker] Move Rust toolchain install to torch_deps stage (#23278) 2026-04-20 13:13:10 -07:00
Yuhao YangClaude Opus 4.6Kangyan-Zhou
 		fe9b9b254b Fix segfault in cudaMemcpyBatchAsync on CUDA 13.0 (#23136) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-04-20 12:20:22 -07:00
Liangsheng Yin 8cb957ccff [Perf] Make EAGLE bigram key an O(1) view on RadixKey (#23106) 2026-04-20 12:01:11 -07:00
ShunkangzandShunkang 3dc1491c95 Support moe_dp_size = 1 for various attention_cp_size (#22003) 
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
 2026-04-20 11:58:19 -07:00
ishandhananiandClaude Opus 4.7 90d527195b [CI] Fix nightly docker builds failing on root-owned workspace leftovers (#23279) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-20 11:56:33 -07:00
Lee Nau b4bb036b73 fix legacy deepep path for flashinfer_cutedsl (#22925) 2026-04-20 11:49:33 -07:00
Kangyan-ZhouandClaude Opus 4.7 4698f4cd10 [CI] Fix wait-for-jobs hanging when matrix job skipped at job level (#23277) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-20 11:16:10 -07:00
ishandhanani b5d9a86e4c fix: add back priorty as radix cache policy (#23275) 2026-04-20 10:04:35 -07:00
Alex Nails 332ec5e5ee [release] install rust toolchain in main dockerfile (#23014) 2026-04-20 09:50:08 -07:00
Makcum888eandronnie_zheng 39c720d1b9 [Diffusion][NPU][CI] update perf numbers (#23056) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-04-20 19:34:11 +03:00
Mick 9a0fd2ff0c [diffusion] optimize: default to in-memory loading for URL/base64 image inputs (#23118) 2026-04-20 23:29:02 +08:00
Mick 0be6ab04dd [diffusion] refactor: LTX2.3 code cleanup (#23207) 2026-04-20 19:02:05 +08:00
YC Yen-Ching Tseng da62e90904 [AMD] Fix multimodal timeout issue : rocm7.2 PR Test (#23247) 2026-04-20 18:36:08 +08:00
YC Yen-Ching Tsengandbingxche cf4b84f839 [AMD] Update AMD workflow name (#23245) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-20 18:18:24 +08:00
Vladislav Nosivskoy 4028a73c10 [KV-Events] Fix kv events events publishing for CP (#22983) 
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
 2026-04-20 17:34:38 +08:00
Alex NailsandClaude Opus 4.7 bea4c895c1 [gRPC] Pass --experimental_allow_proto3_optional to protoc in build.rs (#23226) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-20 17:20:14 +08:00
Bingxu ChenHAIgemini-code-assist[bot]
 		69eb95f20c [AMD] Pin peft<0.19 in pyproject_other.toml to fix ROCm CI ImportError (#23161) 
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-19 23:43:56 -07:00
Liangsheng Yin a2d30d27fe wait for reap in kill_process_tree (#23213) 2026-04-19 23:36:33 -07:00