minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,782 Commits 2 Branches 0 Tags
ab936ce6946df053239f370d41e973100a980a4b
Commit Graph
11782 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Bingxu Chen ab936ce694 Revert "perf: optimize PCG inductor path for FP8 models (#21734)" (#23159) 
Feel free to PR again.
 2026-04-19 23:32:50 -07:00
Kangyan-ZhouandClaude Opus 4.7 97baf17557 Fix test_modelopt_export using stale ModelConfig kwargs (#23214) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-19 23:18:09 -07:00
Kangyan-ZhouandClaude Opus 4.7 1ebe1c57ed [CI] Partition stage-a-test-cpu into 4 matrix shards (#23208) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-19 22:07:37 -07:00
Alex Nails 10e17cc55e [gRPC] Native gRPC server: proto + Rust crate scaffold + server args (#22736) 2026-04-20 12:39:35 +08:00
Baizhou ZhangandClaude Opus 4.6 c304d0d64d [Refactor] Deduplicate NSA utils.py into cp_utils.py for context parallel (#22914) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-19 21:35:35 -07:00
Liangsheng Yin eb76aaba88 [core] Always-on StreamingSession in UnifiedRadixCache (#23202) 2026-04-19 21:19:43 -07:00
ShunkangzandShunkang e389a52cc8 Support allreduce fusion with cp (#21249) 
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
 2026-04-19 21:06:00 -07:00
Liangsheng Yin a7276b623e integrate streaming session into UnifiedRadixCache (#23145) 2026-04-19 20:47:41 -07:00
Kangyan-ZhouandClaude Opus 4.7 1d252803f5 fix(ci): repair path filters regressed by #21482 (#23201) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-19 20:34:57 -07:00
Thomasandronnie_zheng 3063d640dd [CI] Exclude diffusion-specific paths from main_package filter (#23053) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-04-20 10:43:44 +08:00
Byron HsuByron HsuCheng Wan
 		1cff871c67 [Bugfix] Fix DeepEP timeout when compiling DeepGeMM in EP+DP+TP (#23185) 
Co-authored-by: Byron Hsu <byronhsu@Byrons-MacBook-Pro.local>
Co-authored-by: Cheng Wan <ch-wan@users.noreply.github.com>
 2026-04-19 17:36:11 -07:00
Liangsheng Yin d3ce664612 move session to python/sglang/srt/session (#23144) 2026-04-19 17:34:19 -07:00
Baidu-AIAKrootAlex NailsAlex NailsrootMick
 		7ca3566130 Multi platform Plugin (#21388) 
Co-authored-by: root <root@tjzj-inf-sci-k8s-bzz2-0183.tjzj.baidu.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Alex Nails <alexj.nails@gmail.com>
Co-authored-by: root <root@tjzj-inf-sci-k8s-bzz2-0000.tjzj.baidu.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-04-19 17:23:51 -07:00
Cheng WanandClaude Opus 4.7 ebcc2b3eec ci: run weekly est_time update on Monday using p90 of last 15 runs (#23120) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-19 14:39:27 -07:00
inkcherry 4fa3482180 [Bugfix] Add missing http_worker_ipc in session error path (#22766) 2026-04-19 12:47:09 -07:00
billishyahao b74a9dd854 [AMD] fix tbo runtime error when initializing metadata for cuda graph (#22598) 2026-04-19 12:42:48 -07:00
YC Yen-Ching Tseng 32b7777f6c [AMD]Fix AMD multimodal-gen-test-2-gpu timeout by adding partition for standalone test (#23130) 2026-04-19 23:16:18 +08:00
Baizhou ZhangKangyan ZhouClaude Opus 4.7Alison ShaoMick
 		6ecd6f84db [CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-04-19 05:32:36 -07:00
Thomas Wang 03828f4205 [AMD] Reduce NSA indexer kernels (weights_proj, k-cache store kernel fusion) (#22850) 2026-04-19 00:18:11 -07:00
Kehan Li 2a327f0877 Fix Qwen3.5 video processing when passing video_data in "processor_output" format (#22431) 2026-04-19 00:04:01 +08:00
Xiaoyu Zhang cd6ad80c00 diffusion: add HunyuanVideo GroupNorm+SiLU fast path (#22814) 2026-04-18 23:38:49 +08:00
Xiaoyu Zhang c6a45fab64 Qwen3next flashinfer allreduce auto enable (#22664) 2026-04-18 22:32:41 +08:00
Yisheng Gong 4839cecbb0 [main] chore: add bias for base layer with lora (#22169) 2026-04-18 02:07:02 -07:00
amote-i ea20f1baa4 [NPU] [DOC] Update npu best practice docs to match latest code (#23077) 2026-04-18 14:17:00 +08:00
Mick 0d94c3366a [diffusion] feat: introduce ltx-2-two-stage device manager (#22869) 2026-04-18 11:04:33 +08:00
Xiaoyu Zhang 615d6c93b2 [codex] Add flashinfer TRTLLM backend for diffusion NVFP4 (#22717) 2026-04-18 09:06:28 +08:00
Lianmin Zheng 9c47bbad13 Clean up bench_one_batch warning and simplify norm dispatch (#23110) 2026-04-17 17:42:20 -07:00
Cheng WanandClaude Opus 4.7 5f7aee726a refactor(moe): de-duplicate triton MoE runner path into shared helpers (#23019) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-17 17:05:13 -07:00
Yanbin Jiang fd7db0eace Update CI_PERMISSIONS (#23108) 2026-04-17 16:53:03 -07:00
R0CKSTAR 26ae7b8bd7 [MLX] Support radix cache (#21509) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2026-04-18 07:00:50 +08:00
Liangsheng Yin 09b689b407 Apply HF transformers patches from sglang init (#23103) 2026-04-17 15:37:51 -07:00
Liangsheng Yin 573e12a7fc Merge /get_load into /v1/loads (#23010) 2026-04-17 13:36:51 -07:00
Lianmin Zheng 44e67c6835 Remove deprecated double sparsity feature (#23009) 2026-04-17 13:33:12 -07:00
Liangsheng Yin 3df35ecc80 Lower TestPiecewiseCudaGraphQwen25VL gsm8k threshold to 0.80 (#23099) 2026-04-17 13:31:10 -07:00
andyluo7andAndy Luo 9df6107dca [AMD] Enable DFLASH speculative decoding on ROCm (#22342) 
Signed-off-by: Andy Luo <andyluo7@users.noreply.github.com>
Co-authored-by: Andy Luo <andyluo7@users.noreply.github.com>
 2026-04-17 13:10:14 -07:00
shuwennandZhangheng 90c76d665e [HiCache] fix: HiCacheFile component key suffixing (#22891) 
Co-authored-by: Zhangheng <hzh0425@apache.org>
 2026-04-17 13:06:28 -07:00
YC Yen-Ching Tseng 5d4e899477 [AMD] Fix AMD Multimodal Test - skip nvfp4 tests (#23045) 2026-04-17 09:02:39 -07:00
Jincong Chen 2bac219d0c [Perf] Precompute gemma_weight to avoid redundant add on every forward (#22673) 2026-04-17 23:37:41 +08:00
Xiaoyu Zhang 83c5119d01 [diffusion] CI: fix ModelOpt B200 CI artifact coverage (#22955) 2026-04-17 23:33:42 +08:00
Mick 5de89ea942 [diffusion] CI: fix auto-partition (#23076) 2026-04-17 22:37:24 +08:00
YC Yen-Ching Tsengandbingxche f399997d2f [AMD] mirror nightly images to local registry and prefer LAN pulls (#23073) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-17 19:49:26 +08:00
YC Yen-Ching Tsengandbingxche 8c13295842 [AMD] fix AMD CI gate (#22974) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-17 18:32:26 +08:00
Opher Lieber 6e3bbef568 expose num_embeddings in VocabParallelEmbeddingWithLoRA (#22547) 2026-04-17 02:35:13 -07:00
CYYYC0310andcyy a12ea979d4 [test] Add GSM8K accuracy test for PP with mixed chunk prefill (#23029) 
Co-authored-by: cyy <cy02433585@alibaba-inc.com>
 2026-04-17 17:09:53 +08:00
ybyang 271c177443 [NPU]chore(docker): use editable install for sglang in npu.Dockerfile (#23040) 2026-04-17 17:08:39 +08:00
Mick 0b2058853d [diffusion] doc: update doc (#23052) 2026-04-17 16:23:46 +08:00
Jonah Bernard 0d031335ed [Pipeline Parallelism][Bug] Fix scheduler hang in pipeline parallelism setup (#23006) 2026-04-17 14:50:47 +08:00
Duyi-Wang 8c190f6b91 [AMD] Add SGLANG_MORI_MOE_MAX_INPUT_TOKENS to truncate dispatch before MoE. (#22952) 2026-04-16 23:40:15 -07:00
xdtbynd 53f87c463d [Docs] [npu] change the feature support status (#23041) 2026-04-17 14:34:54 +08:00
Alex Nails 43eb66028f ci: install rust toolchain in ci_install_dependency.sh (#23017) 2026-04-16 23:18:22 -07:00