Commit Graph
509 Commits
Author SHA1 Message Date
Bingxu Chen 3607cbd65a [AMD] update ROCm AITER commit (#27555) 2026-06-08 08:49:10 -07:00
Niko Ma 18d728967a [PD][MoRI] Drive KV transfers with a sharded synchronous worker pool (#26922) 2026-06-08 00:49:25 -07:00
Артем Савкин 9f28512737 [NPU] Update documentation for software version upgrades (#26731) 2026-06-06 15:06:13 +03:00
Bingxu Chen 8c8281801d [AMD] update ROCm AITER commit (#27376) 2026-06-05 03:42:16 -07:00
Mohammad Miadh Angkad 7f706f4cfb [Deps] Bump FI to 0.6.12 and cutedsl to 4.5.2 (#26854) 2026-06-03 12:09:18 -07:00
MingxuZh b678448b8a ci(xeon): merge 2 partitions into 1 job to reduce runner contention (#26904) 2026-06-03 09:46:27 +08:00
Baizhou Zhang 68caf49154 Update sgl-deep-gemm to 0.1.2 (#26993) 2026-06-02 13:51:54 -07:00
popsiclexuandpopsiclexu 951fa05a09 [MoE] Support BF16 standard A2A with DeepGEMM runner (#26473)
Co-authored-by: popsiclexu <zhenxue.xu@mthreads.com>
2026-06-01 20:40:38 -07:00
WingEdge777 20f47cfe8e fix : add sglang script as entry bin for runtime docker image (#26895) 2026-06-01 09:22:37 +02:00
monkeyLoveding 7619e77b7b [NPU] chore: basic software upgrade (#26466) 2026-05-29 10:04:15 +08:00
Baizhou Zhang 435c4ffb30 [CI] Clean DeepSeek V4 tests and installation scripts (#26609) 2026-05-28 15:22:59 -07:00
Bingxu Chen bdfd5da53e [AMD] AITER Upgrade (#26562) 2026-05-28 02:04:58 -07:00
Bingxu Chenandyctseng0211 6f85957ff2 [AMD] Fix aiter checkout (rocm dockerfile) (#26544)
Co-authored-by: yctseng0211 <yctseng@amd.com>
2026-05-28 14:25:01 +08:00
9fea20a078 update XPU Dockerfile (#25174)
Signed-off-by: Matrix Yao <matrix.yao@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-28 10:58:09 +08:00
sglang-botandsglang-bot 14f81a67d9 chore: bump sglang-kernel version to 0.4.3 (#26421)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-05-27 11:31:11 -07:00
Kangyan-ZhouandClaude Opus 4.7 7c04b9e942 fix(docker): generate Cargo.lock in chef stage for sgl-router build (#26279)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-25 16:54:47 +08:00
Shangming Cai 7f2829af39 chore: bump mooncake version to 0.3.11.post1 (#25989) 2026-05-25 16:51:03 +08:00
xdtbynd 0942011665 [NPU] Add torchaudio dependency for NPU platform (#26267) 2026-05-25 16:30:12 +08:00
Kangyan-ZhouandClaude Opus 4.7 6e8fe176be sgl-router: experimental Rust HTTP router for SGLang worker pools (#25851)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-25 15:34:05 +08:00
Ma Mingfei 821d5f4a5b [CPU] add faster KV-cache writes (#25874) 2026-05-25 10:28:52 +08:00
jiayisunx 6339295556 [XPU] add apache-tvm-ffi dependency (#26053) 2026-05-22 16:09:08 +08:00
Bingxu ChenandCursor e72e3145a0 [AMD] Upgrade AITER (#25896)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-21 02:10:43 -07:00
jiayisunxandMa Mingfei 34479c19bd [XPU] upgrade triton-xpu version to 3.7.1 (#25730)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-21 10:29:20 +08:00
Xia WeiwenandMa Mingfei 8d5ed330cc [XPU] Enable qwen3.5 on XPU (#21668)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-18 14:59:19 +08:00
0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
2026-05-15 01:04:56 -07:00
Liangsheng Yin 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) 2026-05-14 15:28:58 -07:00
Baizhou Zhang f7efff321d [Docker] Fix several dependencies in Dockerfile (#25215) 2026-05-13 20:18:26 -07:00
Cheng WanandClaude Opus 4.7 72b49bfac6 docker, ci: swap GB DeepEP source from fzyzcjy fork to deepseek-ai/DeepEP@hybrid-ep (#25113)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 13:25:15 -07:00
Baizhou Zhang 51a9403104 Update flashinfer to 0.6.11.post1 (#25129) 2026-05-13 00:12:19 -07:00
billishyahaoandDuyi-Wang 66a9234246 [AMD] support fp8 blockwise quantization combine for mori ep (#24879)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
2026-05-12 23:24:40 -07:00
Brayden Zhongandb8zhong d5f3254ed1 [Dependency] Flashinfer 0.6.8post1 -> 0.6.11 (#24452)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-12 14:38:32 -07:00
Thomas Wang 19afe73e03 [AMD] Cherry-pick aiter commit for mhc_pre fix (#24665) 2026-05-07 23:49:39 -07:00
+6 35870d55ac Deepseek V4 (#23882)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
2026-05-07 18:32:21 -07:00
Mandepudi Rani ChowdaryandMa Mingfei 55224fff08 Add Arm64 CPU Phase 1A CI bootstrap (#22123)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-08 09:28:23 +08:00
Baizhou Zhang ecb786c8d7 [Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268) 2026-05-06 18:59:01 -07:00
YC Yen-Ching Tseng 64613543ea [AMD] fix(docker): unbreak nightly when archive.ubuntu.com:80 is unreachable (#24407) 2026-05-05 00:39:14 -07:00
Baizhou ZhangandClaude Opus 4.7 f059e0264a Fix sgl-deep-gemm release workflow (#24385)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-04 14:36:59 -07:00
Kangyan-ZhouandClaude Opus 4.7 0f283a515a [Docker] fix: install nixl stub alongside nixl-cuXX binary (#24369)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-04 12:46:38 -07:00
mispa-msandClaude Opus 4.7 62a4df0067 [docker] Fix silently-masked cubin download failure; skip prebuilt cubins on aarch64 (#24234)
Signed-off-by: misunp <misunp@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-04 09:08:01 -07:00
Baizhou ZhangandClaude Opus 4.7 de08c804c5 Add release workflow for sgl-deep-gemm wheels (#24348)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-04 00:58:44 -07:00
52b4609789 [Docker] Prep for torch 2.11: cu129 fix, image validator, dep cleanup (#23593)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-05-04 00:37:55 -07:00
88bb5dffe4 [Dependency] Upgrade to Torch 2.11.0 (#21247)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-05-02 12:25:36 -07:00
HAI 7e17a7a1e8 Upd: AITER->(#2879)a6bb499 (#24218) 2026-05-01 01:26:08 -07:00
AlecandKangyan-Zhou 9d95783603 Add Docker image provenance metadata (#24090)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-04-30 21:40:42 -07:00
MingxuZhandMa Mingfei 62136073f9 pin the version of xgrammar to v0.1.32 (#24010)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-04-30 10:13:08 +08:00
MingxuZhandMa Mingfei 2d27c38f13 Update XPU Docker runtime stack & hf_home config (#23820)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-04-29 10:03:11 +08:00
9003f24e2b chore: bump sglang-kernel version to 0.4.1.post1 (#23733)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-25 23:23:49 -07:00
jhchouuu f7e840682c [AMD][MoRI] bump MoRI to v1.1.1 (#23642) 2026-04-24 13:12:20 -07:00
sglang-botandsglang-bot f3b88e080a chore: bump flashinfer version to 0.6.8.post1 (#23281)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-04-23 15:23:03 -07:00
Polisetty V R K Jyothendra Varma 214c35b031 [Intel GPU] Update xpu.Dockerfile to python 3.12 version (#23367) 2026-04-23 09:23:52 +08:00