Commit Graph
527 Commits
Author SHA1 Message Date
Zaili Wang cb06c4e6ce [CPU] Fix model failures on Xeon (#29497) 2026-07-02 13:20:18 +08:00
Zhaoyi LiandMichael a3f6680874 [AMD]: docker(rocm) bump Mooncake to latest main + enable multi-protocol (#27730)
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
2026-07-01 17:41:46 -07:00
Bingxu Chen 81a472efcc [AMD] Update ROCm AITER pin to 9127c94 (#29816) 2026-07-01 01:09:11 -07:00
b6907d9664 docker: install dynamo nightly in the dev image for rapid iteration/testing (#29634)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-29 22:58:19 -07:00
Zhaoyi Liandbingxche 6bf15aa2b9 [AMD]: Enable NIXL PD disaggregation for ROCm(1/n) (#28348)
Co-authored-by: bingxche <bingxche@amd.com>
2026-06-29 21:23:09 -07:00
Martin Hua b1da2082ca chore: bump sgl-deep-gemm build-time apache-tvm-ffi 0.1.9 -> 0.1.11 (#28481) 2026-06-28 00:26:24 -07:00
Xinyuan Tong 7c23d2255a [minimax-m3] Split 1/4: sparse attention ops + JIT kernels + config foundation (#28712) 2026-06-22 13:10:43 -07:00
Douglas Yang 105e095e00 [Docker] Fix cu12 dev image build: pin torch reinstall + JIT-fallback for missing x86 cubins (#28632) 2026-06-18 10:51:57 +02:00
sglang-botandsglang-bot b1d18d562b chore: bump sglang-kernel version to 0.4.4 (#28572)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-06-17 16:13:39 -07:00
Baizhou Zhang 27291118b9 Upgrade sgl-deep-gemm to 0.1.3 (#28402) 2026-06-16 23:06:36 -07:00
Kangyan-ZhouandClaude Opus 4.8 827fc56e00 [router] Multi-arch experimental sgl-router image + fix distroless libpcre2 startup crash (#28474)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-16 20:09:39 -07:00
monkeyLoveding 1180b70440 triton-ascend update (#27624) 2026-06-15 17:20:19 +08:00
Bingxu Chen 9864059e2b [AMD] Update AITER commit (#28249) 2026-06-15 02:04:34 -07:00
Thomas Wang ddbe5ff2f1 [AMD] Pin maturin<1.14 to fix ROCm image build failure (#27999) 2026-06-11 22:13:27 -07:00
Vinay Kumar 57907cff97 docker(xeon): support running container as non-root user (#27157) 2026-06-11 12:26:26 +08:00
Bingxu Chen 4704b10d0d [AMD] Update MoRI to v1.2.0 (#27669) 2026-06-09 22:41:53 -07:00
bcd9c5a903 update pytorch-xpu to 2.12 (#27133)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
2026-06-10 09:25:30 +08:00
c2eae96c56 MSCCL++ Integration (#22734)
Co-authored-by: Caio Rocha <caiorocha@microsof.com>
Co-authored-by: empyreus <rjsouza1995@gmail.com>
2026-06-08 21:13:13 -07:00
Bingxu Chen 3607cbd65a [AMD] update ROCm AITER commit (#27555) 2026-06-08 08:49:10 -07:00
Niko Ma 18d728967a [PD][MoRI] Drive KV transfers with a sharded synchronous worker pool (#26922) 2026-06-08 00:49:25 -07:00
Артем Савкин 9f28512737 [NPU] Update documentation for software version upgrades (#26731) 2026-06-06 15:06:13 +03:00
Bingxu Chen 8c8281801d [AMD] update ROCm AITER commit (#27376) 2026-06-05 03:42:16 -07:00
Mohammad Miadh Angkad 7f706f4cfb [Deps] Bump FI to 0.6.12 and cutedsl to 4.5.2 (#26854) 2026-06-03 12:09:18 -07:00
MingxuZh b678448b8a ci(xeon): merge 2 partitions into 1 job to reduce runner contention (#26904) 2026-06-03 09:46:27 +08:00
Baizhou Zhang 68caf49154 Update sgl-deep-gemm to 0.1.2 (#26993) 2026-06-02 13:51:54 -07:00
popsiclexuandpopsiclexu 951fa05a09 [MoE] Support BF16 standard A2A with DeepGEMM runner (#26473)
Co-authored-by: popsiclexu <zhenxue.xu@mthreads.com>
2026-06-01 20:40:38 -07:00
WingEdge777 20f47cfe8e fix : add sglang script as entry bin for runtime docker image (#26895) 2026-06-01 09:22:37 +02:00
monkeyLoveding 7619e77b7b [NPU] chore: basic software upgrade (#26466) 2026-05-29 10:04:15 +08:00
Baizhou Zhang 435c4ffb30 [CI] Clean DeepSeek V4 tests and installation scripts (#26609) 2026-05-28 15:22:59 -07:00
Bingxu Chen bdfd5da53e [AMD] AITER Upgrade (#26562) 2026-05-28 02:04:58 -07:00
Bingxu Chenandyctseng0211 6f85957ff2 [AMD] Fix aiter checkout (rocm dockerfile) (#26544)
Co-authored-by: yctseng0211 <yctseng@amd.com>
2026-05-28 14:25:01 +08:00
9fea20a078 update XPU Dockerfile (#25174)
Signed-off-by: Matrix Yao <matrix.yao@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-28 10:58:09 +08:00
sglang-botandsglang-bot 14f81a67d9 chore: bump sglang-kernel version to 0.4.3 (#26421)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-05-27 11:31:11 -07:00
Kangyan-ZhouandClaude Opus 4.7 7c04b9e942 fix(docker): generate Cargo.lock in chef stage for sgl-router build (#26279)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-25 16:54:47 +08:00
Shangming Cai 7f2829af39 chore: bump mooncake version to 0.3.11.post1 (#25989) 2026-05-25 16:51:03 +08:00
xdtbynd 0942011665 [NPU] Add torchaudio dependency for NPU platform (#26267) 2026-05-25 16:30:12 +08:00
Kangyan-ZhouandClaude Opus 4.7 6e8fe176be sgl-router: experimental Rust HTTP router for SGLang worker pools (#25851)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-25 15:34:05 +08:00
Ma Mingfei 821d5f4a5b [CPU] add faster KV-cache writes (#25874) 2026-05-25 10:28:52 +08:00
jiayisunx 6339295556 [XPU] add apache-tvm-ffi dependency (#26053) 2026-05-22 16:09:08 +08:00
Bingxu ChenandCursor e72e3145a0 [AMD] Upgrade AITER (#25896)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-21 02:10:43 -07:00
jiayisunxandMa Mingfei 34479c19bd [XPU] upgrade triton-xpu version to 3.7.1 (#25730)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-21 10:29:20 +08:00
Xia WeiwenandMa Mingfei 8d5ed330cc [XPU] Enable qwen3.5 on XPU (#21668)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-18 14:59:19 +08:00
0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
2026-05-15 01:04:56 -07:00
Liangsheng Yin 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) 2026-05-14 15:28:58 -07:00
Baizhou Zhang f7efff321d [Docker] Fix several dependencies in Dockerfile (#25215) 2026-05-13 20:18:26 -07:00
Cheng WanandClaude Opus 4.7 72b49bfac6 docker, ci: swap GB DeepEP source from fzyzcjy fork to deepseek-ai/DeepEP@hybrid-ep (#25113)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 13:25:15 -07:00
Baizhou Zhang 51a9403104 Update flashinfer to 0.6.11.post1 (#25129) 2026-05-13 00:12:19 -07:00
billishyahaoandDuyi-Wang 66a9234246 [AMD] support fp8 blockwise quantization combine for mori ep (#24879)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
2026-05-12 23:24:40 -07:00
Brayden Zhongandb8zhong d5f3254ed1 [Dependency] Flashinfer 0.6.8post1 -> 0.6.11 (#24452)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-12 14:38:32 -07:00
Thomas Wang 19afe73e03 [AMD] Cherry-pick aiter commit for mhc_pre fix (#24665) 2026-05-07 23:49:39 -07:00