Commit Graph
669 Commits
Author SHA1 Message Date
Zhaoyi Li 8a4239fbdc [Fix] [AMD] mooncake: Bump Mooncake to v0.3.14-rc1 for cross-node KV transfer (#44404) 2026-10-18 00:22:55 -07:00
YC Yen-Ching Tseng 9246acd462 [CI] [AMD] aiter: pin aiter commit to 2bb549 for rocm10.1 gfx1250 (#44620) 2026-10-16 17:50:20 +08:00
kkandwunhuang 536cdb4b04 [Feat] [AMD] docker: Install the sgl-amd-mono monokernel plugin in the ROCm image (#44621)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-10-16 01:20:40 -07:00
Mohammad Miadh AngkadandMohammad Angkad 44be30d216 [Chore] deps: Bump FlashInfer to 0.7.2 (#44591)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-15 22:51:21 -07:00
+14 e1d20574da [Chore] docker: Add muse spark CUDA image and DeepGEMM patches (1/5) (#44664)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-10-15 22:46:22 -07:00
a2981ab8ea [Feat] sgl-router: Serve native gRPC ChatComplete (#42674)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 13:11:36 +08:00
snadampal aa5c7e887c [Feat] docker: Add AWS EFA image variants built on published images (#41006)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
2026-10-15 13:19:22 -07:00
Michael bba535ebb4 [Fix] [AMD] docker: Repair the AITER build step after the 2bb549102 pin bump (#44534) 2026-10-15 11:18:41 -07:00
YC Yen-Ching Tseng e87e32b311 [Feat] [AMD] docker: Release ROCm 10.1 for gfx1250 in parallel with ROCm 10.0 (#42699) 2026-10-15 22:59:54 +08:00
kangwangamd 28703575f9 [AMD] Update ROCm AITER pin to 2bb549102 (#44379) 2026-10-15 16:10:41 +08:00
Rain Jiang 12dc623102 [Chore] rust: Remove the sglang-renderer crate (#43451) 2026-10-14 11:43:37 -07:00
Duyi-Wang 6781da8e5b [AMD] [Docker] Update MoRI to v1.2.4 (#43834) 2026-10-12 14:45:42 -07:00
8afe107c24 [XPU] Upgrade XPU backend to PyTorch 2.14 (#42003)
Co-authored-by: Ashwini Rathi <arathi@habana.ai>
Co-authored-by: Y <ashwini.rathi@intel.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-10-12 18:24:48 +08:00
Mohammad Miadh AngkadandMohammad Angkad 130e11d50e [Deps] Bump FlashInfer to 0.7.1 (#43494)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-11 23:23:11 -07:00
黄孝君 e1c6ddca1d [NPU] Bump SGLANG_KERNEL_NPU_TAG to 2026.9.0.post9 (#43340) 2026-10-09 17:30:38 +08:00
Xinyi Song 23f890613e [AMD] Patch aiter's group32 MXFP8 GEMM masked-scale fix (#43319) 2026-10-09 02:08:44 -07:00
黄孝君 9f5d871251 [NPU] Quote the arm64 Triton-ascend wheel URL in npu.Dockerfile (#43035) 2026-10-08 21:44:49 +08:00
943621c336 [sgl-router] Render DeepSeek-V4 through sglang-processor (#42665)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-08 20:16:20 +08:00
45abea0269 [rust-processor] DeepSeek-V4 parity with SGLang, plus a reusable parity harness and skill (#42664)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 18:35:30 +08:00
Yihao WangandClaude Opus 5.5 11972e5207 [deps] bump transformers to 5.19.0 (#42784)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 17:04:08 +08:00
Rain Jiang c52dcc5a01 The sgalng api specs (#41585) 2026-10-07 01:55:01 -07:00
Baizhou Zhang f497b626b6 build: use one DeepEP ref for implementation and packaging (#42827) 2026-10-06 17:04:28 -07:00
Trevor Morris 44a2558d40 [NVIDIA] Fix nightly-cu134 build and update (#42661) 2026-10-06 14:52:42 -07:00
Mohammad Miadh AngkadandMohammad Angkad 38bdf25f8d [Docker] Use uv-managed Python 3.12 and uv for all installs in the CUDA image (#42612)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-06 14:10:09 -07:00
0f57a39152 [rust-processor] Gate render, tokenizer and parser behind cargo features (#42663)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 10:58:38 -07:00
Mohammad Miadh AngkadandMohammad Angkad 0bdd0cc8dc [Deps] Upgrade the CUDA PyTorch stack to 2.14 (#38641)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-04 00:48:02 -07:00
Michael 2cd92d10b9 [AMD] Skip the AITER #6042/#5967 patches on gfx1250 (#42219) 2026-10-02 21:10:01 +08:00
黄孝君 7be0e85658 [CI][NPU][Diffusion] Bump ascend consistency GT to the CANN 9.1.0 baseline (#41500) 2026-10-01 17:13:28 +08:00
Thomas Wang ffb134188b [AMD] Update aiter version for v41 (#42023) 2026-10-01 01:49:45 -07:00
DarkSharpness 3ed6367d3f [DSV4/DSA] Name the FlashMLA KV format and drop the V4.1 support probe (#41337) 2026-10-01 00:02:18 -07:00
Sageandishandhanani baae0195d9 [ci] fix renderer image publish (#41936)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-09-30 18:27:11 -07:00
Sage 8e4bcc5ca9 [rust-renderer] sglang-processor lib (#41896)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-09-30 15:09:35 -07:00
547286bb5a [Deps] Bump transformers to 5.17.0 (#39012)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-09-30 12:52:02 -07:00
Mohammad Miadh AngkadandMohammad Angkad eae808903f [Deps] Bump FlashInfer to 0.7.0.post1 (#40709)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-09-30 12:42:19 -07:00
jain-ria 21ed9fbf44 [Rust] Extract shared runtime.v1 protobuf bindings (#41726)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
2026-09-30 10:13:08 -07:00
Shangming Cai 8c75ad9e62 chore: bump mooncake version to 0.3.13.post1 (#41678) 2026-09-30 15:16:54 +08:00
ashwini rathi 98fce73d5b [XPU] publish nightly docker image with sgl-kernel-xpu built from main (#41650) 2026-09-29 20:09:53 +08:00
Trevor Morris b07cb9e9e7 [NVIDIA] Update deepgemm, deep-ep, sgl-kernel in CUDA 13.4 image, use cuda base image (#40987) 2026-09-28 14:12:46 -07:00
34f090053e [AMD] [Docker] Remove unused LLVM 18 setup from ROCm TileLang build (#41387)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
2026-09-27 22:41:08 -07:00
Caio RochaandCaio Rocha e047e50d4e Add 8-node AllReduce/AllGather and MNVLS algorithm support to MSCCL++ (#37442)
Co-authored-by: Caio Rocha <caiorocha@microsft.com>
2026-09-24 15:51:29 -07:00
Thomas Wang 1446e24d13 [AMD] Add .co for deepseek v4 fp8 decode kernel and add group decode opt (#41120) 2026-09-24 12:21:34 -07:00
黄孝君 4142235c2b [NPU] Update CANN version to 9.1.0 (#40524) 2026-09-24 21:35:31 +08:00
jacky.chengandEddie A. Tsai 58988bee2f [AMD] Add diffusion (Wan2.2) extras to gfx1151 Docker image (#40844)
Co-authored-by: Eddie A. Tsai <56776714+vvvdwbvvv@users.noreply.github.com>
2026-09-22 22:18:55 -07:00
kangwangamd 264da63319 [AMD] Update ROCm AITER pin to acf8fdf9 (#39965) 2026-09-21 22:01:17 -07:00
7b1c2ed0a4 [rust-renderer] Standalone preprocessing (#36718)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
2026-09-20 22:03:12 +08:00
Chunan Zeng d78b35076a [CI] Fix missing elfutils headers in CUDA 13.4 DeepGEMM build (#39855) 2026-09-16 16:41:29 -07:00
Jensenandronnie_zheng 5212797880 [NPU] fix npu docker workspace directory (#39732)
Signed-off-by: xiedeyantu <czjourney@163.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-09-16 11:51:38 +03:00
Kan WuandClaude Fable 5.1 e89d8facab [sgl-router] Prepare dynamo-render dependencies (#39457)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-14 19:08:16 -07:00
sglang-botandsglang-bot 96a95171c7 chore: bump sglang-kernel version to 0.4.7 (#39346)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-09-13 20:49:37 -07:00
Baizhou Zhang 29cc9d2dc9 [CI] Install elfutils headers for DeepGEMM wheel builds (#39152) 2026-09-11 17:29:40 -07:00