684 Commits
Author SHA1 Message Date
weireweireandweireweire 49a2fbf817 [Fix] docker: Pin sgl-nvidia-mega to 3333e4c so the megakernel starts on main (#46030)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-10-23 17:58:04 -07:00
Khoa Phamandhnyls2002 5bdbec0d48 [Perf] dsv41: Drop the MegaGate padded-row copy on sgl-deep-gemm 0.2.3.post2 (#45933)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-10-22 22:10:57 -07:00
Trevor Morris 91fc46a017 [Fix] [NVIDIA] docker: Disable torch 2.15 nccl2 in CUDA 13.4 container to fix EPLB rebalance crash (#45456) 2026-10-22 20:46:32 +08:00
黄孝君 569dda1e61 [CI] [NPU] npu: Update SGLang kernel tag to 2026.9.0.post10 (#45288) 2026-10-22 14:55:56 +08:00
Ziyi XuandClaude Opus 5.5 a56024c267 [CI] flash-mla: Add the sgl-flash-mla release workflow (#45651)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 23:34:14 -07:00
Rohan VarmaandYangmin Li 9ec74a53cc [Fix] [NVIDIA] docker: Build sgl-deep-gemm 0.2.3 for cu134 to match the sglang pin (#45521)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
2026-10-22 09:01:05 +08:00
kangwangamd 131c42ba33 [Perf] [AMD] aiter: Update ROCm AITER pin to 285579b62 (gfx942/gfx950 only) (#45498) 2026-10-21 02:25:02 -07:00
YC Yen-Ching Tseng 132836b369 [Fix] [AMD] docker: Build Triton from source for ROCm 10.1 gfx1250 (#45329) 2026-10-21 15:14:24 +08:00
Kan WuandClaude Opus 5.5 aba892fbdf [Refactor] sgl-router: Move experimental/sgl-router to top-level sgl-router (#45414)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 11:09:13 +08:00
Jimmy Shong d69966f9c0 [Chore] docker: Add Beam CUDA image (1/8) (#45253) 2026-10-20 13:00:46 -07:00
Trevor Morris ec1fdc22a9 [Fix] [NVIDIA] docker: Fix CUDA 13.4 container by updating torch nightly (#45252) 2026-10-20 10:52:42 +08:00
YAMY 722669e606 [Feat] [NVIDIA] megakernels: Add --enable-nvidia-megakernel and a layer for NVIDIA megakernel plugins (#44945) 2026-10-19 11:54:44 -07:00
Trevor Morris 04c8c9703f [Fix] docker: Install numactl in runtime images - needed for SGLANG_NUMA_BIND_V2 (#43883) 2026-10-18 22:55:58 -07:00
e9b22a0818 [Perf] [AMD] monokernels: Let a plugin skip per-step attention metadata (#44601)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
Co-authored-by: kkHuang-amd <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-18 14:04:57 +00:00
+14 d33dd0566a [Feat] srt: Add muse spark runtime, multimodal support and tests (3/5) (#44666)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-10-18 01:00:24 -07:00
Zhaoyi Li 8a4239fbdc [Fix] [AMD] mooncake: Bump Mooncake to v0.3.14-rc1 for cross-node KV transfer (#44404) 2026-10-18 00:22:55 -07:00
YC Yen-Ching Tseng 9246acd462 [CI] [AMD] aiter: pin aiter commit to 2bb549 for rocm10.1 gfx1250 (#44620) 2026-10-16 17:50:20 +08:00
kkandwunhuang 536cdb4b04 [Feat] [AMD] docker: Install the sgl-amd-mono monokernel plugin in the ROCm image (#44621)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-10-16 01:20:40 -07:00
Mohammad Miadh AngkadandMohammad Angkad 44be30d216 [Chore] deps: Bump FlashInfer to 0.7.2 (#44591)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-15 22:51:21 -07:00
+14 e1d20574da [Chore] docker: Add muse spark CUDA image and DeepGEMM patches (1/5) (#44664)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-10-15 22:46:22 -07:00
a2981ab8ea [Feat] sgl-router: Serve native gRPC ChatComplete (#42674)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 13:11:36 +08:00
snadampal aa5c7e887c [Feat] docker: Add AWS EFA image variants built on published images (#41006)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
2026-10-15 13:19:22 -07:00
Michael bba535ebb4 [Fix] [AMD] docker: Repair the AITER build step after the 2bb549102 pin bump (#44534) 2026-10-15 11:18:41 -07:00
YC Yen-Ching Tseng e87e32b311 [Feat] [AMD] docker: Release ROCm 10.1 for gfx1250 in parallel with ROCm 10.0 (#42699) 2026-10-15 22:59:54 +08:00
kangwangamd 28703575f9 [AMD] Update ROCm AITER pin to 2bb549102 (#44379) 2026-10-15 16:10:41 +08:00
Rain Jiang 12dc623102 [Chore] rust: Remove the sglang-renderer crate (#43451) 2026-10-14 11:43:37 -07:00
Duyi-Wang 6781da8e5b [AMD] [Docker] Update MoRI to v1.2.4 (#43834) 2026-10-12 14:45:42 -07:00
8afe107c24 [XPU] Upgrade XPU backend to PyTorch 2.14 (#42003)
Co-authored-by: Ashwini Rathi <arathi@habana.ai>
Co-authored-by: Y <ashwini.rathi@intel.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-10-12 18:24:48 +08:00
Mohammad Miadh AngkadandMohammad Angkad 130e11d50e [Deps] Bump FlashInfer to 0.7.1 (#43494)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-11 23:23:11 -07:00
黄孝君 e1c6ddca1d [NPU] Bump SGLANG_KERNEL_NPU_TAG to 2026.9.0.post9 (#43340) 2026-10-09 17:30:38 +08:00
Xinyi Song 23f890613e [AMD] Patch aiter's group32 MXFP8 GEMM masked-scale fix (#43319) 2026-10-09 02:08:44 -07:00
黄孝君 9f5d871251 [NPU] Quote the arm64 Triton-ascend wheel URL in npu.Dockerfile (#43035) 2026-10-08 21:44:49 +08:00
943621c336 [sgl-router] Render DeepSeek-V4 through sglang-processor (#42665)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-08 20:16:20 +08:00
45abea0269 [rust-processor] DeepSeek-V4 parity with SGLang, plus a reusable parity harness and skill (#42664)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 18:35:30 +08:00
Yihao WangandClaude Opus 5.5 11972e5207 [deps] bump transformers to 5.19.0 (#42784)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 17:04:08 +08:00
Rain Jiang c52dcc5a01 The sgalng api specs (#41585) 2026-10-07 01:55:01 -07:00
Baizhou Zhang f497b626b6 build: use one DeepEP ref for implementation and packaging (#42827) 2026-10-06 17:04:28 -07:00
Trevor Morris 44a2558d40 [NVIDIA] Fix nightly-cu134 build and update (#42661) 2026-10-06 14:52:42 -07:00
Mohammad Miadh AngkadandMohammad Angkad 38bdf25f8d [Docker] Use uv-managed Python 3.12 and uv for all installs in the CUDA image (#42612)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-06 14:10:09 -07:00
0f57a39152 [rust-processor] Gate render, tokenizer and parser behind cargo features (#42663)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 10:58:38 -07:00
Mohammad Miadh AngkadandMohammad Angkad 0bdd0cc8dc [Deps] Upgrade the CUDA PyTorch stack to 2.14 (#38641)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-04 00:48:02 -07:00
Michael 2cd92d10b9 [AMD] Skip the AITER #6042/#5967 patches on gfx1250 (#42219) 2026-10-02 21:10:01 +08:00
黄孝君 7be0e85658 [CI][NPU][Diffusion] Bump ascend consistency GT to the CANN 9.1.0 baseline (#41500) 2026-10-01 17:13:28 +08:00
Thomas Wang ffb134188b [AMD] Update aiter version for v41 (#42023) 2026-10-01 01:49:45 -07:00
DarkSharpness 3ed6367d3f [DSV4/DSA] Name the FlashMLA KV format and drop the V4.1 support probe (#41337) 2026-10-01 00:02:18 -07:00
Sageandishandhanani baae0195d9 [ci] fix renderer image publish (#41936)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-09-30 18:27:11 -07:00
Sage 8e4bcc5ca9 [rust-renderer] sglang-processor lib (#41896)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-09-30 15:09:35 -07:00
547286bb5a [Deps] Bump transformers to 5.17.0 (#39012)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-09-30 12:52:02 -07:00
Mohammad Miadh AngkadandMohammad Angkad eae808903f [Deps] Bump FlashInfer to 0.7.0.post1 (#40709)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-09-30 12:42:19 -07:00
jain-ria 21ed9fbf44 [Rust] Extract shared runtime.v1 protobuf bindings (#41726)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
2026-09-30 10:13:08 -07:00