100 Commits
Author SHA1 Message Date
Baizhou Zhang 2fca6d69aa bumping sgl-deep-gemm to 0.2.0 (#39371) 2026-09-14 15:30:31 -07:00
Baizhou ZhangandChunan Zeng 5ebb16005d [DeepSeek-V4.1] Bump FlashMLA to the fork's rebase head (v4.1 kernels) (#39171)
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
2026-09-13 15:43:19 -07:00
Baizhou Zhang 7763f666f3 Fix DeepGEMM release MegaMoE validation without RDMA (#39245) 2026-09-12 20:27:29 -07:00
Baizhou Zhang a8b5616303 Fix DeepGEMM release dependencies and bound GPU validation (#39241) 2026-09-12 17:00:58 -07:00
a66451c058 [GLM-5.3 Flash] Restore and enable KPool metadata fusion (#38845)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2@liverpool.ac.uk>
Co-authored-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: zanes-ops <zanes@nvidia.com>
2026-09-12 16:01:11 -07:00
Baizhou Zhang 56a4f47ca6 [CI] Fix base-a wait for skipped CPU matrix (#39195) 2026-09-11 23:39:53 -07:00
Baizhou Zhang 3bb2a5231a [CI] Extend DeepGEMM SM90 test timeout to four hours (#39194) 2026-09-11 23:36:54 -07:00
Baizhou Zhang 9c365e97b1 [CI] Fix DeepGEMM sanitizer setup and Blackwell test timeouts (#39163) 2026-09-11 20:54:52 -07:00
Baizhou Zhang 29cc9d2dc9 [CI] Install elfutils headers for DeepGEMM wheel builds (#39152) 2026-09-11 17:29:40 -07:00
Baizhou Zhang fa6e657b93 [misc] Update CI permission (#38834) 2026-09-10 01:38:58 -07:00
Baizhou Zhang e54ff1efb9 [CP V1 Deprecation 5/5] Update prefill CP documentation (#36230) 2026-09-08 19:27:49 -07:00
Baizhou Zhang ed183d45ac [CP V1 Deprecation 4/5] Canonicalize prefill CP API names (#36229) 2026-09-08 16:03:36 -07:00
Baizhou Zhang 85d39401c8 [CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293) 2026-09-07 15:39:34 -07:00
Baizhou Zhang 503e36cbae Tiny Update CI Permission (#38278) 2026-09-06 22:17:48 -07:00
Baizhou Zhang b6c31b155c [CP V1 Deprecation 3/5] Remove generic prefill CP v1 runtime (#36228) 2026-09-06 21:53:53 -07:00
Baizhou Zhang ff1285cc28 [CP V1 Deprecation 2/5] Make strategy prefill CP canonical (#36223) 2026-09-03 20:24:19 -07:00
Baizhou Zhang fd70325c10 [CI] Add dspark + dsv4 e2e test (#37665) 2026-09-03 14:26:25 -07:00
Baizhou Zhang 07c8f7294d Bump sgl-deep-gemm to 0.1.7 (#37279) 2026-08-31 17:16:34 -07:00
Baizhou Zhang a7ee399904 Bump sgl-deep-gemm to v0.1.6 (#36998) 2026-08-29 19:51:02 -07:00
Baizhou Zhang 46334460a6 [CI] Temporarily disable GB300 jobs (#36981) 2026-08-28 23:56:54 -07:00
395c2258c3 [Docs] Add GLM-5.3 cookbook (#36827)
Co-authored-by: JustinTong0323 <xinyuantong.cs@gmail.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Mohammad Angkad <176301910+mmangkad@users.noreply.github.com>
2026-08-28 14:56:06 +00:00
Baizhou Zhang 76217f6603 Revert "[NPU] [bugfix] Fix import of ggml_moe_a8_vec and Fix NPU MLA HiCache backup accessing missing data_ptrs" (#36747) 2026-08-27 16:16:30 -07:00
Baizhou ZhangandRyan Stewart 41e7612dee [Model] Support Nemotron 3.5 Lightning speculative decoding (#36186)
Co-authored-by: Ryan Stewart <rystewart@nvidia.com>
2026-08-25 16:43:58 -07:00
Baizhou Zhang 2d88c79b3e [CI] Add Kimi-K3 MMMU-Pro accuracy coverage (#36284) 2026-08-25 16:33:46 -07:00
Baizhou Zhang 833be86c15 [CP V1 Deprecation 1/5] Migrate tests to strategy-based prefill CP (#36222) 2026-08-24 20:15:34 -07:00
Baizhou Zhang 3b5909de0e [DeepSeek V4] Add W4A4 MegaMoE server flag (#35918) 2026-08-21 18:44:18 -07:00
Baizhou Zhang 60ff1e33a5 [DeepSeek V4] Default FP4 checkpoints to FlashInfer MXFP4 MoE (#35919) 2026-08-21 16:48:58 -07:00
Baizhou Zhang 92eeed41d7 [Docker] Defer CUDA 13 NCCL override until after dependency resolution (#35756) 2026-08-20 14:48:07 -07:00
Baizhou Zhang d287880a7a Update deepep for SBO feature (#35450) 2026-08-19 23:37:13 -07:00
Baizhou Zhang cfc6dfb364 Apply latest DeepEP branch (#34923) 2026-08-18 16:24:50 -07:00
Baizhou Zhang b814a7e812 [CI] Skip fast-fail for scheduled stages (#35392) 2026-08-18 15:07:33 -07:00
Baizhou Zhang 5b60b7c651 [DSV4] Turn on mhc post pre fusion by default (#35214) 2026-08-18 00:03:37 -07:00
Baizhou Zhang 53621818e4 [Docs] Enable PD disaggregation for DSV4 low-latency recipes (#35224) 2026-08-17 20:07:27 -07:00
Baizhou Zhang c2c1c4d3eb [CI] Move DSA PD+MTP+CP Layersplit test to basic B300 test suite (#35220) 2026-08-17 17:44:31 -07:00
Baizhou Zhang bc312d185d Clean deprecated DeepSeek V4 Environs (#34926) 2026-08-17 16:07:00 -07:00
Baizhou Zhang e161bd1265 Fix Python packaging shadowing in DeepEP wheel builds (#34937) 2026-08-15 03:27:32 -07:00
Baizhou Zhang 8d44091326 Update sgl-deep-ep release workflow for DeepEP v2 (#34914) 2026-08-15 02:08:28 -07:00
Baizhou Zhang 7769f54feb [Kimi-K3] Use explicit SiTU activation for MegaMoE (#34883) 2026-08-15 01:41:59 -07:00
Baizhou Zhang a1844709f1 [CI] Trim Qwen3.5 FP8 GB300 performance batches (#34882) 2026-08-14 16:45:11 -07:00
Baizhou Zhang 8b4faa3336 [Docs] Update Kimi-K3 installation options (#34886) 2026-08-14 16:19:23 -07:00
Baizhou Zhang 0a6bbbe128 [Fix] Restore layer-level DSV4 RoPE policy (#34788) 2026-08-13 21:26:45 -07:00
Baizhou Zhang 9c0d4cba3f [CI] Split Kimi K2.5 performance batches by config (#34669) 2026-08-13 03:20:50 -07:00
Baizhou Zhang 273d978bed [CI] Use default installer for B300 tests (#34635) 2026-08-12 16:21:40 -07:00
Baizhou Zhang 983dfd6a9a [Misc] Sanitize the structure of environ.py (#34472) 2026-08-11 16:31:33 -07:00
Baizhou Zhang b498f46271 [CI] Add MegaMoE runner compatibility alias (#34326) 2026-08-10 19:47:38 -07:00
Baizhou Zhang a92bbf2f24 docs: remove DSV4 low-latency chunked prefill size (#34333) 2026-08-10 17:23:43 -07:00
Baizhou Zhang 56e8bb49b8 fix(ci): constrain NeMo Skills evaluator dependencies (#34322) 2026-08-10 16:56:46 -07:00
Baizhou Zhang c9444deef4 Docker: install DeepEP from release wheels (#34041) 2026-08-07 23:51:09 -07:00
Baizhou Zhang eb3cc879e0 Install DeepEP from release wheels (#33932) 2026-08-07 15:38:44 -07:00
Baizhou Zhang 8fc66d1a62 docker: pin Kimi images to SGLang commit (#34030) 2026-08-07 14:49:26 -07:00
Baizhou Zhang 8a22b8305d docker: add Kimi K3 artifacts and build hpc-ops with C++20 (#33956) 2026-08-07 13:50:44 -07:00
Baizhou Zhang 5e60363960 Fix prefill CP graph overflow with larger bucket search (#33906) 2026-08-07 01:33:14 -07:00
Baizhou Zhang e0af47b03e Fix sgl-deep-ep builder dependencies (#33866) 2026-08-06 16:30:02 -07:00
Baizhou Zhang ba9074035a Build and release sgl-deep-ep wheels (#33498) 2026-08-06 02:07:36 -07:00
Baizhou Zhang 0e584529f5 [CI] Remove profiling from nightly tests (#33832) 2026-08-06 01:16:08 -07:00
Baizhou Zhang 5d1a0c7129 Revert "Warn on risky serving-time Triton work" (#33826) 2026-08-05 23:36:10 -07:00
Baizhou Zhang f9b954ddb1 [CI] Temporarily disable prefill cuda graph for qwen3.5 nightly test (#33772) 2026-08-05 18:52:57 -07:00
Baizhou Zhang 070fde72bf [CI] Remove some unneeded CP tests (#33763) 2026-08-05 16:07:14 -07:00
Baizhou Zhang 25035bff8d Use main branch in Kimi Dockerfiles (#33760) 2026-08-05 15:33:14 -07:00
Baizhou Zhang 87ed82ff7e Remove custom all-reduce disable from Kimi-K3 B300 recipe (#33612) 2026-08-04 16:07:31 -07:00
Baizhou Zhang 6808c6d571 [Tiny] Little enhancement of Kimi-K3 test (#33609) 2026-08-04 15:36:41 -07:00
Baizhou Zhang eb31a53338 Revert "Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120" (#33455) 2026-08-03 19:03:56 -07:00
Baizhou Zhang 7f6a2e2b50 [Refactor] Clean up and split DSA indexer (#33443) 2026-08-03 18:05:01 -07:00
Baizhou Zhang 0bf0640b9d [CP] Support breakable CUDA graphs for zigzag strategy (#33136) 2026-08-02 23:11:57 -07:00
Baizhou Zhang e824b24250 [CP] Fuse zigzag attention into a single call (#33137) 2026-08-02 20:46:42 -07:00
Baizhou Zhang e1964da451 [Docs] Add RTX 5090 DeepSeek-V4 recipe (#33157) 2026-07-31 19:04:23 -07:00
Baizhou Zhang fd28242b68 [CI] Pin NCCL ports for GB300 PR tests (#33044) 2026-07-31 02:28:37 -07:00
Baizhou Zhang d12ea3e9ba docker: add Kimi K3 images (#32760) 2026-07-29 03:02:28 -07:00
ef6c07008b Support DCP for Kimi Linear model (#32612)
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
2026-07-28 22:59:58 -07:00
Baizhou Zhang b21cc8eb9b [misc] Update CodeOwner (#32717) 2026-07-28 19:55:14 -07:00
Baizhou Zhang 082b2a10b6 Add local ZIP uploader for whl releases (#32489) 2026-07-27 00:03:59 -07:00
Baizhou Zhang f15b43242b Bump sgl-deep-gemm to 0.1.5 (#32345) 2026-07-24 14:03:38 -07:00
Baizhou Zhang 3d0c6bf57f [Fix] Fix trtllm_mla backend + fp8 kv cache without rope (#32181) 2026-07-23 14:55:18 -07:00
Baizhou Zhang ed26a111b2 Revert "docker: install dynamo nightly in the dev image for rapid iteration/testing" (#32257) 2026-07-23 14:51:43 -07:00
Baizhou Zhang 20f6a416e7 [Tiny] Skip sm120 deepgemm test temporarily (#32193) 2026-07-23 02:54:58 -07:00
Baizhou Zhang 5387e23ecd [Tiny]Correct runner for testing deepgemm (#32174) 2026-07-23 01:13:14 -07:00
Baizhou Zhang fc0cbb795d [Misc] Add sm120 tests to DeepGemm release pipeline (#31841) 2026-07-21 22:19:23 -07:00
Baizhou Zhang 9668d9ea72 Support GPT-OSS zigzag CP with TRTLLM-MHA (#31732) 2026-07-20 00:48:04 -07:00
Baizhou Zhang 7a03d30149 Support MiMo V2.5 with zigzag context parallelism (#29972) 2026-07-19 02:36:40 -07:00
Baizhou Zhang 38b29dcd6c Fix SM120 NVFP4 KV cache test OOM (#31653) 2026-07-18 00:53:47 -07:00
Baizhou Zhang 304a529558 Revert "Bump FlashInfer to 0.6.15 and revert regressions" (#31625) 2026-07-17 16:46:33 -07:00
Baizhou Zhang eaeb779ea4 [Doc] Update GLM5.2 Cookbook with LayerSplit usage (#31577) 2026-07-17 02:25:50 -07:00
Baizhou Zhang e835512303 Add nightly test for GLM5.2 LayerSplit (#31512) 2026-07-17 00:29:14 -07:00
Baizhou Zhang 82e7cdcff9 [Misc] Remove a few dead code paths in DSA (#30973) 2026-07-12 23:25:03 -07:00
Baizhou Zhang e1d51be91f [Tiny] Fix a typo in cookbook (#30837) 2026-07-10 21:47:35 -07:00
Baizhou Zhang 07165d5daa Add DCP to runtime parallel context (#30478) 2026-07-10 21:23:41 -07:00
Baizhou Zhang e8646701c1 Update GLM-5.2 NVFP4 cookbook (#30826) 2026-07-10 15:56:32 -07:00
Baizhou Zhang 3f1694f5e0 Update sgl-deep-gemm to 0.1.4.post1 (#30697) 2026-07-10 13:30:43 -07:00
2c6cd1ef41 [Dep] Upgrade flashinfer to 0.6.14 (#29910)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-07-09 17:52:33 -07:00
Baizhou Zhang 7e936f690e [Tiny] Fix Lint in #30645 (#30699) 2026-07-09 15:30:48 -07:00
Baizhou Zhang 2b3d9ad375 [Tiny] Fix docstring in CP abstractions (#30579) 2026-07-08 18:41:40 -07:00
Baizhou Zhang fa278a762c Fix FA3 prefill CP NaNs (#30439) 2026-07-07 20:16:09 -07:00
Baizhou Zhang 946804e042 Disable FA3 sparse mask kernels by default (#30356) 2026-07-07 01:46:44 -07:00
Baizhou Zhang 5eb1b6a7ba Remove retired DSA env paths (#29912) 2026-07-05 22:58:02 -07:00
Baizhou Zhang e552f6ed75 [Fix] Fix DSA indexer fusion for NeoX RoPE (#30111) 2026-07-04 03:20:55 -07:00
Baizhou Zhang 1f0f353d92 [CI] Add GLM52 NVFP4 MTP B200 tests (#30021) 2026-07-03 13:43:38 -07:00
Baizhou Zhang e3258d3b54 [Fix] Turn off dsa indexer fusion by default (#30018) 2026-07-03 01:08:06 -07:00
Baizhou Zhang c312cdd3a7 Upgrading tvm-ffi/sgl-deep-gemm/tilelang (#29554) 2026-07-01 12:32:18 -07:00
Baizhou Zhang 677a11bfa9 [Doc] Tiny update dsv4 doc (#29827) 2026-07-01 01:47:35 -07:00
Baizhou Zhang cc238270b1 Update GLM tests to 5.2 and delete redundant tests (#29686) 2026-06-29 23:04:26 -07:00