Commit Graph
100 Commits
Author SHA1 Message Date
Baizhou Zhang 2d88c79b3e [CI] Add Kimi-K3 MMMU-Pro accuracy coverage (#36284) 2026-08-25 16:33:46 -07:00
Baizhou Zhang 833be86c15 [CP V1 Deprecation 1/5] Migrate tests to strategy-based prefill CP (#36222) 2026-08-24 20:15:34 -07:00
Baizhou Zhang 3b5909de0e [DeepSeek V4] Add W4A4 MegaMoE server flag (#35918) 2026-08-21 18:44:18 -07:00
Baizhou Zhang 60ff1e33a5 [DeepSeek V4] Default FP4 checkpoints to FlashInfer MXFP4 MoE (#35919) 2026-08-21 16:48:58 -07:00
Baizhou Zhang 92eeed41d7 [Docker] Defer CUDA 13 NCCL override until after dependency resolution (#35756) 2026-08-20 14:48:07 -07:00
Baizhou Zhang d287880a7a Update deepep for SBO feature (#35450) 2026-08-19 23:37:13 -07:00
Baizhou Zhang cfc6dfb364 Apply latest DeepEP branch (#34923) 2026-08-18 16:24:50 -07:00
Baizhou Zhang b814a7e812 [CI] Skip fast-fail for scheduled stages (#35392) 2026-08-18 15:07:33 -07:00
Baizhou Zhang 5b60b7c651 [DSV4] Turn on mhc post pre fusion by default (#35214) 2026-08-18 00:03:37 -07:00
Baizhou Zhang 53621818e4 [Docs] Enable PD disaggregation for DSV4 low-latency recipes (#35224) 2026-08-17 20:07:27 -07:00
Baizhou Zhang c2c1c4d3eb [CI] Move DSA PD+MTP+CP Layersplit test to basic B300 test suite (#35220) 2026-08-17 17:44:31 -07:00
Baizhou Zhang bc312d185d Clean deprecated DeepSeek V4 Environs (#34926) 2026-08-17 16:07:00 -07:00
Baizhou Zhang e161bd1265 Fix Python packaging shadowing in DeepEP wheel builds (#34937) 2026-08-15 03:27:32 -07:00
Baizhou Zhang 8d44091326 Update sgl-deep-ep release workflow for DeepEP v2 (#34914) 2026-08-15 02:08:28 -07:00
Baizhou Zhang 7769f54feb [Kimi-K3] Use explicit SiTU activation for MegaMoE (#34883) 2026-08-15 01:41:59 -07:00
Baizhou Zhang a1844709f1 [CI] Trim Qwen3.5 FP8 GB300 performance batches (#34882) 2026-08-14 16:45:11 -07:00
Baizhou Zhang 8b4faa3336 [Docs] Update Kimi-K3 installation options (#34886) 2026-08-14 16:19:23 -07:00
Baizhou Zhang 0a6bbbe128 [Fix] Restore layer-level DSV4 RoPE policy (#34788) 2026-08-13 21:26:45 -07:00
Baizhou Zhang 9c0d4cba3f [CI] Split Kimi K2.5 performance batches by config (#34669) 2026-08-13 03:20:50 -07:00
Baizhou Zhang 273d978bed [CI] Use default installer for B300 tests (#34635) 2026-08-12 16:21:40 -07:00
Baizhou Zhang 983dfd6a9a [Misc] Sanitize the structure of environ.py (#34472) 2026-08-11 16:31:33 -07:00
Baizhou Zhang b498f46271 [CI] Add MegaMoE runner compatibility alias (#34326) 2026-08-10 19:47:38 -07:00
Baizhou Zhang a92bbf2f24 docs: remove DSV4 low-latency chunked prefill size (#34333) 2026-08-10 17:23:43 -07:00
Baizhou Zhang 56e8bb49b8 fix(ci): constrain NeMo Skills evaluator dependencies (#34322) 2026-08-10 16:56:46 -07:00
Baizhou Zhang c9444deef4 Docker: install DeepEP from release wheels (#34041) 2026-08-07 23:51:09 -07:00
Baizhou Zhang eb3cc879e0 Install DeepEP from release wheels (#33932) 2026-08-07 15:38:44 -07:00
Baizhou Zhang 8fc66d1a62 docker: pin Kimi images to SGLang commit (#34030) 2026-08-07 14:49:26 -07:00
Baizhou Zhang 8a22b8305d docker: add Kimi K3 artifacts and build hpc-ops with C++20 (#33956) 2026-08-07 13:50:44 -07:00
Baizhou Zhang 5e60363960 Fix prefill CP graph overflow with larger bucket search (#33906) 2026-08-07 01:33:14 -07:00
Baizhou Zhang e0af47b03e Fix sgl-deep-ep builder dependencies (#33866) 2026-08-06 16:30:02 -07:00
Baizhou Zhang ba9074035a Build and release sgl-deep-ep wheels (#33498) 2026-08-06 02:07:36 -07:00
Baizhou Zhang 0e584529f5 [CI] Remove profiling from nightly tests (#33832) 2026-08-06 01:16:08 -07:00
Baizhou Zhang 5d1a0c7129 Revert "Warn on risky serving-time Triton work" (#33826) 2026-08-05 23:36:10 -07:00
Baizhou Zhang f9b954ddb1 [CI] Temporarily disable prefill cuda graph for qwen3.5 nightly test (#33772) 2026-08-05 18:52:57 -07:00
Baizhou Zhang 070fde72bf [CI] Remove some unneeded CP tests (#33763) 2026-08-05 16:07:14 -07:00
Baizhou Zhang 25035bff8d Use main branch in Kimi Dockerfiles (#33760) 2026-08-05 15:33:14 -07:00
Baizhou Zhang 87ed82ff7e Remove custom all-reduce disable from Kimi-K3 B300 recipe (#33612) 2026-08-04 16:07:31 -07:00
Baizhou Zhang 6808c6d571 [Tiny] Little enhancement of Kimi-K3 test (#33609) 2026-08-04 15:36:41 -07:00
Baizhou Zhang eb31a53338 Revert "Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120" (#33455) 2026-08-03 19:03:56 -07:00
Baizhou Zhang 7f6a2e2b50 [Refactor] Clean up and split DSA indexer (#33443) 2026-08-03 18:05:01 -07:00
Baizhou Zhang 0bf0640b9d [CP] Support breakable CUDA graphs for zigzag strategy (#33136) 2026-08-02 23:11:57 -07:00
Baizhou Zhang e824b24250 [CP] Fuse zigzag attention into a single call (#33137) 2026-08-02 20:46:42 -07:00
Baizhou Zhang e1964da451 [Docs] Add RTX 5090 DeepSeek-V4 recipe (#33157) 2026-07-31 19:04:23 -07:00
Baizhou Zhang fd28242b68 [CI] Pin NCCL ports for GB300 PR tests (#33044) 2026-07-31 02:28:37 -07:00
Baizhou Zhang d12ea3e9ba docker: add Kimi K3 images (#32760) 2026-07-29 03:02:28 -07:00
ef6c07008b Support DCP for Kimi Linear model (#32612)
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
2026-07-28 22:59:58 -07:00
Baizhou Zhang b21cc8eb9b [misc] Update CodeOwner (#32717) 2026-07-28 19:55:14 -07:00
Baizhou Zhang 082b2a10b6 Add local ZIP uploader for whl releases (#32489) 2026-07-27 00:03:59 -07:00
Baizhou Zhang f15b43242b Bump sgl-deep-gemm to 0.1.5 (#32345) 2026-07-24 14:03:38 -07:00
Baizhou Zhang 3d0c6bf57f [Fix] Fix trtllm_mla backend + fp8 kv cache without rope (#32181) 2026-07-23 14:55:18 -07:00
Baizhou Zhang ed26a111b2 Revert "docker: install dynamo nightly in the dev image for rapid iteration/testing" (#32257) 2026-07-23 14:51:43 -07:00
Baizhou Zhang 20f6a416e7 [Tiny] Skip sm120 deepgemm test temporarily (#32193) 2026-07-23 02:54:58 -07:00
Baizhou Zhang 5387e23ecd [Tiny]Correct runner for testing deepgemm (#32174) 2026-07-23 01:13:14 -07:00
Baizhou Zhang fc0cbb795d [Misc] Add sm120 tests to DeepGemm release pipeline (#31841) 2026-07-21 22:19:23 -07:00
Baizhou Zhang 9668d9ea72 Support GPT-OSS zigzag CP with TRTLLM-MHA (#31732) 2026-07-20 00:48:04 -07:00
Baizhou Zhang 7a03d30149 Support MiMo V2.5 with zigzag context parallelism (#29972) 2026-07-19 02:36:40 -07:00
Baizhou Zhang 38b29dcd6c Fix SM120 NVFP4 KV cache test OOM (#31653) 2026-07-18 00:53:47 -07:00
Baizhou Zhang 304a529558 Revert "Bump FlashInfer to 0.6.15 and revert regressions" (#31625) 2026-07-17 16:46:33 -07:00
Baizhou Zhang eaeb779ea4 [Doc] Update GLM5.2 Cookbook with LayerSplit usage (#31577) 2026-07-17 02:25:50 -07:00
Baizhou Zhang e835512303 Add nightly test for GLM5.2 LayerSplit (#31512) 2026-07-17 00:29:14 -07:00
Baizhou Zhang 82e7cdcff9 [Misc] Remove a few dead code paths in DSA (#30973) 2026-07-12 23:25:03 -07:00
Baizhou Zhang e1d51be91f [Tiny] Fix a typo in cookbook (#30837) 2026-07-10 21:47:35 -07:00
Baizhou Zhang 07165d5daa Add DCP to runtime parallel context (#30478) 2026-07-10 21:23:41 -07:00
Baizhou Zhang e8646701c1 Update GLM-5.2 NVFP4 cookbook (#30826) 2026-07-10 15:56:32 -07:00
Baizhou Zhang 3f1694f5e0 Update sgl-deep-gemm to 0.1.4.post1 (#30697) 2026-07-10 13:30:43 -07:00
2c6cd1ef41 [Dep] Upgrade flashinfer to 0.6.14 (#29910)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-07-09 17:52:33 -07:00
Baizhou Zhang 7e936f690e [Tiny] Fix Lint in #30645 (#30699) 2026-07-09 15:30:48 -07:00
Baizhou Zhang 2b3d9ad375 [Tiny] Fix docstring in CP abstractions (#30579) 2026-07-08 18:41:40 -07:00
Baizhou Zhang fa278a762c Fix FA3 prefill CP NaNs (#30439) 2026-07-07 20:16:09 -07:00
Baizhou Zhang 946804e042 Disable FA3 sparse mask kernels by default (#30356) 2026-07-07 01:46:44 -07:00
Baizhou Zhang 5eb1b6a7ba Remove retired DSA env paths (#29912) 2026-07-05 22:58:02 -07:00
Baizhou Zhang e552f6ed75 [Fix] Fix DSA indexer fusion for NeoX RoPE (#30111) 2026-07-04 03:20:55 -07:00
Baizhou Zhang 1f0f353d92 [CI] Add GLM52 NVFP4 MTP B200 tests (#30021) 2026-07-03 13:43:38 -07:00
Baizhou Zhang e3258d3b54 [Fix] Turn off dsa indexer fusion by default (#30018) 2026-07-03 01:08:06 -07:00
Baizhou Zhang c312cdd3a7 Upgrading tvm-ffi/sgl-deep-gemm/tilelang (#29554) 2026-07-01 12:32:18 -07:00
Baizhou Zhang 677a11bfa9 [Doc] Tiny update dsv4 doc (#29827) 2026-07-01 01:47:35 -07:00
Baizhou Zhang cc238270b1 Update GLM tests to 5.2 and delete redundant tests (#29686) 2026-06-29 23:04:26 -07:00
Baizhou Zhang 12f76d115c Update GLM-5.2 B300 and GB300 NVFP4 cookbook settings (#29466) 2026-06-26 16:15:33 -07:00
Baizhou Zhang 73741f7074 Bypass legacy GLM DSA layer types validation (#29454) 2026-06-26 15:24:16 -07:00
Baizhou Zhang 3344b73c80 Add DeepSeek V4 Pro GB300 nightly and expand Kimi K25 nightly test (#28103) 2026-06-25 12:13:52 -07:00
Baizhou Zhang e3026ef016 [3/N][CP] Implement zigzag CP strategy (#28421) 2026-06-18 15:10:30 -07:00
Baizhou ZhangandShijin 4b817f5d7f Upgrade fa3 hash (#28394)
Co-authored-by: Shijin <dovis.zhang02@gmail.com>
2026-06-17 13:32:11 -07:00
Baizhou Zhang 27291118b9 Upgrade sgl-deep-gemm to 0.1.3 (#28402) 2026-06-16 23:06:36 -07:00
Baizhou Zhang 77f327cb6e [2/n] [CP] Add context parallel strategy abstractions (#27313) 2026-06-16 00:20:04 -07:00
Baizhou Zhang 4c0457f440 [misc] Update codeowner (#28342) 2026-06-15 14:42:01 -07:00
Baizhou Zhang a14d1a5656 Add DeepSeek V4 MTP acceptance length checks (#28098) 2026-06-12 18:53:20 -07:00
Baizhou Zhang d26b90cf70 Add weireweire to CI permissions (#27957) 2026-06-11 14:10:45 -07:00
Baizhou Zhang 125ef88892 Disable async assert in Nemotron nightly tests (#27838) 2026-06-10 16:28:14 -07:00
Baizhou Zhang 3c1b0fb226 [1/n] [CP] Simplify prefill context parallel server args (#27312) 2026-06-10 14:11:38 -07:00
Baizhou Zhang 047e5df3b1 Revert "Share BCG output buffers across capture sizes" (#27758) 2026-06-09 20:51:40 -07:00
Baizhou Zhang 9a48bf75f5 Add GB300 base C CI suite (#27427) 2026-06-06 02:27:30 -07:00
Baizhou Zhang e69cc07a60 Remove DeepSeek V4 release Docker workflow (#27404) 2026-06-05 16:49:05 -07:00
Baizhou Zhang cc67f922cd [misc] Update Codeowner for Lora (#27224) 2026-06-03 22:50:15 -07:00
Baizhou Zhang d097cd2212 [GLM-5] Apply trtllm MHA kernel for GLM-5 on Blackwell (#21332) 2026-06-03 17:16:54 -07:00
Baizhou Zhang 68caf49154 Update sgl-deep-gemm to 0.1.2 (#26993) 2026-06-02 13:51:54 -07:00
Baizhou Zhang 2fdae94e46 docs: update RTX PRO 6000 deployment snippet (#26968) 2026-06-01 14:34:27 -07:00
Baizhou Zhang 05bef58297 [Misc] Tiny change default building branch of sgl-deep-gemm (#26699) 2026-05-29 01:18:36 -07:00
Baizhou Zhang 69362cbc2c [Doc] Update benchmark instruction for dsv4 (#26668) 2026-05-28 23:37:35 -07:00
Baizhou Zhang 435c4ffb30 [CI] Clean DeepSeek V4 tests and installation scripts (#26609) 2026-05-28 15:22:59 -07:00
Baizhou Zhang cd65be98df [CP] Add back qwen 30b test (#26604) 2026-05-28 14:34:41 -07:00