Commit Graph
100 Commits
Author SHA1 Message Date
Baizhou Zhang ea879c7739 [Minor] Correct sglang version when installing from source (#17315) 2026-01-18 19:36:16 -08:00
Baizhou Zhang 8b9e9357fe [2/n] deepseek_v2.py Refactor: Migrate MHA forward method in deepseek_v2.py (#16817) 2026-01-17 09:36:25 +08:00
Baizhou Zhang a04675892e Update flashinfer to 0.6.1 (#15551) 2026-01-17 00:48:30 +08:00
Baizhou Zhang 8b99af9af8 [Doc] Tiny update Cuda 13 environment instructions (#17174) 2026-01-16 06:12:26 +08:00
Baizhou Zhang f9fc50acd6 [Tiny] Rename test_sparse_flash_attn.py to fix CI (#16895) 2026-01-11 18:18:29 +08:00
Baizhou Zhang 8b5d426340 [CI]Move fa4 e2e test to 4-gpu-b200 runner (#16889) 2026-01-11 15:53:38 +08:00
Baizhou Zhang 9fd2358cc2 Update Cutedsl version and pin cuda-python version (#16838) 2026-01-10 17:08:43 +08:00
Baizhou Zhang 7f393d9512 [Docker] Add nightly dev docker for Cuda 13 (#16862) 2026-01-10 14:56:53 +08:00
Baizhou Zhang 94fc26aad8 [Doc]Update note for Cuda 13 container usage (#16805) 2026-01-10 14:03:19 +08:00
Baizhou Zhang 38dc5839dd [1/n]deepseek_v2.py Refactor: attention backend handlers and forward method definition (#16306) 2026-01-08 09:22:31 +08:00
Baizhou Zhang 153c69f63d [CI] Enable dpsk v31 test on nightly H200 (#16660) 2026-01-07 23:21:19 +08:00
Baizhou Zhang 7d757d6f17 Clean Some Environment Variables for DeepSeek V32 (#15938) 2026-01-07 14:00:16 +08:00
Baizhou Zhang 6ffe1fc02f [Fix]Pin mooncake version to 0.3.7.post2 in grace blackwell (#16502) 2026-01-06 14:11:40 +08:00
Baizhou Zhang bb23a8fe77 [Tiny]Remove progress bar for fp8 ue8m0 quant when unneeded (#16177) 2026-01-03 10:54:12 +08:00
Baizhou Zhang f07e76b229 Multiple refactors of DeepSeek V32 and context parallel (#16305) 2026-01-03 02:21:22 +08:00
Baizhou Zhang 70a769bc56 Fix NPU docker release workflow (#16253) 2026-01-01 10:53:45 +08:00
Baizhou Zhang e47afa0237 [DP]Fix sync bubble in adjust_num_token_non_padded_for_attn_tp (#16178) 2025-12-31 17:58:18 +08:00
Baizhou Zhang f35b5da521 [CI] Append test variant name to markdown report header in nightly test (#16166) 2025-12-31 00:09:24 +08:00
Baizhou ZhangandKangyan Zhou 98225be6e5 [CI] Fixing release with cut branch workflow (#16153)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
2025-12-30 17:18:02 +08:00
Baizhou Zhang 208e6a9dac [Doc]Update MTP moe backends for EP document (#16013) 2025-12-28 19:36:23 +08:00
Baizhou Zhang 656f4d69a1 Refactor fp8 nextn layer for DeepSeek nvfp4 checkpoint (#15353) 2025-12-28 11:57:09 +08:00
Baizhou Zhang 468931b572 [Tiny]Move deepseek fp4 cutlass moe test to per-commit test (#15565) 2025-12-21 18:08:07 -08:00
Baizhou Zhang 2b0ddf89f5 [Tiny]Add warning for deepgemm on Blackwell (#15352) 2025-12-18 13:45:26 -08:00
Baizhou Zhang 8451e22758 [DeepSeek-V32]Update nightly performance benchmark (#15308) 2025-12-17 11:25:31 -08:00
Baizhou Zhang d92c1f8cbd Fix lora doc (#15282) 2025-12-16 15:53:38 -08:00
Baizhou Zhang 28a19e494b Fix lint (#15281) 2025-12-16 13:36:01 -08:00
Baizhou Zhang 0261c4aff7 [misc] Upgrade cutedsl to 4.3.1 (#14857) 2025-12-16 12:11:56 -08:00
Baizhou Zhang c843419562 Remove duplicate bs=1 in nightly benchmark (#15162) 2025-12-15 22:09:22 -08:00
Baizhou Zhang ab3ffd1c8e Add nightly accuracy test for DeepSeek V3.2 (#14935) 2025-12-13 12:11:16 -08:00
Baizhou Zhang 8698867479 [CI]Add gb200 runner back (#15024) 2025-12-12 20:19:34 -08:00
Baizhou Zhang 7dcad45cad [CI] Temp disable gb200 test (#14865) 2025-12-10 19:05:16 -08:00
Baizhou Zhang e5201bda34 [CI] Unblock gb200 cutedsl test (#14469) 2025-12-08 17:58:25 -08:00
Baizhou Zhang 6799847ebf [CI]Unblock and split spec v2+dp test (#14551) 2025-12-07 17:39:25 -08:00
Baizhou Zhang 673c11ba73 [Minor] Temporarily skipping deepep large mtp test (#14586) 2025-12-07 13:59:16 -08:00
Baizhou Zhang 9dfa01a435 [Misc]Register and refactor some environs for dpsk-fp4 and DeepEp (#14538) 2025-12-06 12:29:16 -08:00
Baizhou Zhang bc388471d2 [1/n] Fix hanging during DeepGemm Warmup (#14493) 2025-12-06 10:44:02 -08:00
Baizhou Zhang 42fcf5438f Revert "tiny remove deprecated endpoint call" (#14533) 2025-12-05 23:48:54 -08:00
Baizhou Zhang 80a575e4e8 Add YAMY1234 to CI Permission (#14475) 2025-12-04 21:25:49 -08:00
Baizhou ZhangandXinyuan Tong 7e78825d5a [Tiny]Small fixes in deepseek v32 doc (#14372)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2025-12-03 11:35:40 -08:00
Baizhou Zhang 4bcc5879af [Doc] Fix DeepSeek V32 Doc (#14336) 2025-12-02 21:06:55 -08:00
Baizhou Zhang 922054079c [Doc] Update DeepSeek-V3.2 document (#14321) 2025-12-02 18:19:39 -08:00
Baizhou Zhang 03888b9de5 [Minor] Upgrade cutedsl version in Dockerfile (#13968) 2025-12-01 17:15:26 -08:00
Baizhou Zhang eb5008846a [CI] Fix test_deepep_large.py (#14247) 2025-12-01 15:18:48 -08:00
Baizhou Zhang f1115cf58d Revert "[Minor]Raise Error when deepep num dispatch token per rank is smaller than cuda graph bs" (#14171) 2025-11-30 12:49:46 -08:00
Baizhou Zhang 7b03cc6482 [Minor]Raise Error when deepep num dispatch token per rank is smaller than cuda graph bs (#14065) 2025-11-30 10:11:42 -08:00
Baizhou Zhang 051ad83347 [chore] Arrange NV packages in Dockerfile (#13749) 2025-11-27 18:08:27 -05:00
Baizhou Zhang 7ab548ef64 [2/2] Refactor DeepGeem requant for FP8 FusedMoE on Blackwell (#13960) 2025-11-27 09:00:26 -05:00
Baizhou Zhang 8a9b8b8457 Revert "Fix nightly test failures: NSA indexer dtype and CPP radix cache init" (#14015) 2025-11-26 10:45:23 -08:00
Baizhou Zhang 873382a910 [Tiny]Upgrade README for sgl-kernel (#13945) 2025-11-25 16:46:30 -08:00
Baizhou Zhang 808b6dfdea [Minor] Fix lint (#13938) 2025-11-25 10:57:23 -08:00
Baizhou Zhang 04b52fa8d6 [chore]Upgrade flashinfer to 0.5.3 (#13751) 2025-11-23 23:38:36 -08:00
Baizhou Zhangandfy1214 4683e244fe [1/2] Refactor DeepGeem requant for FP8 Linear on Blackwell (#13601)
Co-authored-by: fy1214
2025-11-23 16:07:56 -08:00
Baizhou Zhang c9bd1aca32 [CI] Tiny refactoring sgl-kernel tests (#13813) 2025-11-23 12:45:17 -08:00
Baizhou Zhang 8bfce9b08d [Tiny] Renaming environ for NVFP4 dispatch (#13756) 2025-11-22 00:05:20 -08:00
Baizhou Zhang 9f59194f29 [Fix] Fix DeepSeek V3 MTP on B200 (#13548) 2025-11-18 16:30:26 -08:00
Baizhou Zhang 10969ae4be [chore] Disable ccache for sgl-kernel release (#13541) 2025-11-18 14:28:58 -08:00
Baizhou Zhang 85ae508e8b Add bfloat16 tuned fused moe config for Dpsk-MTP layer on B200 (#13455) 2025-11-17 17:44:31 -08:00
Baizhou Zhang d64dd3e18e [Tiny]Fix 1-gpu nightly test bugs (#13389) 2025-11-16 15:54:17 -08:00
Baizhou Zhang 3ccd7fa669 [CI] Fix B200 CI (#13387) 2025-11-16 15:13:57 -08:00
Baizhou Zhang 10285ec204 [Misc]Add date to cu13 dev image tag (#13316) 2025-11-14 19:42:50 -08:00
Baizhou Zhang 8ece99a9dc [CI] Update job dependency and move dpsk v3.2 tests to 8-gpu suite (#12942) 2025-11-11 23:16:47 -08:00
Baizhou Zhang 99e25805f5 [Fix] Fix nan error for large scale ep (#12866) 2025-11-11 14:44:57 -08:00
Baizhou Zhang 5f02b918ec [Fix] Fix trtllm-mla backend when chunked prefix cache is disabled (#12361) 2025-11-08 15:10:25 -08:00
Baizhou Zhang e039ff382c [CI] Fix huggingface access for test_flash_attention_4.py (#12846) 2025-11-07 20:07:06 -08:00
Baizhou Zhang bb6a21cd99 [Fix]Tiny fix in Dockerfile (#12748) 2025-11-05 21:04:33 -08:00
Baizhou Zhang 3c0a6df82d [chore] Fix triton installation for cu13 image (#12742) 2025-11-05 20:20:18 -08:00
Baizhou Zhang 9a954982de [chore] SGLang tag management in Dockerfile (#12734) 2025-11-05 19:03:26 -08:00
Baizhou Zhang 9ec6031d70 [chore]Remove dockerfile from target file of bump kernel version (#12728) 2025-11-05 18:01:19 -08:00
Baizhou Zhang 7c45b8b4bb [CI] Fix qwen3-vl lora nightly ci (#12708) 2025-11-05 11:00:13 -08:00
Baizhou Zhang d22d044734 Revert "Enable memory saver for hybrid model" (#12648) 2025-11-04 16:22:06 -08:00
Baizhou Zhang 42889acbd0 [hotfix] Fix deepep w4a8 bug (#12642) 2025-11-04 13:55:59 -08:00
Baizhou Zhang 15efbcb4e7 [chore] Fix update_kernel_whl_index script for multiple cuda version (#12519) 2025-11-03 16:34:14 -08:00
Baizhou Zhang 6e29446e45 [hotfix] Remove flashinfer-jit-cache from pyproject (#12530) 2025-11-02 22:11:05 -08:00
Baizhou Zhang 9a512cf95b [CI] Move some Lora/Deterministic CI tests to nightly (#12507) 2025-11-01 19:54:22 -07:00
Baizhou Zhang 2b7bf11bd2 [Hotfix] Remove extra comment in sgl-kernel README (#12500) 2025-11-01 12:22:45 -07:00
Baizhou Zhang 566ade0388 [CI] Build aarch64 kernels for sgl-kernel test (#12480) 2025-11-01 11:55:42 -07:00
Baizhou Zhang 5f98b7fe61 [CI] Fix kernel installation on aarch runners (#12475) 2025-10-31 14:25:27 -07:00
Baizhou Zhang 57cc5385c0 [CI] Add more bins for 1-gpu CI test (#12422) 2025-10-31 00:05:01 -07:00
Baizhou Zhang b7fdde4bb4 [ci] Fix ci_install_deepep (#12375) 2025-10-30 11:39:14 -07:00
Baizhou Zhang 621dfb8886 Import flash_mla from sgl-kernel (#12135) 2025-10-29 23:54:21 -07:00
Baizhou Zhang 685c06451f [ci] Try fixing broken CIs (#12317) 2025-10-29 01:13:51 -07:00
Baizhou Zhang 587deb15a7 [hotfix] Fix pytest not found in CI (#12311) 2025-10-29 11:07:36 +08:00
Baizhou Zhang 75c09e1ffe [Fix] Fix cu130 sgl-kernel wheel renaming (#12173) 2025-10-26 22:44:05 -07:00
Baizhou Zhang 97828878d8 [Doc] Small update of DeepSeek v3.2 document (#12138) 2025-10-25 20:34:05 -07:00
Baizhou Zhang bcecf27e7c [Doc] Fix format for deepseek v3.2 document (#12130) 2025-10-25 15:07:50 -07:00
Baizhou Zhang 4b0ac1d52a Update sgl-kernel version to 0.3.16.post4 (#12125) 2025-10-25 14:33:33 -07:00
Baizhou Zhang 8e987fa2a3 Update document index for DeepSeek-v32 docs (#12101) 2025-10-25 13:38:58 -07:00
Baizhou Zhang ce86979355 [Fix] Set global args in cpu test (#12105) 2025-10-24 21:46:17 -07:00
729b242934 [Doc] Add documentation for DeepSeek V3.2 (#11877)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>
2025-10-24 19:06:22 -07:00
Baizhou Zhang 4ef981e2b6 Revert "[Fix] Fix lint to pass CI" (#12042) 2025-10-23 19:44:58 -07:00
Baizhou Zhang 69ed8b67a8 [Fix] Fix lint to pass CI (#12037) 2025-10-23 19:39:38 -07:00
Baizhou Zhangandgemini-code-assist[bot] 983ef22cf3 [Doc] Update deterministic inference flag in server_arguments.md (#11978)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-10-22 14:12:15 -07:00
Baizhou Zhang ef4a8097b8 Rename flashmla kernel options of nsa backend for better readability (#11876) 2025-10-21 13:14:16 -07:00
Baizhou Zhang ebff4ee648 Update sgl-kernel and remove fast hadamard depedency (#11844) 2025-10-21 13:13:54 -07:00
Baizhou Zhang 44f0ece9fc [Doc] Update documents for FA4 (#11778) 2025-10-19 17:40:38 -07:00
Baizhou Zhang cbb5fc2edc [CI] Add CI test for DeepSeek V3.2 MTP (#11835) 2025-10-19 17:00:25 -07:00
Baizhou Zhang 20b8d2306c Cleaning indexer for DeepSeek V3.2 (#11682) 2025-10-17 13:47:21 -07:00
Baizhou Zhang b0d1d717e1 Revert "make radix cache deterministic" (#11728) 2025-10-16 14:36:15 -07:00
Baizhou Zhang c224a4c6cc Fix log for chunked prefix cache (#11624) 2025-10-14 11:49:33 -07:00
Baizhou Zhang 9f1f699a7a [CI] Add Basic Test for DeepSeek V3.2 (#11308) 2025-10-13 11:41:02 -07:00