Commit Graph
26 Commits
Author SHA1 Message Date
ced5e9fe49 [Kimi] Enable GB300 TP4 and GB200/GB300 TP16 SP collectives (#35330)
Co-authored-by: Ajit Mistry <ajmistry@amistry.nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
2026-09-29 10:18:11 -07:00
eeecho c7be3e935b [SM120] Add optional FlashInfer PCIe-IPC all-reduce for switch-free hosts (#34528) 2026-09-28 23:08:44 -07:00
Caio RochaandCaio Rocha e047e50d4e Add 8-node AllReduce/AllGather and MNVLS algorithm support to MSCCL++ (#37442)
Co-authored-by: Caio Rocha <caiorocha@microsft.com>
2026-09-24 15:51:29 -07:00
Cheng Wan a80055d3c6 [Fix] Broadcast requests along attention CP before attention TP (#41083) 2026-09-24 12:16:27 -07:00
Cheng Wan 2d0e94e3a3 Check the topology identities where the layout is written, and build at the published widths (#40340) 2026-09-21 12:22:59 -07:00
5e9342d16f [PP][DeepSeek V4] Overlap communication and optimize SM120 prefill (#38792)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
2026-09-18 21:18:04 -07:00
Xiaoyu Zhang 986959e3c4 [Refactor] Deduplicate kernel helpers and remove unused code (#40197) 2026-09-19 09:27:30 +08:00
Cheng Wan 406c9c71d8 [Feature] Support BF16 and batch-invariant inference with DeepEP v2 (#38160) 2026-09-15 14:30:50 -07:00
Cheng Wan fa663e7297 config: delete the redundant full stamp in initialize_model_parallel (#39202) 2026-09-12 17:27:21 -07:00
Xiaoyu ZhangandMick Qian 4d23a4fa6d [Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-07 15:13:59 +08:00
sglang-botandsglang-bot 6252993afe chore: update CI test est_time values (#38238)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-09-06 17:49:41 -07:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-09-02 19:46:08 -07:00
3a0f1a1344 [NPU] fix: reach torch>=2.8 CUDA memory-pool APIs lazily via torch._C (#29100)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-29 15:55:14 -07:00
fzyzcjy c56cee0f80 Support gated launch to defer startup memory allocation (#35927) 2026-08-24 20:19:45 +08:00
Xingyu Liuandxingyuliu 7dcaf11987 [Fix] Select custom all-reduce v2 by topology capability (#35061)
Co-authored-by: xingyuliu <xingyuliu@fb.com>
2026-08-18 10:30:10 -07:00
cctry df986c4d5e Consolidate CUDA VMM allocation helpers (#34199) 2026-08-10 18:11:11 -07:00
f9e6888b5a [Distributed] Propagate semantic group names to PyTorch process groups (#32900)
Co-authored-by: jipengtian <jipengtian@xiaohongshu.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-06 20:38:12 -07:00
Liangsheng Yin c0d5ebd6c4 [CI] Move CPU-only unit tests to the CPU suite and trim dead 5090 registrations (#33654) 2026-08-05 01:43:29 -07:00
Xiaoyu ZhangandClaude Opus 4.8 2d1a7be8c4 [Kernel] Reclassify kernel tests by ops group + move helpers out of the package (RFC #29630) (#32128)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 12:18:27 +08:00
Xiaoyu ZhangandClaude Opus 4.8 99f636a86f [Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels (#32072)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 08:35:09 +08:00
Xiaoyu ZhangandClaude Opus 4.8 246b3c3eaf [Kernel] Phase 3+4: move JIT infra + operator groups into sglang.kernels (RFC #29630) (#31666)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-22 11:28:27 +08:00
Michael c546afc147 [AMD] Register 2 CPU/triton unit + kernel tests for AMD 1-GPU PR CI (#31379) 2026-07-17 09:01:46 -07:00
Mick 04af94d150 fix: avoid tilelang cuda runtime pollution (#30870) 2026-07-14 22:30:27 +08:00
Ming Yang 5ae214f18b Extract reusable VMM shareable-handle helpers from register_graph_inputs (#29621) 2026-07-01 14:02:00 -07:00
Yihao Wang f5c9f88ee2 [plugin][distributed] use active platform's backend in get_default_distributed_backend (#23969) 2026-06-11 20:05:17 -07:00
Liangsheng Yin d7e3e54148 [Test] split test/registered/distributed/ into topic folders (#26240) 2026-05-24 17:02:07 -07:00