Commit Graph
17676 Commits
Author SHA1 Message Date
xiaobochen-amdandZhang, Jiejing 030d7e7e9b [ROCm] Define the DSA head-gate graph helpers on HIP (#37118)
Co-authored-by: Zhang, Jiejing <jiejing.zhang@amd.com>
2026-09-02 22:55:45 -07:00
Zaili Wang 4b0edb25f2 [CPU] Update base image to Ubuntu 26.04 (#35313) 2026-09-03 12:42:14 +08:00
Liangsheng Yin 54da74e83e [Fix] Broadcast PP dynamic-chunk profiling failures so every rank disables together (#37675) 2026-09-02 21:09:04 -07:00
Yash Akhauri 98ef7d8ae6 docs: add K2 Horizon cookbook recipes and H200 results (#37655) 2026-09-03 11:52:05 +08:00
Liangsheng Yin 49e6e81830 [CI] Accept t64-suffixed apt packages in the install skip check (#37689) 2026-09-02 20:51:47 -07:00
hhhh1252023 81b0e4985a Modify KUBE_JOB_NAME to fix the problem of the string being too long (#37572) 2026-09-03 11:43:36 +08:00
Khoa PhamandClaude Opus 5 cf3173aeb9 [Perf] Walk the radix tree by offset instead of re-slicing token storage (ported from #36507) (#37324)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-03 11:13:03 +08:00
Alex NailsandClaude Opus 5 57c26a84e0 [chore] Add .git-blame-ignore-revs for the black -> ruff-format reformat (#37210) (#37695)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-02 20:01:48 -07:00
James Liu 4229088a48 feat(kernels): generalize persistent CuTe JIT cache (#33911) 2026-09-02 19:59:04 -07:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-09-02 19:46:08 -07:00
2641e427be Xpu/weekly simple model enablement 2026 08 30 (#37193)
Co-authored-by: dayanandav <dayananda.vasantha.kumar@intel.com>
Co-authored-by: Girijala, Pavan Sivaram <pavan.sivaram.girijala@intel.com>
Co-authored-by: Cui, Lily <lily.cui@intel.com>
Co-authored-by: Juan Muneton <juan.muneton.gallego@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
2026-09-03 09:35:59 +08:00
Liangsheng Yin a522c8a4b6 [misc] Extract PP dynamic chunk sizing into a DynamicChunkSizer scheduler component (#37674) 2026-09-02 18:35:43 -07:00
Mick 0dd66def7c [chore] harden checkpoint quantization metadata parsing (#36922) 2026-09-03 09:27:22 +08:00
fbf909b460 [Fix] Alpha-channel images and tool-result media ordering (port of #36507) (#37320)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-09-02 18:23:06 -07:00
Lee NauandYangmin Li 6e41f1ad29 [Fix] Preserve FP32 in SM107 MXFP8 fallback (#37489)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
2026-09-02 17:55:14 -07:00
Shiyan DengandLianmin Zheng 80e8302d03 Add SGLANG_CRASH_ON_JIT_COMPILE to forbid on-the-fly JIT compilation (#36615)
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-09-02 17:26:25 -07:00
87d60a2229 Improve CUDA graph and speculative execution output handling (#37329)
Co-authored-by: jiayisuse <jiayisuse@fb.com>
Co-authored-by: Yinghai Lu <yinghai@meta.com>
Co-authored-by: Hao Zhang <zhisbug@users.noreply.github.com>
Co-authored-by: Yichao Fu <yichaofu@meta.com>
2026-09-02 17:25:27 -07:00
Alison Shao db1eb48651 [CI] Graceful teardown for the PD and HiSparse server fixtures (#37485) 2026-09-02 17:22:18 -07:00
ff04a00d73 Reduce tokenizer overhead and offload CUDA VMM publication (#37330)
Co-authored-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Yinghai Lu <yinghai@meta.com>
2026-09-02 17:21:08 -07:00
Oguz Ulgen f15748d965 [bench] Support real-traffic replay with early-stop-aware steady-state metrics in bench_one_batch_server (#37469) 2026-09-02 17:20:25 -07:00
Liangsheng Yin 5c46ce37f5 [Fix] Apply the attention-CP broadcast result in PP dynamic-chunk profiling (#37669) 2026-09-02 17:20:07 -07:00
Xinyuan Tong 3421d4375b [Docs] GLM-5.3-Flash cookbook: drop stale EP caveat, add B300/H100/B200 FP8 speed data (#37576) 2026-09-02 17:16:23 -07:00
Byron HsuandByronHsu 046cdaabaa [Sampling] Capture masks from sampler support (#36630)
Co-authored-by: ByronHsu <ByronHsu@users.noreply.github.com>
2026-09-02 17:13:28 -07:00
Cheng WanandClaude Opus 5 5ddca6819e Fix unified SWA: size a non-owner's v2p by the id space it must address (#37560)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-02 16:56:18 -07:00
Cheng WanandClaude Opus 5 5a1275a519 Converge the two SWA predicates, and stop conditioning the capture sink on the pool (#37550)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-02 16:55:46 -07:00
Cheng WanandClaude Opus 5 d9848b9ecd Build the unified read stream directly, without the page-table rectangle (#37512)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-02 16:55:16 -07:00
Cheng WanandClaude Opus 5 18d5ffb42a Size the unified read-table grid from bs, and fuse the allocator's tombstone scatters (#37511)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-02 16:54:26 -07:00
c05f8ae830 [PD] Optimize paged allocator free-list release (#37146)
Co-authored-by: wangwenming.41 <wangwenming.41@jd.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-09-02 16:51:37 -07:00
Liangsheng Yin 4bc34117f1 [CI] Install lmms-eval from PyPI, drop human-eval install, add clone token fallback (#37672) 2026-09-02 16:23:10 -07:00
Alison Shao a6da3a4922 [CI] Re-enable GB300 jobs (#37522) 2026-09-02 16:15:40 -07:00
Mohammad Miadh Angkad 718bd39fe0 [Fix] DP attention: correct the decode->extend prefix off-by-one (#37505) 2026-09-02 16:14:16 -07:00
paulzhang-tmandQiaolin-Yu 3fa6b86504 [Spec] Publish the final multi-layer EAGLE shared-read event (#36752)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2026-09-02 15:57:50 -07:00
eeechoandBaizhou Zhang 19c30dff56 [SM120] DeepSeek-V4: DeepGEMM paged-MQA indexer +FP4 MoE+ page-split (#29927)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-09-02 15:49:59 -07:00
YAMY 982aa8acfc [Bugfix] Load Qwen3.5 MTP embedding under PP (#37471) 2026-09-02 15:19:40 -07:00
YAMY 3c9cea8f10 [EAGLE] Prune draft-extend logits to selected rows (#35546) 2026-09-02 15:10:08 -07:00
YAMY fe45af1e6f perf(gdn): select ReplaySSM verify loop unrolling by shape (#36970) 2026-09-02 15:07:49 -07:00
Faradawn Yang 9c70d22721 Update GLM-5.2 NVFP4 B200/B300 for AgentX HiCache (#35368) 2026-09-02 14:39:09 -07:00
cctry 3a855b050a fix(disagg): poll receivers during decode preallocation (#37483) 2026-09-02 14:26:40 -07:00
cctry ad6e830858 [Bugfix] Key CUDA graph dedup signatures on kernel function identity (#37657) 2026-09-02 14:24:31 -07:00
Liangsheng Yin 19c7679e9e [mem_cache] Make free_swa sync-free on page_size == 1 (#36723) 2026-09-02 14:18:22 -07:00
JoeandBBuf acea43079f Fix native MoE handling of noncontiguous top-k IDs (#36407)
Co-authored-by: BBuf <1182563586@qq.com>
2026-09-02 14:16:19 -07:00
Liangsheng Yin 2d799c28f4 [CI] Authenticate and retry git clones in install scripts (#37647) 2026-09-02 13:21:26 -07:00
f8cbf000f4 [AMD] Enable FP4 indexer for Deepseek V4 (#37353)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: AMD-yanfeiwang <256076023+AMD-yanfeiwang@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-09-02 09:45:08 -07:00
Mick f6aed6ec53 [diffusion] doc: rewrite stale diffusion compatibility matrix (#36987) 2026-09-02 23:42:54 +08:00
Kevin MiandClaude Fable 5 f586654518 [diffusion] feat: support FastH3 (4-step VSA-distilled MiniMax-H3) with a VSA-H3 attention backend (#37480)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-09-02 21:39:54 +08:00
YC Yen-Ching TsengandChen 99b9109553 [AMD] Run ROCm 7.0 shadow tests every two days- #37582 (#37586)
Co-authored-by: Chen <bingxche@amd.com>
2026-09-02 17:51:16 +08:00
Liangsheng Yin 862a909a08 [Fix] Lock PP dynamic-chunk profiling requests before releasing through the tree cache (#37509) 2026-09-02 02:09:01 -07:00
Liangsheng Yin ebfd8c60e5 [CI] Install sgl-eval from PyPI through the test extra (#37504) 2026-09-02 01:45:25 -07:00
Shuwen WangandClaude Opus 5 fe3d4b9bbb fix: restore missing get_component_forced_attn_backend import in minimax_h3 (#37566)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-02 15:58:31 +08:00
4b329482e8 [diffusion] feat: support cube sparse attention for minimax h3 (#34893)
Co-authored-by: zhenaozhenfu <zhenaozhenfu@minimaxi.com>
Co-authored-by: Reynor <reynor@minimaxi.com>
2026-09-02 15:21:33 +08:00