Commit Graph
17416 Commits
Author SHA1 Message Date
Mick fa474b0441 [diffusion] fix: fix image encoder parallel folding proposal (#36863) 2026-08-29 14:34:36 +08:00
Mick f5319af1c9 [diffusion] chore: honor explicit component offload (#36931) 2026-08-29 14:29:57 +08:00
Liangsheng Yin a25df83fe3 [Cookbook] Run accuracy benchmarks through sgl-eval (#36977) 2026-08-28 23:29:38 -07:00
ishandhanani 4d7d2ebb44 [Docker] Install AI Dynamo nightly (#36946) 2026-08-28 23:27:52 -07:00
Mick d1ce017665 [diffusion] feat: delegate recognized quantized components to transformers (#36902) 2026-08-29 14:26:50 +08:00
Mick 3c1d77be21 [diffusion] feat: respect component weight overrides for upsamplers (#36874) 2026-08-29 14:23:11 +08:00
Mick f93b48c627 [diffusion] refactor: resolve indexed component weight sets (#36883) 2026-08-29 14:21:25 +08:00
zijiecandjacky.cheng 7f2ee22b70 [AMD] Fix eager metadata for AITER EAGLE draft extend (#36915)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-08-28 22:56:38 -07:00
24c9251ac5 [AMD][Spec][PD] Enable the PD DSA fused-TopK seed remap on ROCm (#36714)
Co-authored-by: Tianxiao Jiang <tianxiaojiang@Tianxiaos-MacBook-Pro.local>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-28 22:34:23 -07:00
Liangsheng Yin ec962fd12d [Fix] Fall back to the process-group broadcast for DSA topk when PyNCCL is absent (#36963) 2026-08-28 22:20:35 -07:00
Eric Zhang 3904b309db Add configurable HTTP/2 connection window (#36920) 2026-08-29 13:18:42 +08:00
3760296be8 [PD] Pack DCP1→DCP-N PD KV transfers into dest-contiguous RDMA blocks (#35762)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-28 21:41:30 -07:00
+8 5f216fc33f qwen 3.8 rebase (#35758)
Co-authored-by: cherichy <cherichy@outlook.com>
Co-authored-by: guangyunh-nv <guangyunh@nvidia.com>
Co-authored-by: jiahanc <jiahanc@nvidia.com>
Co-authored-by: jinyangyuan-nvidia <joyuan@nvidia.com>
Co-authored-by: Cheng Hang <chang@nvidia.com>
Co-authored-by: Yicheng Qiang <yqiang@nvidia.com>
Co-authored-by: Sam Li <lsam@nvidia.com>
Co-authored-by: Tom-Zheng <tizheng@nvidia.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: xiaoweiw-nv <xiaoweiw@nvidia.com>
Co-authored-by: Zheng Li <lizheng.cs@zju.edu.cn>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-08-28 20:41:34 -07:00
zhaozx-cn ca8cc101b8 [NPU] add causal conv1d for ascend kda backend (#35021) 2026-08-29 11:39:45 +08:00
Mohammad Miadh Angkad 8a4c517a60 [Docs] Restore the AIME25 label so GLM-5.3 FP8 and BF16 scores render again (#36950) 2026-08-29 11:38:26 +08:00
amote-i 505228823f [NPU] [DOC] udpate supported features on NPU (#36940) 2026-08-29 10:52:01 +08:00
Chunyuan WU 92b0d447b0 [CPU] Fix wrongly causal-masked bidirectional attention (#35434) 2026-08-28 19:49:43 -07:00
amote-i 51c18d9aa8 [NPU] [DOC] update npu best practice (#36476) 2026-08-29 09:38:52 +08:00
Liangsheng Yin 0df69849ba [Fix] Drop the duplicated DSpark draft sample_block call (#36934) 2026-08-28 18:10:41 -07:00
Aurick Qiao 7276a30c45 [Fix] Support LSE on the RadixAttention extra-kwargs graph path (#35453) 2026-08-28 18:04:00 -07:00
Trevor Morris a16872767f Update CUDA 13.4 image to flashinfer 0.6.18rc10, cutedsl 4.8. Fix sgl- wheel unpinning (#36929) 2026-08-28 17:52:15 -07:00
Thomas Wang 89816a21a1 [AMD] Update v4 amd cookbook 0828 (#36828) 2026-08-28 17:20:22 -07:00
Olga Miroshnichenko 36afd70f9c [ROCm][Bugfix] Use token-level KV indices in the aiter ASM context-prefill gather (#36852) 2026-08-28 17:17:18 -07:00
valechenandHAI 4944e50e2c [AMD] Add Work-Centric (Lean) Attention: a persistent-CTA decode kernel for long-context serving (#33576)
Signed-off-by: Valerie Chen <valechen@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-08-28 17:00:44 -07:00
Xiaoyu Zhang db6f0a9d53 Refactor JIT kernel and expert-pack directory layout (#36704) 2026-08-29 07:41:25 +08:00
Xiaoyu Zhang 50bc1a3767 [diffusion] Keep Cosmos3 Nano resident on 96 GB GPUs (#36641) 2026-08-29 07:40:46 +08:00
Gregory Leleytner e1b3bba3cc [Kernel] Route large SM90 row/column-scaled FP8 GEMMs to Torch (#34318) 2026-08-29 07:35:37 +08:00
Xiaoyu Zhang 96a4dcdde8 [CI] Slim JIT kernel unit tests (#36887) 2026-08-29 07:26:49 +08:00
Cheng Wan d12b313b93 fix: KT's last MoE layer stops deferring experts again (#36921) 2026-08-28 15:05:08 -07:00
Trevor Morris ca179b761b Use kernel build node for cu134 image (#36912) 2026-08-28 14:56:23 -07:00
Liangsheng Yin 60f6d77a98 [mem_cache] Carry swa_evicted_seqlen into SWARadixCache.cache_unfinished_req (#36909) 2026-08-28 14:29:27 -07:00
Jonny Kongandjonnykong 4d78d59e51 [MoE] Make simulated expert routing support DP>1, and fuse into one triton kernel (#29718)
Co-authored-by: jonnykong <jonnykong@fb.com>
2026-08-28 14:22:45 -07:00
Liangsheng Yin f65b2b2b15 [Fix] Lazy-import aiter in DSv4 paged_decode to unbreak CPU CI (#36914) 2026-08-28 14:16:53 -07:00
karverma-amd 2a96ebf648 [AMD][DSV4] perf: retune decode split-K heuristic for MI355X (#36094) 2026-08-28 13:48:41 -07:00
Shuwen Wang ade4f4ba8b fix: report the real backend for non-CUDA CI registrations in /rerun-test (#36778) 2026-08-28 13:45:59 -07:00
weireweireandweireweire 3254f9b47c [Blackwell] Reserve SMs for DeepGEMM MegaMoE grid barriers (#36657)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-28 13:37:36 -07:00
Mohammad Miadh Angkad 70088aa5db Fix KeyError on batch requests whose state is freed before it is read (#36638) 2026-08-28 12:57:07 -07:00
YC Yen-Ching Tseng c7879af887 [AMD] release rocm10 image for gfx1250 from amd_helios (#36892) 2026-08-28 12:00:25 -07:00
Zhiqiang Xie f611e0c073 [HiCache] Fence load-back behind the forward stream (#36738) 2026-08-28 11:12:51 -07:00
Zhiqiang Xie c9bba091f8 [HiCache] Key storage prefetch by the request namespace (#36382) 2026-08-28 11:12:10 -07:00
Cheng WanandClaude Opus 5 ef20fab38a config: the forwarding slots go; the dispatcher calls the family directly (#36792)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:26:29 -07:00
Cheng WanandClaude Opus 5 7bc3204117 config: three cache and pool readers take the bags (#36791)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:21:32 -07:00
Cheng WanandClaude Opus 5 43c63a22ff config: the derived parallel widths are computed from the leaves (#36790)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:18:46 -07:00
Cheng WanandClaude Opus 5 c2928e86d7 config: the resolution pipeline moves out of the record (#36789)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:17:24 -07:00
pllimax 726665e08e [CI] Read subprocess stdout on a background thread to avoid EOF deadlock (#36673) 2026-08-29 01:11:02 +08:00
Chao Shi 8e04f66a70 HiCache: avoid unnecessary all-reduce in check_prefetch_progress (#36425) 2026-08-29 00:52:53 +08:00
Alison Shao 23cb11ae01 Fix KV cache pool sized far too small when weight-loading memory is still referenced (#36583) 2026-08-28 09:47:23 -07:00
黄孝君 fcb4ff1ee3 [NPU] Update sgl-kernel-npu version (#36433) 2026-08-29 00:42:28 +08:00
Po-Han Huang (NVIDIA) 6ff2fe6a6a CI: split JIT kernel unit tests into two partitions (#36775) 2026-08-28 09:32:58 -07:00
Bingxu Chen 9579bff860 [AMD] Add ROCm 10 (gfx942 / gfx950) release images (#36434) 2026-08-28 08:03:39 -07:00