Commit Graph
17396 Commits
Author SHA1 Message Date
Trevor Morris a16872767f Update CUDA 13.4 image to flashinfer 0.6.18rc10, cutedsl 4.8. Fix sgl- wheel unpinning (#36929) 2026-08-28 17:52:15 -07:00
Thomas Wang 89816a21a1 [AMD] Update v4 amd cookbook 0828 (#36828) 2026-08-28 17:20:22 -07:00
Olga Miroshnichenko 36afd70f9c [ROCm][Bugfix] Use token-level KV indices in the aiter ASM context-prefill gather (#36852) 2026-08-28 17:17:18 -07:00
valechenandHAI 4944e50e2c [AMD] Add Work-Centric (Lean) Attention: a persistent-CTA decode kernel for long-context serving (#33576)
Signed-off-by: Valerie Chen <valechen@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-08-28 17:00:44 -07:00
Xiaoyu Zhang db6f0a9d53 Refactor JIT kernel and expert-pack directory layout (#36704) 2026-08-29 07:41:25 +08:00
Xiaoyu Zhang 50bc1a3767 [diffusion] Keep Cosmos3 Nano resident on 96 GB GPUs (#36641) 2026-08-29 07:40:46 +08:00
Gregory Leleytner e1b3bba3cc [Kernel] Route large SM90 row/column-scaled FP8 GEMMs to Torch (#34318) 2026-08-29 07:35:37 +08:00
Xiaoyu Zhang 96a4dcdde8 [CI] Slim JIT kernel unit tests (#36887) 2026-08-29 07:26:49 +08:00
Cheng Wan d12b313b93 fix: KT's last MoE layer stops deferring experts again (#36921) 2026-08-28 15:05:08 -07:00
Trevor Morris ca179b761b Use kernel build node for cu134 image (#36912) 2026-08-28 14:56:23 -07:00
Liangsheng Yin 60f6d77a98 [mem_cache] Carry swa_evicted_seqlen into SWARadixCache.cache_unfinished_req (#36909) 2026-08-28 14:29:27 -07:00
Jonny Kongandjonnykong 4d78d59e51 [MoE] Make simulated expert routing support DP>1, and fuse into one triton kernel (#29718)
Co-authored-by: jonnykong <jonnykong@fb.com>
2026-08-28 14:22:45 -07:00
Liangsheng Yin f65b2b2b15 [Fix] Lazy-import aiter in DSv4 paged_decode to unbreak CPU CI (#36914) 2026-08-28 14:16:53 -07:00
karverma-amd 2a96ebf648 [AMD][DSV4] perf: retune decode split-K heuristic for MI355X (#36094) 2026-08-28 13:48:41 -07:00
Shuwen Wang ade4f4ba8b fix: report the real backend for non-CUDA CI registrations in /rerun-test (#36778) 2026-08-28 13:45:59 -07:00
weireweireandweireweire 3254f9b47c [Blackwell] Reserve SMs for DeepGEMM MegaMoE grid barriers (#36657)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-28 13:37:36 -07:00
Mohammad Miadh Angkad 70088aa5db Fix KeyError on batch requests whose state is freed before it is read (#36638) 2026-08-28 12:57:07 -07:00
YC Yen-Ching Tseng c7879af887 [AMD] release rocm10 image for gfx1250 from amd_helios (#36892) 2026-08-28 12:00:25 -07:00
Zhiqiang Xie f611e0c073 [HiCache] Fence load-back behind the forward stream (#36738) 2026-08-28 11:12:51 -07:00
Zhiqiang Xie c9bba091f8 [HiCache] Key storage prefetch by the request namespace (#36382) 2026-08-28 11:12:10 -07:00
Cheng WanandClaude Opus 5 ef20fab38a config: the forwarding slots go; the dispatcher calls the family directly (#36792)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:26:29 -07:00
Cheng WanandClaude Opus 5 7bc3204117 config: three cache and pool readers take the bags (#36791)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:21:32 -07:00
Cheng WanandClaude Opus 5 43c63a22ff config: the derived parallel widths are computed from the leaves (#36790)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:18:46 -07:00
Cheng WanandClaude Opus 5 c2928e86d7 config: the resolution pipeline moves out of the record (#36789)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 10:17:24 -07:00
pllimax 726665e08e [CI] Read subprocess stdout on a background thread to avoid EOF deadlock (#36673) 2026-08-29 01:11:02 +08:00
Chao Shi 8e04f66a70 HiCache: avoid unnecessary all-reduce in check_prefetch_progress (#36425) 2026-08-29 00:52:53 +08:00
Alison Shao 23cb11ae01 Fix KV cache pool sized far too small when weight-loading memory is still referenced (#36583) 2026-08-28 09:47:23 -07:00
黄孝君 fcb4ff1ee3 [NPU] Update sgl-kernel-npu version (#36433) 2026-08-29 00:42:28 +08:00
Po-Han Huang (NVIDIA) 6ff2fe6a6a CI: split JIT kernel unit tests into two partitions (#36775) 2026-08-28 09:32:58 -07:00
Bingxu Chen 9579bff860 [AMD] Add ROCm 10 (gfx942 / gfx950) release images (#36434) 2026-08-28 08:03:39 -07:00
395c2258c3 [Docs] Add GLM-5.3 cookbook (#36827)
Co-authored-by: JustinTong0323 <xinyuantong.cs@gmail.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Mohammad Angkad <176301910+mmangkad@users.noreply.github.com>
2026-08-28 14:56:06 +00:00
匡胤鑫 b644771e07 [Fix] Route the Mooncake MoE A2A backend through Kimi K3's EP-A2A / SP-MoE fast path (#36862) 2026-08-28 21:46:35 +08:00
Артем СавкинandXiaoyu Zhang ecbadf0b4b [NPU] [Diffusion] support distributed inference pipeline for GLM-Image (#31320)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-08-28 15:39:05 +03:00
Mick 803b4fb31c [diffusion] refactor: scope model-specific API parameters (#35613) 2026-08-28 19:08:30 +08:00
ming_wang d56706459c bugfix for index_fill_ on NPU (#36759) 2026-08-28 17:41:49 +08:00
Xinguo ZhuandMa Mingfei 74df026877 fix(cpu): skip GPU JIT MoE top-k on CPU (#35677)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-28 02:31:26 -07:00
K Chiranjeevi 9cee0a31d1 [XPU] Lazily import tvm_ffi-dependent all_reduce kernel in minimax_m2 (#35290)
Signed-off-by: Chiranjeevi Koppula <ckoppula@habana.ai>
2026-08-28 02:18:03 -07:00
McZyWu 69a49fede8 fix(kimi-k3): preserve dense ModelSlim MLA weights (#36603) 2026-08-28 02:15:52 -07:00
Zheng Wengang 1e6d041f78 [BugFix][VLM] keep Qwen3-VL MoE inference deepstack order (#34690) 2026-08-28 17:02:16 +08:00
Zhiqiang Xie 3785b2d20f [HiCache] Reject load-back specs that claim nodes pinned by an in-flight load-back (#35931) 2026-08-28 01:59:06 -07:00
Xiaoyu Zhang eebb99c049 [diffusion][kernel] avoid 4D scale-shift autotuning (#36521) 2026-08-28 16:58:19 +08:00
Xiaoyu Zhang 45424d8434 [diffusion][kernel] support transposed residual-gate add (#36504) 2026-08-28 16:54:37 +08:00
Zhiqiang Xie 1061e34785 [HiCache] Retry L3 storage prefetch after a missed attempt (#36227) 2026-08-28 01:35:21 -07:00
Zhiqiang Xie 3f1031d697 [HiCache] Heal the storage existence cache on a hybrid prefetch discard (#36386) 2026-08-28 01:33:40 -07:00
Haoguang Cai 989e51ba9c [Docs] Rename Tencent cookbook page titles to "Hy4 preview" / "Hy3 preview" (#36823) 2026-08-28 01:31:52 -07:00
Yikai Zhangandamdpilot-upstream-sync d3b972cbf0 fix(lora): build the MoE LoRA align JIT kernel on ROCm (#36379)
Co-authored-by: amdpilot-upstream-sync <amdpilot-upstream-sync@users.noreply.github.com>
2026-08-28 01:18:42 -07:00
Bingxu Chen 0c7d017dbb [AMD][Fix] Qwen3.5: make empty-batch guard tuple-aware on fused AR+quant path (#35341) 2026-08-28 01:11:53 -07:00
Bingxu Chen 2a7fb511c9 [AMD][CI] Limit HiCache MGSM eval concurrency on ROCm (#36308) 2026-08-28 01:05:59 -07:00
zijiexiaandClaude Fable 5 2960d69622 [Cookbook] Hy4-Preview follow-ups: runtime-accurate recipes + released-model info (#36808)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-28 00:19:07 -07:00
acc918b3ec [AMD] Qwen3.5 ASM FMHA chunked-prefill context attention (#36758)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-08-27 23:37:45 -07:00