Commit Graph
741 Commits
Author SHA1 Message Date
956b9a24ee [Perf] [AMD] qwen3.5: Fuse activation quant into small-M FP8 block-scale GEMM on gfx950 (#42229)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-10-20 22:32:30 -07:00
Aarne Talman 4b5c9c4b5e [Perf] [AMD] attention: Restore the gfx950 extend tile for head_dim <= 128 (#45099) 2026-10-20 22:02:50 -07:00
b326e8349d [Perf] mamba: Copy tracked decode states at HBM bandwidth in one persistent launch (#45213)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: YavorGIvanov <YavorGIvanov@users.noreply.github.com>
2026-10-20 16:52:15 -07:00
kkandwunhuang 9686edcf80 [Perf] [AMD] dsv41: faster mHC boundary Triton tile for 96+ rows, bitwise unchanged (#45124)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-10-20 16:39:34 -07:00
Cheng WanandAditya Suresh 299a75ac5d [Refactor] moe: Derive routing inputs from the layer and active forward (#44994)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
2026-10-20 16:26:15 -07:00
kkandwunhuang 533020b500 [Perf] [AMD] dsv41: run gfx950 MXFP8 dense GEMMs on aiter's preshuffled FlyDSL kernel (#45123)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-10-20 16:19:32 -07:00
Aarne Talman d5e83ea4f6 [Perf] [AMD] deterministic: Faster extend attention launch on gfx950 (#45098) 2026-10-20 16:11:01 -07:00
7656071309 [Feat] platform: Add initial T-HEAD SAIL platform support [2/N] (#43826)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: yzshi <163985193+Yunzshi310@users.noreply.github.com>
2026-10-20 22:19:07 +08:00
Xiaoyu ZhangandClaude Opus 5.5 2229345dff [Doc] kda_kernels: Point the SM121 QSA kernel provenance at its SGLang PR (#45359)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 16:50:58 +08:00
Xiaoyu ZhangandClaude Opus 5.5 0788f1fdd0 [Refactor] kernels: Register agent-generated kernels under their KDA / Cake backend (#45277)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 16:35:11 +08:00
XXXXRT666andAlex Nails 1739d962a4 [Refactor] [Apple] MLX: Use Native Extension Builder for Metal Kernels (#44367)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-10-20 00:35:29 -07:00
602c92ccd8 [Perf] DeepSeek-V4.1: Raise the SM100 swap-AB decode cap to 40 rows (#44632)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: nbommi19 <227267412+nbommi19@users.noreply.github.com>
2026-10-19 22:20:10 -07:00
72d886efb8 [Perf] DeepSeek-V4.1: Run the small-batch decode fusions at TP2 (#43838)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: nbommi19 <227267412+nbommi19@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
2026-10-19 21:17:05 -07:00
wxzhoucsandXiaoyu Zhang e3205080ce [Fix] qwen3.8: Fix batch-invariant kernels for Qwen3.8 Flash-Next (#42087)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-20 11:32:40 +08:00
Liangsheng Yin 5e630fa571 [Perf] deepseek-v4.1: Drop host syncs from encoder-replay folding and tail metadata (#45275) 2026-10-19 19:39:39 -07:00
Mohammad Miadh AngkadandMohammad Angkad af856717c2 [Fix] mamba: Skip zero-width conv pools in the MTP verify scatter (#45212)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-19 19:23:17 -07:00
Xiaoyu ZhangandClaude Opus 5.5 693d333306 [Refactor] kernels: Regroup operators by computation and dissolve ops/muse_spark (#45112)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 08:47:57 +08:00
Cheng Wan 48ea486928 [Fix] moe: Renormalize per-rank shared-slot routing over routed experts only (#44904) 2026-10-19 16:56:21 -07:00
Jiuqiang Tang 49766a74f9 [Fix] attn_residual: int64 program ids in the score/combine kernels (int32 overflow at 37,451 tokens) (#43438) 2026-10-19 15:12:12 -07:00
Mohammad Miadh AngkadandMohammad Angkad 7656ea0e74 [CI] python: Move the remaining CUDA build paths off Python 3.10 (#44393)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-19 14:29:00 -07:00
Jan SchalkampandXiaoyu Zhang 8e7601ae4a [Feat] paged-experts: Serve MoE models whose weights do not fit VRAM (#42557)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-19 23:10:04 +08:00
Monishver 806e7423af [Perf] deepseek_v4: size the masked silu-mul-quant grid to the GPU, not the padded capacity (#44618)
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
2026-10-19 23:07:12 +08:00
Siliang ChenandCursor 7c4cc5a51c [Perf] [AMD] attention: Spread uneven Triton decode batches across XCDs (#41229)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-19 23:03:27 +08:00
zhaozx-cn ed0b8f433f [Fix] [NPU] kimi-k3: skip fused gmm1 for situ activation in Ascend runner (#43837) 2026-10-19 19:30:41 +08:00
Quanli Liand全力 e45cbce599 [Fix] diffusion: Prevent int32 overflow in Qwen-Image-2.1-Turbo VAE RMSNorm (#45118)
Co-authored-by: 全力 <liquanli.lql@antgroup.com>
2026-10-19 18:01:02 +08:00
a5117beb11 [Perf] mhc: Parallelize small-batch post across hidden tiles (#44906)
Co-authored-by: leonardHONG <178642616+leonardHONG@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-19 15:07:13 +08:00
7c9a78efbe [Feat] nemotron: Port Nemotron 3.5 Super serving changes (#44518)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 13:27:22 +08:00
Yuwei An 834bfe4ef0 [Fix] attention: Opt FlashMLA scheduler into dynamic shared memory (#44580) 2026-10-18 20:31:39 -07:00
Duyi-Wang 8d3eee46a7 [Perf] [AMD] deepseek-v4: Skip top-k refinement for proven positive-zero ties (#44927) 2026-10-19 11:27:47 +08:00
Mohammad Miadh AngkadandMohammad Angkad 377cd867fd [Perf] dsa: Route the k-pool indexer top-k through the top-k v2 kernel (#43775)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-19 09:49:39 +08:00
Emre AlbayrakandXiaoyu Zhang 10ec53ac2f [Perf] [NVIDIA] fp8_fa_sm120: Use the block-scaled MMA encoding (#43390)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-19 09:36:21 +08:00
Xiaoyu ZhangandClaude Opus 5.5 329072d99a [Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 08:55:47 +08:00
Liangsheng Yin fe89a7c890 [Fix] deepseek-v4.1: Start the PD decode draft SWA window at the prefill draft valid-from (#45037) 2026-10-18 15:06:20 -07:00
Cheng Wan 57db5089c2 [Perf] attention: Capture translated FA4 verify metadata for DSPARK (#44973) 2026-10-18 05:42:16 -07:00
Cheng Wan 2e9b2cacda [Perf] speculative: Fuse draft write-window gathering and KV translation (#44972) 2026-10-18 05:41:34 -07:00
Cheng Wan 2a83471676 [Perf] mamba: Fuse strided state updates and replay index translation (#44971) 2026-10-18 05:40:57 -07:00
Cheng Wan d318a546da [Perf] unified-memory: Reduce allocation and SWA retirement overhead (#44970) 2026-10-18 05:40:25 -07:00
Cheng Wan a5b21145e1 [Refactor] attention: Separate decode metadata from pool ownership (#44969) 2026-10-18 05:39:44 -07:00
3edb156dec [Feat] unified-memory: Fuse drafts with sliding-window and recurrent-state layers (#43326)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
2026-10-18 05:39:09 -07:00
LindaandMick 680a2ff27e [Perf] [NVIDIA] diffusion/FLUX.3: Run dynamic LoRA through PrimsTS GEMMs (#44761)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-18 20:32:19 +08:00
WenhaoZhangandMick 1fd46ddd56 [Perf] diffusion: fused indexed modulation for FP32 AdaLN tables (#44180)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-18 20:31:36 +08:00
+14 d33dd0566a [Feat] srt: Add muse spark runtime, multimodal support and tests (3/5) (#44666)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-10-18 01:00:24 -07:00
Michael 00f6cdcd1b [Fix] [AMD] kda: Reject match_cutedsl_decode on ROCm and skip its parity tests (#44089) 2026-10-18 00:01:40 -07:00
Michael 3626978a13 [Fix] [AMD] kda: Match the fused verify Q/K norm to its reference kernel (#43991) 2026-10-18 00:01:11 -07:00
140c57d5bf [Perf] diffusion: classify residual_gate_add operands once per call (#44478)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-18 11:51:52 +08:00
8d02b69c11 [Perf] diffusion: Replay Triton launches without the runner's per-launch hook metadata (#44471)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-18 09:58:54 +08:00
949e1a2080 [Perf] diffusion: Cache the fused linear-GELU verdict per linear (#44643)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-18 09:55:29 +08:00
400c1dfe6e [Perf] distributed: skip the DLPack re-wrap of custom all-reduce results (#44251)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-17 18:44:31 +08:00
56a20d7e34 [Perf] kernels: Enter a JIT kernel's device guard only when the device differs (#44644)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-17 16:43:27 +08:00
a2953d7b7f [Fix] deepseek-v4.1: Serve prompt-logprob requests under decoder SWA bounded replay (#44850)
Co-authored-by: Pedram Ghazi <pedram.ghazi@amd.com>
Co-authored-by: David Orman <ormandj@corenode.com>
2026-10-17 01:25:33 -07:00