 
|
956b9a24ee
|
[Perf] [AMD] qwen3.5: Fuse activation quant into small-M FP8 block-scale GEMM on gfx950 (#42229)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-20 22:32:30 -07:00 |
|
Aarne Talman
|
4b5c9c4b5e
|
[Perf] [AMD] attention: Restore the gfx950 extend tile for head_dim <= 128 (#45099)
|
2026-10-20 22:02:50 -07:00 |
|
 
|
b326e8349d
|
[Perf] mamba: Copy tracked decode states at HBM bandwidth in one persistent launch (#45213)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: YavorGIvanov <YavorGIvanov@users.noreply.github.com>
|
2026-10-20 16:52:15 -07:00 |
|
 kkandwunhuang
|
9686edcf80
|
[Perf] [AMD] dsv41: faster mHC boundary Triton tile for 96+ rows, bitwise unchanged (#45124)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-20 16:39:34 -07:00 |
|
 Cheng WanandAditya Suresh
|
299a75ac5d
|
[Refactor] moe: Derive routing inputs from the layer and active forward (#44994)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
|
2026-10-20 16:26:15 -07:00 |
|
 kkandwunhuang
|
533020b500
|
[Perf] [AMD] dsv41: run gfx950 MXFP8 dense GEMMs on aiter's preshuffled FlyDSL kernel (#45123)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-20 16:19:32 -07:00 |
|
Aarne Talman
|
d5e83ea4f6
|
[Perf] [AMD] deterministic: Faster extend attention launch on gfx950 (#45098)
|
2026-10-20 16:11:01 -07:00 |
|
 
|
7656071309
|
[Feat] platform: Add initial T-HEAD SAIL platform support [2/N] (#43826)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: yzshi <163985193+Yunzshi310@users.noreply.github.com>
|
2026-10-20 22:19:07 +08:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
2229345dff
|
[Doc] kda_kernels: Point the SM121 QSA kernel provenance at its SGLang PR (#45359)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-20 16:50:58 +08:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
0788f1fdd0
|
[Refactor] kernels: Register agent-generated kernels under their KDA / Cake backend (#45277)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-20 16:35:11 +08:00 |
|
 XXXXRT666andAlex Nails
|
1739d962a4
|
[Refactor] [Apple] MLX: Use Native Extension Builder for Metal Kernels (#44367)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-20 00:35:29 -07:00 |
|
 
|
602c92ccd8
|
[Perf] DeepSeek-V4.1: Raise the SM100 swap-AB decode cap to 40 rows (#44632)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: nbommi19 <227267412+nbommi19@users.noreply.github.com>
|
2026-10-19 22:20:10 -07:00 |
|
    
|
72d886efb8
|
[Perf] DeepSeek-V4.1: Run the small-batch decode fusions at TP2 (#43838)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: nbommi19 <227267412+nbommi19@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-19 21:17:05 -07:00 |
|
 wxzhoucsandXiaoyu Zhang
|
e3205080ce
|
[Fix] qwen3.8: Fix batch-invariant kernels for Qwen3.8 Flash-Next (#42087)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-20 11:32:40 +08:00 |
|
Liangsheng Yin
|
5e630fa571
|
[Perf] deepseek-v4.1: Drop host syncs from encoder-replay folding and tail metadata (#45275)
|
2026-10-19 19:39:39 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
af856717c2
|
[Fix] mamba: Skip zero-width conv pools in the MTP verify scatter (#45212)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-19 19:23:17 -07:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
693d333306
|
[Refactor] kernels: Regroup operators by computation and dissolve ops/muse_spark (#45112)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-20 08:47:57 +08:00 |
|
Cheng Wan
|
48ea486928
|
[Fix] moe: Renormalize per-rank shared-slot routing over routed experts only (#44904)
|
2026-10-19 16:56:21 -07:00 |
|
Jiuqiang Tang
|
49766a74f9
|
[Fix] attn_residual: int64 program ids in the score/combine kernels (int32 overflow at 37,451 tokens) (#43438)
|
2026-10-19 15:12:12 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
7656ea0e74
|
[CI] python: Move the remaining CUDA build paths off Python 3.10 (#44393)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-19 14:29:00 -07:00 |
|
 Jan SchalkampandXiaoyu Zhang
|
8e7601ae4a
|
[Feat] paged-experts: Serve MoE models whose weights do not fit VRAM (#42557)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 23:10:04 +08:00 |
|
Monishver
|
806e7423af
|
[Perf] deepseek_v4: size the masked silu-mul-quant grid to the GPU, not the padded capacity (#44618)
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
|
2026-10-19 23:07:12 +08:00 |
|
 Siliang ChenandCursor
|
7c4cc5a51c
|
[Perf] [AMD] attention: Spread uneven Triton decode batches across XCDs (#41229)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-19 23:03:27 +08:00 |
|
zhaozx-cn
|
ed0b8f433f
|
[Fix] [NPU] kimi-k3: skip fused gmm1 for situ activation in Ascend runner (#43837)
|
2026-10-19 19:30:41 +08:00 |
|
 Quanli Liand全力
|
e45cbce599
|
[Fix] diffusion: Prevent int32 overflow in Qwen-Image-2.1-Turbo VAE RMSNorm (#45118)
Co-authored-by: 全力 <liquanli.lql@antgroup.com>
|
2026-10-19 18:01:02 +08:00 |
|
 
|
a5117beb11
|
[Perf] mhc: Parallelize small-batch post across hidden tiles (#44906)
Co-authored-by: leonardHONG <178642616+leonardHONG@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 15:07:13 +08:00 |
|
   
|
7c9a78efbe
|
[Feat] nemotron: Port Nemotron 3.5 Super serving changes (#44518)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 13:27:22 +08:00 |
|
Yuwei An
|
834bfe4ef0
|
[Fix] attention: Opt FlashMLA scheduler into dynamic shared memory (#44580)
|
2026-10-18 20:31:39 -07:00 |
|
Duyi-Wang
|
8d3eee46a7
|
[Perf] [AMD] deepseek-v4: Skip top-k refinement for proven positive-zero ties (#44927)
|
2026-10-19 11:27:47 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
377cd867fd
|
[Perf] dsa: Route the k-pool indexer top-k through the top-k v2 kernel (#43775)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-19 09:49:39 +08:00 |
|
 Emre AlbayrakandXiaoyu Zhang
|
10ec53ac2f
|
[Perf] [NVIDIA] fp8_fa_sm120: Use the block-scaled MMA encoding (#43390)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 09:36:21 +08:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
329072d99a
|
[Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 08:55:47 +08:00 |
|
Liangsheng Yin
|
fe89a7c890
|
[Fix] deepseek-v4.1: Start the PD decode draft SWA window at the prefill draft valid-from (#45037)
|
2026-10-18 15:06:20 -07:00 |
|
Cheng Wan
|
57db5089c2
|
[Perf] attention: Capture translated FA4 verify metadata for DSPARK (#44973)
|
2026-10-18 05:42:16 -07:00 |
|
Cheng Wan
|
2e9b2cacda
|
[Perf] speculative: Fuse draft write-window gathering and KV translation (#44972)
|
2026-10-18 05:41:34 -07:00 |
|
Cheng Wan
|
2a83471676
|
[Perf] mamba: Fuse strided state updates and replay index translation (#44971)
|
2026-10-18 05:40:57 -07:00 |
|
Cheng Wan
|
d318a546da
|
[Perf] unified-memory: Reduce allocation and SWA retirement overhead (#44970)
|
2026-10-18 05:40:25 -07:00 |
|
Cheng Wan
|
a5b21145e1
|
[Refactor] attention: Separate decode metadata from pool ownership (#44969)
|
2026-10-18 05:39:44 -07:00 |
|
 
|
3edb156dec
|
[Feat] unified-memory: Fuse drafts with sliding-window and recurrent-state layers (#43326)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-18 05:39:09 -07:00 |
|
 LindaandMick
|
680a2ff27e
|
[Perf] [NVIDIA] diffusion/FLUX.3: Run dynamic LoRA through PrimsTS GEMMs (#44761)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-18 20:32:19 +08:00 |
|
 WenhaoZhangandMick
|
1fd46ddd56
|
[Perf] diffusion: fused indexed modulation for FP32 AdaLN tables (#44180)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-18 20:31:36 +08:00 |
|
+14        
|
d33dd0566a
|
[Feat] srt: Add muse spark runtime, multimodal support and tests (3/5) (#44666)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-10-18 01:00:24 -07:00 |
|
Michael
|
00f6cdcd1b
|
[Fix] [AMD] kda: Reject match_cutedsl_decode on ROCm and skip its parity tests (#44089)
|
2026-10-18 00:01:40 -07:00 |
|
Michael
|
3626978a13
|
[Fix] [AMD] kda: Match the fused verify Q/K norm to its reference kernel (#43991)
|
2026-10-18 00:01:11 -07:00 |
|
 
|
140c57d5bf
|
[Perf] diffusion: classify residual_gate_add operands once per call (#44478)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 11:51:52 +08:00 |
|
 
|
8d02b69c11
|
[Perf] diffusion: Replay Triton launches without the runner's per-launch hook metadata (#44471)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 09:58:54 +08:00 |
|
 
|
949e1a2080
|
[Perf] diffusion: Cache the fused linear-GELU verdict per linear (#44643)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 09:55:29 +08:00 |
|
 
|
400c1dfe6e
|
[Perf] distributed: skip the DLPack re-wrap of custom all-reduce results (#44251)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-17 18:44:31 +08:00 |
|
 
|
56a20d7e34
|
[Perf] kernels: Enter a JIT kernel's device guard only when the device differs (#44644)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-17 16:43:27 +08:00 |
|
 
|
a2953d7b7f
|
[Fix] deepseek-v4.1: Serve prompt-logprob requests under decoder SWA bounded replay (#44850)
Co-authored-by: Pedram Ghazi <pedram.ghazi@amd.com>
Co-authored-by: David Orman <ormandj@corenode.com>
|
2026-10-17 01:25:33 -07:00 |
|