Commit Graph
85 Commits
Author SHA1 Message Date
150f568900 [diffusion] kernels: stop specializing on per-request sequence lengths (#41710)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 22:21:01 +08:00
WenhaoZhangandMick Qian 284cda01fb [diffusion] optimization: fuse the video VAE decoder's RMSNorm and QK RoPE for MiniMax-H3 (#41906)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 17:30:39 +08:00
Xiaoyu Zhang bc5a055dd7 [diffusion] move kernel validation into launchers and simplify dispatch (#42391) 2026-10-04 18:23:29 +08:00
trebladev 295a53c90e [diffusion] optimization: fuse Flux3 rowwise FP8 quantization with triton (#41671) 2026-10-04 09:01:17 +08:00
Xiaoyu Zhangandkernel-design-agents 77b64e353f [KDA+Kimi K3] Speed up LTX-2.3 QK norm and split RoPE on H200 (#41459)
Co-authored-by: kernel-design-agents <334018530+kernel-design-agents@users.noreply.github.com>
2026-10-01 14:21:31 +08:00
triple-mu 2e7e0802f4 [diffusion] Qwen-Image 2.1: fuse Q/K RMSNorm + RoPE + KV packing into one CUDA kernel and project Q/K/V with one packed GEMM (#41339) 2026-09-28 21:45:39 +08:00
Xiaoyu Zhang 38ec649048 [Refactor] Restore logical kernel groups and test organization (#41243) 2026-09-26 12:30:44 +08:00
Xiaoyu Zhang 85374532f2 [diffusion] Fuse lossless Klein packed QK RMSNorm and RoPE on Hopper (#40490) 2026-09-26 09:24:21 +08:00
Xiaoyu Zhang 26c63335e2 [Diffusion] Fuse lossless LingBot World FP32 normalization (#40425) 2026-09-24 18:41:10 +08:00
Xiaoyu Zhang c85df5becc [Diffusion] Fuse lossless Wan VAE post-ops for LongLive 2 I2V (#40405) 2026-09-24 17:40:07 +08:00
Xiaoyu Zhang 261cb826e6 [Diffusion] Fuse LongCat GELU+cat and support Edit-Turbo BCG (#40384) 2026-09-24 17:27:56 +08:00
Xiaoyu Zhang c3e985203a [Diffusion] Remove unused standalone benchmarks and deduplicate kernel tests (#40924) 2026-09-23 22:42:03 +08:00
Xiaoyu Zhang 4e60d70ba4 [Diffusion] Fuse Joy Image Edit QKV concatenation and avoid QK copies (#40494) 2026-09-23 22:20:14 +08:00
Xiaoyu Zhang 172b1b4825 [Diffusion] Accelerate Cosmos3 Edge on Hopper with lossless fusions (#40386) 2026-09-23 21:16:58 +08:00
f9c2791460 [diffusion] model: support qwen-image-2.1 (#39983)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
2026-09-20 09:46:09 +08:00
Xiaoyu Zhang cb22f2451e [Cleanup] Deduplicate kernel tests, diffusion fixtures and benchmark helpers (#40265) 2026-09-19 19:45:38 +08:00
Xiaoyu Zhang 7bc9152447 [Test] Consolidate kernel tests under plural kernels tree (#39966) 2026-09-18 07:37:48 +08:00
Xiaoyu ZhangandMick Qian 3e035a3513 [Diffusion] Optimize Qwen-Image-Edit attention on Hopper (#38584)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-13 09:15:01 +08:00
DayuxiaoshuiandXiaoyu Zhang db1de6ff4c [Diffusion] Keep the Wan VAE decoder channels_last and add a Triton NHWC nearest upsample (#38182)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-09-09 09:31:35 +08:00
Xiaoyu Zhang 554f817948 [Diffusion] Optimize LTX-2 QKNorm and split RoPE on Hopper (#38396) 2026-09-08 19:05:02 +08:00
Xiaoyu ZhangandMick Qian 4d23a4fa6d [Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-07 15:13:59 +08:00
sglang-botandsglang-bot 6252993afe chore: update CI test est_time values (#38238)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-09-06 17:49:41 -07:00
bd16c22a04 [diffusion] fuse LingBot MoE group-limited top-k index selection (#38044)
Co-authored-by: BBuf <bbuf@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-05 18:12:30 +08:00
DayuxiaoshuiandXiaoyu Zhang 50c1bf0db0 [Diffusion] Port the Wan VAE decoder fast paths to the Qwen-Image VAE (#38020)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-09-05 18:02:33 +08:00
Xiaoyu Zhang 54c2c99feb [Diffusion] Fuse LingBot per-token gated residual and RMSNorm modulate (#37910) 2026-09-04 14:35:13 +08:00
YC Yen-Ching TsengandPhil Li 1fb85053e7 [AMD][Diffusion] Migrate FlyDSL fused norm kernels to the v0.3.0 stable API (#36349)
Co-authored-by: Phil Li <haicli@amd.com>
2026-09-02 23:03:08 -07:00
Xiaoyu ZhangandCursor f4c17fed07 [Diffusion] Fuse FLUX.2 NVFP4 FC1, SwiGLU, and FC2 quantization (#37096)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-02 08:21:14 +08:00
c593527f33 [Kernel] Add KDA NVFP4 GEMM for Qwen3.x on SM120 (#36865)
Co-authored-by: Song Bian <biansonghz@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-02 08:16:54 +08:00
Xiaoyu ZhangandCursor 1c3ad92438 [Diffusion] Fuse FLUX.2 ModelOpt FP8 producers and QKV packing (#37162)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-01 16:14:29 +08:00
71cee04ebe [Diffusion] Optimize Qwen-Image TP collectives and attention (#36680)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-01 10:28:37 +08:00
Xiaoyu ZhangandCursor 6715debb2a [Diffusion] Fuse Qwen-Image FP8 QKV projection and Blackwell epilogue (#37123)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-01 08:34:41 +08:00
Xiaoyu Zhang 52e1c24744 [Diffusion] Fuse FLUX.2 token concatenation and NVFP4 quantization (#37141) 2026-08-31 21:33:02 +08:00
Xiaoyu Zhang 771e613d96 [Diffusion] Fuse Qwen-Image final adaptive LayerNorm (#37144) 2026-08-31 18:22:20 +08:00
Xiaoyu ZhangandCursor 1ed9bfac2c [Diffusion] Fuse Qwen-Image FP8 norm and activation quantization (#37156)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-31 18:19:42 +08:00
Xiaoyu Zhang bb5e619860 [diffusion] perf: absorb Qwen-Image output projection biases (#37116) 2026-08-31 08:25:37 +08:00
Xiaoyu Zhang 5ab97c4f44 [Diffusion] Cache Qwen-Image modulation across serial CFG branches (#37090) 2026-08-31 01:40:29 +08:00
Xiaoyu Zhang 96a4dcdde8 [CI] Slim JIT kernel unit tests (#36887) 2026-08-29 07:26:49 +08:00
Xiaoyu Zhang eebb99c049 [diffusion][kernel] avoid 4D scale-shift autotuning (#36521) 2026-08-28 16:58:19 +08:00
Xiaoyu Zhang 45424d8434 [diffusion][kernel] support transposed residual-gate add (#36504) 2026-08-28 16:54:37 +08:00
Xiaoyu Zhang 96b31770f9 [diffusion] fuse Helios paired transposed RoPE (#36502) 2026-08-28 08:57:37 +08:00
Alex NailsandClaude Opus 5 5ffdb02d0c [CI] Cut repeated tokenizer loads, serial subprocesses and a double scan (#36241)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-24 18:22:43 -07:00
Hert4andAlex Nails b4bd5f91ee [diffusion] Fix test_model_fast_paths import after sana_ln_modulate rename (#36175)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-24 04:48:17 -07:00
Xiaoyu Zhang 46b92b22e2 [diffusion] Accelerate LingBot Video RMSNorm in quality=high (#35969) 2026-08-24 18:02:00 +08:00
Xiaoyu Zhang 6d40b8aebf [diffusion] Fix Hunyuan QKV pack indexing at production video shapes (#36009) 2026-08-24 13:39:26 +08:00
Xiaoyu Zhang 8dcfb3b5e7 [diffusion] Fuse LongCat-Image QKNorm and interleaved RoPE (#35995) 2026-08-24 12:07:26 +08:00
Xiaoyu Zhang e129fe21e5 [diffusion] Flatten Wan VAE RMSNorm row addressing (#35981) 2026-08-24 08:57:54 +08:00
Xiaoyu Zhang 83e9ece672 [diffusion] Fuse SANA-Video interleaved RoPE (#35695) 2026-08-22 12:56:45 +08:00
R0CKSTARandAlex Nails d90318b3e2 [MLX] Upgrade to Torch 2.13/MLX 0.32+ and redesign the Torch-MLX tensor bridge (#32984)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-21 18:51:42 -07:00
Xiaoyu Zhang 39d4d65a51 [diffusion] Accelerate SANA-Video linear attention in quality=high (#35728) 2026-08-21 18:05:43 +08:00
Xiaoyu Zhang 7e80e889a2 [diffusion] Fuse LTX-2.5 decoder 3D RoPE (#35698) 2026-08-21 10:13:09 +08:00