Commit Graph
100 Commits
Author SHA1 Message Date
Xiaoyu Zhang 344613c159 [diffusion] Default Hunyuan VAE to tiled decode (#36012) 2026-08-24 13:18:06 +08:00
Xiaoyu Zhang 8dcfb3b5e7 [diffusion] Fuse LongCat-Image QKNorm and interleaved RoPE (#35995) 2026-08-24 12:07:26 +08:00
Xiaoyu Zhang 09592f5889 [diffusion] Keep LongLive2 components resident on large GPUs (#35993) 2026-08-24 12:06:52 +08:00
Xiaoyu Zhang e129fe21e5 [diffusion] Flatten Wan VAE RMSNorm row addressing (#35981) 2026-08-24 08:57:54 +08:00
Xiaoyu Zhang b2eb0fa51e [diffusion] Keep Cosmos3 Nano resident on high-memory GPUs (#36000) 2026-08-24 08:51:58 +08:00
Xiaoyu Zhang 447048dba2 [diffusion] Reject unsafe quality=high BCG replay (#36008) 2026-08-24 08:50:26 +08:00
Xiaoyu Zhang f4448e677f [diffusion] Reuse SANA fast paths in SANA-Video BCG (#35961) 2026-08-24 08:47:04 +08:00
Xiaoyu Zhang 96bfd2476c [diffusion] Enable SANA-Video breakable CUDA graphs (#35729) 2026-08-22 12:57:09 +08:00
Xiaoyu Zhang 83e9ece672 [diffusion] Fuse SANA-Video interleaved RoPE (#35695) 2026-08-22 12:56:45 +08:00
Xiaoyu Zhang 39d4d65a51 [diffusion] Accelerate SANA-Video linear attention in quality=high (#35728) 2026-08-21 18:05:43 +08:00
Xiaoyu Zhang a5c52a9358 [diffusion] Enable LongCat breakable CUDA graphs (#35724) 2026-08-21 17:59:16 +08:00
Xiaoyu Zhang 7e80e889a2 [diffusion] Fuse LTX-2.5 decoder 3D RoPE (#35698) 2026-08-21 10:13:09 +08:00
Xiaoyu Zhang 04444ee352 [diffusion] Refresh eager optimization skills and benchmark safeguards (#35679) 2026-08-20 22:03:57 +08:00
Xiaoyu ZhangandClaude Opus 5 9113fc6d93 [docs] Add a fused-kernels page for SGLang Diffusion (#35436)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-19 16:32:42 +08:00
Xiaoyu ZhangandClaude Opus 5 ae6945e112 [kernels] Reorganize ops/diffusion by operator domain behind a lazy facade (#35114)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-18 20:37:43 +08:00
Xiaoyu Zhang 0aa09ab40d [diffusion] Reuse bit-exact modulation fast path for LTX-2.3 (#34930) 2026-08-17 09:04:10 +08:00
Xiaoyu Zhang 41abbb0d32 [diffusion] Accelerate Cosmos3 T2I QKNorm+RoPE (#34932) 2026-08-16 20:15:32 +08:00
Xiaoyu Zhang 095ec6c997 [diffusion][kernel] Accelerate Sana BCG with bit-exact conv post-processing (#34928) 2026-08-16 20:05:57 +08:00
Xiaoyu Zhang 0761d3f3a4 [diffusion] Accelerate lossless Ideogram norm post-processing (#34931) 2026-08-16 17:20:09 +08:00
Xiaoyu Zhang b752f1e533 [diffusion] Enable breakable CUDA graphs for LTX-2.3 (#34929) 2026-08-16 17:18:43 +08:00
Xiaoyu Zhang 0c072235f4 [diffusion] Bound overlong weight lock filenames (#34825) 2026-08-15 17:20:30 +08:00
Xiaoyu Zhang 9c9a3273be [diffusion] Fix Helios denoising profiler stepping (#34826) 2026-08-14 23:21:54 +08:00
Xiaoyu Zhang 5f2a6d6422 [diffusion] Fix symbolic replicated-mode counting under torch.compile (#34824) 2026-08-14 23:20:29 +08:00
Xiaoyu ZhangandClaude Fable 5 704e512836 [GDN] Honor configured linear-attn verify backend in the kernel dispatcher (#34592)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-14 08:59:52 +08:00
Xiaoyu Zhang c255fbc4fe [Diffusion] Add @triple-mu as a code owner (#34748) 2026-08-14 00:37:49 +08:00
Xiaoyu Zhang ebca0bbde4 [Diffusion][ERNIE] Fuse QKNorm with full-width RoPE (#34620) 2026-08-13 23:23:21 +08:00
Xiaoyu Zhang 82f7afb881 [Diffusion] Make auto residency decisions component-scoped (#34615) 2026-08-13 23:20:55 +08:00
Xiaoyu Zhang 74c0322342 [Diffusion][FLUX.2] Fuse eager AdaLN and packed SwiGLU (#34616) 2026-08-13 19:55:53 +08:00
Xiaoyu Zhang 3c1791a7df [Diffusion][HunyuanVideo] Fuse eager QKV packing and high-quality QKNorm (#34617) 2026-08-13 19:54:00 +08:00
Xiaoyu ZhangandClaude Fable 5 a23670ddbf [diffusion] Wan2.2-TI2V: fuse per-token adaLN table add into contiguous slices + hoist rope cache (denoise -13.1% H100 / -12.6% H200, bit-exact; eager beats compile) (#34584)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-13 17:26:46 +08:00
Xiaoyu Zhang 26579d893e [Diffusion][GLM-Image] Retune QK head LayerNorm for SM103 (#34619) 2026-08-13 10:49:13 +08:00
Xiaoyu Zhang 1f008dc226 [Diffusion][LTX-2] Allocate AdaLN outputs from one contiguous slab (#34508) 2026-08-12 16:28:27 +08:00
Xiaoyu Zhang daae3acb36 [Diffusion][Z-Image] Tune native QK RMSNorm launch for SM103 (#34507) 2026-08-12 16:27:44 +08:00
Xiaoyu Zhang 4827061247 [Diffusion] Make weight-only FP8 dequant cache torch.compile-safe (#34506) 2026-08-12 16:26:31 +08:00
Xiaoyu Zhang 84ce7502cf [Diffusion][MiniMax H3] Extend exact QKNorm+RoPE rounding to SM103 (#34505) 2026-08-12 16:25:24 +08:00
Xiaoyu Zhang 45f7063335 [Diffusion] Tune QK head LayerNorm for SM103 (#34503) 2026-08-12 16:24:18 +08:00
Xiaoyu Zhang 22e4b3a81f [Diffusion] Avoid slow cuBLASLt GELU epilogue on SM120 (#34350) 2026-08-12 12:12:00 +08:00
Xiaoyu Zhang 4aff4b1822 [Diffusion] Improve bit-exact fusion fallback diagnostics (#34412) 2026-08-12 10:42:48 +08:00
Xiaoyu Zhang 3f9d184833 [Diffusion] Tune QK head LayerNorm for SM120 (#34349) 2026-08-12 10:41:54 +08:00
Xiaoyu Zhang a53d3636ce [diffusion][model] Add native SANA-Video T2V support (#32921) 2026-08-12 10:07:24 +08:00
Xiaoyu ZhangandClaude Fable 5 37c631ef23 [diffusion] Ideogram-4: fuse Qwen3-style RoPE and SwiGLU silu-mul (denoise -5.1% H100 / -4.7% H200, bit-exact) (#34314)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-12 09:19:35 +08:00
Xiaoyu Zhang b1b8ce715b [Diffusion][MiniMax H3] Fix SM120 QKNorm+RoPE rounding (#34347) 2026-08-12 09:18:16 +08:00
Xiaoyu ZhangandClaude Fable 5 546965fc72 [diffusion] LTX-2: mount the bit-exact fused modulate at the 8 bare adaLN sites (ltx23-one-stage denoise -2.8% H100 / -2.6% H200) (#34315)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-11 18:23:08 +08:00
Xiaoyu ZhangandClaude Fable 5 071f0f1e9d [diffusion] ERNIE-Image: fuse rotate-half RoPE + GELU-mul and hoist rope cos/sin (denoise -16.2% H100 / -12.7% H200, bit-exact) (#34306)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-11 18:18:37 +08:00
Xiaoyu ZhangandClaude Fable 5 ba3dc16401 [diffusion] weight-only FP8: dequantize linear weights once at first use (Ideogram-4 denoise -18.8% H200 / -7.8% H100, bit-exact) (#34305)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-11 18:15:26 +08:00
Xiaoyu ZhangandClaude Fable 5 f5f0c3ee7a [diffusion] Z-Image single-GPU BCG: fix the replay crash and make output bit-exact vs eager (#34183) (#34210)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-10 22:18:32 +08:00
fd3036523a [diffusion] Clean up shared bitexact gates, helpers, and stale naming (#34180)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-10 22:14:09 +08:00
Xiaoyu ZhangandClaude Opus 4.8 441910f926 [diffusion] LTX-2 quality=high fused RMSNorm+modulate + FFN GELU epilogue (H200 ltx23-one-stage denoise 45.85->43.24 s, ~matches torch.compile) (#34172)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-10 09:46:17 +08:00
Xiaoyu ZhangandClaude Opus 4.8 56ef810cad [diffusion] BCG: auto-capture the default warmup resolution instead of hard-requiring --warmup-resolutions (H200 SANA denoise 0.73->0.457 s with a single flag) (#34174)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-10 08:37:32 +08:00
Xiaoyu Zhang f6cbdc1dd1 docs(diffusion): refresh skills for latest runtime (#34143) 2026-08-09 10:30:46 +08:00
Xiaoyu Zhang 38c007dfe5 [diffusion] FLUX.1: route the adaLN LN+modulate sites through the bit-exact fused LayerNorm+modulate kernel (H200 1024^2 lossless denoise -1.2%, e2e wall -2.9%) (#34126) 2026-08-09 09:52:37 +08:00
Xiaoyu ZhangandClaude Fable 5 6424fec326 [diffusion] Bit-exact data-movement elimination for the Wan causal VAE decoder (H200 LongLive2 704x1280x61f: decode 2.80->2.32 s lossless / 2.12->1.67 s quality=high, e2e -10.7%) (#34125)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-09 09:50:56 +08:00
Xiaoyu ZhangandClaude Fable 5 33ed5d4413 [diffusion] perf_logger: SYNC_STAGE_PROFILING must drain the GPU queue for stage records too (fixes 2-3x inflated DecodingStage readings) (#34124)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-09 09:49:52 +08:00
Xiaoyu Zhang dc9624deb2 [diffusion] Clean up kernels and shared fast paths (#34085) 2026-08-09 00:37:00 +08:00
Xiaoyu ZhangandClaude Fable 5 891445676c [diffusion] Sana: bit-exact fused aten LayerNorm+modulate under BCG (H200 denoise -4.8%) (#34015)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-08 16:05:25 +08:00
Xiaoyu ZhangandClaude Fable 5 5dffa06fe1 [diffusion] GLM-Image bit-exact fused aten LayerNorm+modulate / qk-LN (H200 30-step denoise -8.1%) (#34008)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-08 13:26:11 +08:00
Xiaoyu Zhang 148f15b0af [diffusion] FLUX.1 fused adaLN modulate (bit-exact) + RoPE cache hoist, LN-affine folding behind quality=high (H200 e2e -3.5% lossless / -6.9% high) (#34004) 2026-08-08 13:07:42 +08:00
Xiaoyu ZhangandClaude Fable 5 6c7498113f [diffusion] Enable breakable CUDA graph for SANA (H200 1024px e2e -26%, bit-exact) (#33989)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-07 23:54:39 +08:00
Xiaoyu Zhang d4be483efb [diffusion] Enable breakable CUDA graph for LTX-2 (H200 two-stage e2e 10.75 s -> 6.90 s, 1.56x) (#33885) 2026-08-07 22:29:14 +08:00
Xiaoyu ZhangandClaude Fable 5 572434e2f6 [diffusion] Z-Image bit-exact fused qk-norm (H200 Turbo 1024px e2e -6.4%) (#33886)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-07 17:03:28 +08:00
Xiaoyu ZhangandClaude Fable 5 591cfb0881 [diffusion] FLUX.2 bit-exact residual-gate fast path (H200 klein-4B 50-step denoise -1.2%) (#33823)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 22:54:40 +08:00
Xiaoyu ZhangandClaude Fable 5 dd98c9572a [diffusion] Generalize the FLUX.2 VAE decoder fast path to AutoencoderKL (Z-Image / FLUX.1) behind quality=high (#33818)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 22:53:15 +08:00
Xiaoyu ZhangandClaude Fable 5 3654740347 [diffusion] ERNIE-Image bit-exact fused RMSNorm+scale/shift (H200 1024^2 e2e 15.63 -> 15.00 s, denoise -3.3%) (#33854)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 19:58:44 +08:00
Xiaoyu ZhangandClaude Fable 5 295784723a [diffusion] Ideogram 4: fuse RMSNorm modulate/gate chains via the Z-Image Triton suite behind quality=high (H200 e2e -2.9%/-3.4%) (#33822)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 19:57:34 +08:00
Xiaoyu ZhangandClaude Fable 5 eff6a11350 [diffusion] FLUX.1 bit-exact residual-gate fast path + tanh-GELU epilogue behind quality=high (H200 e2e -1.1% lossless / -4.3% high) (#33819)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 19:56:38 +08:00
Xiaoyu ZhangandClaude Fable 5 b6876fc652 [diffusion] ERNIE-Image bit-exact residual-gate fast path (H200 1024^2 e2e 16.17 -> 15.75 s) (#33734)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 13:43:09 +08:00
Xiaoyu ZhangandClaude Fable 5 4c0a8940fa [Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 08:52:09 +08:00
Xiaoyu ZhangandMohammad Miadh Angkad ba12a16a62 [diffusion] Prefer cuDNN SDPA over FA4 for dense attention on sm_100 (B200) (#33655)
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-08-06 08:49:10 +08:00
Xiaoyu ZhangandClaude Fable 5 3425c93666 [diffusion] Wan VAE RMSNorm+SiLU fusion behind quality=high (H200 FastWan2.2 e2e 9.611 -> 9.125 s) (#33546)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-05 21:33:35 +08:00
Xiaoyu ZhangandClaude Fable 5 a5888c956f [diffusion] Pack Ulysses Q/K/V input all-to-all into one collective + reusable a2a staging buffers (#33667)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-05 19:15:46 +08:00
Xiaoyu ZhangandClaude Fable 5 95d0e57e83 [diffusion] Fuse DiT FFN tanh-GELU into up-proj GEMM (cublasLt epilogue) behind quality=high (Qwen-Image 1024^2 denoise 12.36 -> 12.05 s on H200) (#33536)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-04 23:49:43 +08:00
Xiaoyu Zhang 0d0c7d853f [diffusion] FLUX.2 VAE decoder fast path behind quality=high (H200: 1024^2 97.6->29.2 ms, 2048^2 437.2->168.5 ms) (#33451) 2026-08-04 23:48:19 +08:00
Xiaoyu ZhangandClaude Fable 5 c6f2a9c1d4 [diffusion] Restrict request-level quality to two validated tiers: lossless (default) and high (#33453)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-04 11:43:16 +08:00
Xiaoyu Zhang f829fb3ff7 [diffusion] Fix component accuracy topology reuse (#33317) 2026-08-04 08:35:03 +08:00
Xiaoyu ZhangandClaude Fable 5 4ef1660cd8 [Docs] MiniMax-H3: add measured H200 Ulysses4 vs TP2+Ulysses2 topology data (#33398)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-03 12:54:29 -07:00
Xiaoyu Zhang b64fd800d4 docs(diffusion): update skills for MiniMax-H3 (#33282) 2026-08-03 12:44:01 +08:00
fb207b72b0 feat(kernels): port standalone Kimi K3 kernels (#32890)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: zhangxiaolei <zhangxiaolei.666@bytedance.com>
2026-08-01 13:26:47 +08:00
Xiaoyu Zhang c5bd3d7dce [diffusion][benchmark] Add reproducible request-manifest offline benchmark (#32917) 2026-07-30 22:11:18 +08:00
Xiaoyu Zhang 7784ac8f91 [diffusion][docs] Fix Cosmos3 model sizes (#32916) 2026-07-30 22:10:23 +08:00
Xiaoyu Zhang 2e9c82b359 [Kernel] Remove unreachable AOT headers (#32842) 2026-07-30 22:08:57 +08:00
Xiaoyu Zhang 1d9c292547 [Kernel] Add inventory guards and clean benchmark layout (#32788) 2026-07-30 09:03:24 +08:00
Xiaoyu Zhang 0ebbe43dbb fix(diffusion): size VSA top-k from padded blocks (#32695) 2026-07-29 21:58:41 +08:00
Xiaoyu Zhang 4f5b50c576 perf(diffusion): decode Wan VAE in BF16 (#32697) 2026-07-29 21:57:50 +08:00
Xiaoyu Zhang 917e900d4d feat(diffusion): add regional torch compile (#32696) 2026-07-29 21:57:05 +08:00
Xiaoyu ZhangandClaude Fable 5 8742a1a0f8 Add a benchmark script for the HPC-Ops bf16xfp32 router GEMM (#32642)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-29 18:17:08 +08:00
Xiaoyu Zhang c32c4ef79c [Kernel] Move sgl-kernel under sglang.kernels.aot (#32648) 2026-07-29 17:25:00 +08:00
Xiaoyu Zhang c9947b087b Enable multimodal prefill BCG for VL and audio models (#30872) 2026-07-29 06:47:40 +08:00
Xiaoyu Zhang 7778dd23ea [diffusion] refactor: remove stale kernels and dead code (#32651) 2026-07-29 06:23:23 +08:00
Xiaoyu Zhang 9cffc2ba52 [Kernel] Remove unused implementations and stale registry entries (#32636) 2026-07-28 18:12:10 +08:00
8d6549bc40 [Attention Backend] Extend hpc_ops dynamic-scheduled decode to bf16 (#32304)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
2026-07-27 21:31:04 +08:00
3d91a569ce [MoE Backend] Add HPC-Ops FP8 MoE runner backend (#30541)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
2026-07-24 19:46:11 +08:00
841fa293b5 [Fix] Reject online weight updates while the HPC-Ops router GEMM split cache is active (#31943)
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-24 19:30:13 +08:00
Xiaoyu ZhangandClaude Fable 5 d4a0dfbc31 [Fix] Two root causes of the H100 deepep TBO CI break: scale-tensor use-after-free + missing non-finite quant sanitization (#32188)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-24 07:29:28 +08:00
Xiaoyu ZhangandClaude Opus 4.8 62aa85d9aa [Kernel] Sweep missed dedicated kernels into kernels.ops (moe/quant siblings + dspark) (RFC #29630) (#32160)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 17:07:16 +08:00
Xiaoyu ZhangandClaude Opus 4.8 11b0e5c5ad [Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630) (#32148)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 13:47:02 +08:00
Xiaoyu ZhangandClaude Opus 4.8 2d1a7be8c4 [Kernel] Reclassify kernel tests by ops group + move helpers out of the package (RFC #29630) (#32128)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 12:18:27 +08:00
Xiaoyu ZhangandClaude Opus 4.8 99f636a86f [Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels (#32072)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 08:35:09 +08:00
0a6d1930c3 [Attention Backend] Add HPC-Ops attention backend (#30540)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
2026-07-22 22:06:22 +08:00
Xiaoyu ZhangandClaude Opus 4.8 74338e94f1 [Kernel] Phase 4 batch-3: migrate tangled JIT subsystems + new groups into kernels.ops (RFC #29630) (#32045)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-22 21:15:03 +08:00
Xiaoyu ZhangandClaude Opus 4.8 977ea336cd [Kernel] Phase 4 batch-2: migrate JIT operator groups into kernels.ops (no shims) (RFC #29630) (#32015)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-22 17:49:51 +08:00