 Xiaoyu Zhang
|
444b29c932
|
[Diffusion] Clean up obsolete worker plumbing, dead helpers, and tests (#39293)
|
2026-09-16 12:11:45 +08:00 |
|
|
Xiaoyu Zhang
|
537ac52c5b
|
[SRT] Clean up no-op compiler pass, dead helpers, and migration tests (#39295)
|
2026-09-16 12:04:21 +08:00 |
|
|
Xiaoyu ZhangandMick Qian
|
23bc4c6ed9
|
[Diffusion] Return Qwen-Image-Layered outputs and preserve CFG2 rounding (#38549)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-13 09:15:47 +08:00 |
|
|
Xiaoyu ZhangandMick Qian
|
3e035a3513
|
[Diffusion] Optimize Qwen-Image-Edit attention on Hopper (#38584)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-13 09:15:01 +08:00 |
|
|
Xiaoyu ZhangandCursor
|
0a57403468
|
[Perf] Optimize Qwen3-VL unique-image serving on H100 (#36411)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-12 15:16:59 +08:00 |
|
|
Xiaoyu Zhang
|
d6b5dca90c
|
[Diffusion] Optimize SANA-WM convolution post-processing and streaming GDN (#38529)
|
2026-09-11 23:30:17 +08:00 |
|
|
Xiaoyu Zhang
|
7f09fbcd25
|
[Diffusion] Preserve BF16 rounding in Hopper LTX QKNorm and RoPE fusion (#38533)
|
2026-09-11 23:02:54 +08:00 |
|
|
Xiaoyu Zhang
|
a27be5ff62
|
[Diffusion] Enable lossless BCG for FLUX.1-dev (#38591)
|
2026-09-09 14:09:21 +08:00 |
|
|
Xiaoyu Zhang
|
03d06a764e
|
[Docs] Add measured JoyEcho H200 residency and BCG recipe (#38534)
|
2026-09-09 11:19:27 +08:00 |
|
|
Xiaoyu Zhang
|
2952c8d5ea
|
[Diffusion] Fuse LongCat Image normalization and modulation (#38530)
|
2026-09-09 11:12:17 +08:00 |
|
|
Xiaoyu Zhang
|
554f817948
|
[Diffusion] Optimize LTX-2 QKNorm and split RoPE on Hopper (#38396)
|
2026-09-08 19:05:02 +08:00 |
|
|
Xiaoyu ZhangandMick Qian
|
4d23a4fa6d
|
[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-07 15:13:59 +08:00 |
|
|
Xiaoyu Zhang
|
be00a543a7
|
perf: use Gumbel-max trick in the main sampler to cut decode CPU dispatch (#38117)
|
2026-09-06 22:40:27 +08:00 |
|
|
Xiaoyu Zhang
|
d61378af77
|
docs(diffusion): add per-model tuning decision table to performance guide (#38148)
|
2026-09-06 15:26:40 +08:00 |
|
|
Xiaoyu ZhangandWaterpine
|
ccf9fe6590
|
[Kernel] Add KDA FP8 skinny GEMM for SM120 (#38082)
Co-authored-by: Waterpine <biansonghz@gmail.com>
|
2026-09-05 22:27:06 +08:00 |
|
|
Xiaoyu Zhang
|
dc2843801d
|
perf(lfm2): fuse gating and short convolution on SM90 (#37622)
|
2026-09-05 21:52:16 +08:00 |
|
|
Xiaoyu Zhang
|
eda10c3678
|
[Diffusion] Enable breakable CUDA graph for JoyEcho (#38110)
|
2026-09-05 21:45:53 +08:00 |
|
|
|
bd16c22a04
|
[diffusion] fuse LingBot MoE group-limited top-k index selection (#38044)
Co-authored-by: BBuf <bbuf@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-05 18:12:30 +08:00 |
|
|
Xiaoyu ZhangandBBuf
|
d49180019b
|
fix(moe): cast filtered-activation expert_ids to int32 for torch.compile (#38085)
Co-authored-by: BBuf <bbuf@users.noreply.github.com>
|
2026-09-05 17:13:07 +08:00 |
|
|
Xiaoyu Zhang
|
a74470e904
|
fix(mamba): unify causal_conv1d col* dtype to x (MiniCPM-V-4.6 GDN prefill bf16/fp16 mismatch) (#38039)
|
2026-09-05 17:08:20 +08:00 |
|
|
Xiaoyu Zhang
|
da76fa073f
|
[diffusion] fix: fix host-resident vocab tables loaded on GPU (#38012)
|
2026-09-05 14:03:21 +08:00 |
|
|
Xiaoyu ZhangandBBuf
|
d6e0a8cbf4
|
[diffusion] add Helios per-token gated-residual fusion (quality-gated) (#38042)
Co-authored-by: BBuf <bbuf@users.noreply.github.com>
|
2026-09-05 10:29:09 +08:00 |
|
|
Xiaoyu ZhangandBBuf
|
bc727bc4ee
|
[FP8] SM120: route FP8 linear to per-tensor (cudnn/nvjet) instead of channelwise cutlass (#38006)
Co-authored-by: BBuf <bbuf@example.com>
|
2026-09-05 09:07:13 +08:00 |
|
|
Xiaoyu Zhang
|
85da5457de
|
[diffusion] auto-keep video DiT resident on high-memory GPUs (#38001)
|
2026-09-05 08:54:09 +08:00 |
|
|
Xiaoyu Zhang
|
f3b2725609
|
sm120 32GB mem-tier: raise decode cuda-graph max_bs 24->48 + chunked_prefill 2k->4k (#37898)
|
2026-09-04 18:47:26 +08:00 |
|
|
Xiaoyu Zhang
|
01e66a62db
|
[Diffusion] Improve BCG warmup frame-count diagnostics for video models (#37890)
|
2026-09-04 15:05:24 +08:00 |
|
|
Xiaoyu Zhang
|
54c2c99feb
|
[Diffusion] Fuse LingBot per-token gated residual and RMSNorm modulate (#37910)
|
2026-09-04 14:35:13 +08:00 |
|
|
Xiaoyu Zhang
|
06b8749803
|
[Diffusion][Docs] Add single-GPU large-VRAM performance notes (B300) (#37891)
|
2026-09-04 13:33:28 +08:00 |
|
|
Xiaoyu Zhang
|
397aeca376
|
fix(benchmark): support Glm4MoeLite in fused MoE tuner (#37623)
|
2026-09-03 17:21:42 +08:00 |
|
|
Xiaoyu Zhang
|
403a15c163
|
[CI] Batch CPU test workers (#37252)
|
2026-09-02 10:35:14 +08:00 |
|
|
Xiaoyu Zhang
|
1aa8299d1d
|
[Diffusion] Add cumulative extra-high quality tier (#37422)
|
2026-09-02 10:26:13 +08:00 |
|
|
Xiaoyu ZhangandCursor
|
f4c17fed07
|
[Diffusion] Fuse FLUX.2 NVFP4 FC1, SwiGLU, and FC2 quantization (#37096)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-02 08:21:14 +08:00 |
|
|
|
c593527f33
|
[Kernel] Add KDA NVFP4 GEMM for Qwen3.x on SM120 (#36865)
Co-authored-by: Song Bian <biansonghz@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-02 08:16:54 +08:00 |
|
|
|
ee462b5899
|
[Kernel] Add tuned LFM2.5 Triton MoE configs on B300 (#37158)
Co-authored-by: Song Bian <biansonghz@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-01 22:55:38 +08:00 |
|
|
Xiaoyu Zhang
|
5993f91f84
|
[Kernel] Register merged diffusion agent kernels with KDA backend (#37385)
|
2026-09-01 22:51:10 +08:00 |
|
|
Xiaoyu Zhang
|
4c7ff0d906
|
[CI] Double JIT kernel unit test timeout (#37435)
|
2026-09-01 22:37:37 +08:00 |
|
|
Xiaoyu ZhangandCursor
|
1c3ad92438
|
[Diffusion] Fuse FLUX.2 ModelOpt FP8 producers and QKV packing (#37162)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-01 16:14:29 +08:00 |
|
|
|
71cee04ebe
|
[Diffusion] Optimize Qwen-Image TP collectives and attention (#36680)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-01 10:28:37 +08:00 |
|
|
Xiaoyu ZhangandCursor
|
175973d834
|
[Diffusion] Fuse Qwen-Image residual norm and NVFP4 quantization (#37129)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-01 08:54:10 +08:00 |
|
|
Xiaoyu ZhangandCursor
|
079afaffb1
|
[Diffusion] Fuse FLUX.2 gated residual normalization on Blackwell (#37112)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-01 08:38:33 +08:00 |
|
|
Xiaoyu ZhangandCursor
|
6715debb2a
|
[Diffusion] Fuse Qwen-Image FP8 QKV projection and Blackwell epilogue (#37123)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-01 08:34:41 +08:00 |
|
|
Xiaoyu Zhang
|
52e1c24744
|
[Diffusion] Fuse FLUX.2 token concatenation and NVFP4 quantization (#37141)
|
2026-08-31 21:33:02 +08:00 |
|
|
Xiaoyu ZhangandSong Bian
|
d60d658f5f
|
[Kernel] Add GB300 Triton MoE configs for GLM-4.5 FP8 (#37159)
Co-authored-by: Song Bian <biansonghz@gmail.com>
|
2026-08-31 21:31:04 +08:00 |
|
|
Xiaoyu Zhang
|
771e613d96
|
[Diffusion] Fuse Qwen-Image final adaptive LayerNorm (#37144)
|
2026-08-31 18:22:20 +08:00 |
|
|
Xiaoyu ZhangandCursor
|
1ed9bfac2c
|
[Diffusion] Fuse Qwen-Image FP8 norm and activation quantization (#37156)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-31 18:19:42 +08:00 |
|
|
Xiaoyu Zhang
|
bb5e619860
|
[diffusion] perf: absorb Qwen-Image output projection biases (#37116)
|
2026-08-31 08:25:37 +08:00 |
|
|
Xiaoyu Zhang
|
5ab97c4f44
|
[Diffusion] Cache Qwen-Image modulation across serial CFG branches (#37090)
|
2026-08-31 01:40:29 +08:00 |
|
|
Xiaoyu Zhang
|
8c28cdd116
|
[Diffusion][Kernel] Fuse Wan2.2 NVFP4 bias + GELU on Blackwell (#37075)
|
2026-08-31 01:37:35 +08:00 |
|
|
Xiaoyu Zhang
|
0e1146d04f
|
[diffusion] optimization: optimize Pi0.5 inference and bounded graph serving (#34599)
|
2026-08-29 14:47:32 +08:00 |
|
|
Xiaoyu Zhang
|
db6f0a9d53
|
Refactor JIT kernel and expert-pack directory layout (#36704)
|
2026-08-29 07:41:25 +08:00 |
|
|
Xiaoyu Zhang
|
50bc1a3767
|
[diffusion] Keep Cosmos3 Nano resident on 96 GB GPUs (#36641)
|
2026-08-29 07:40:46 +08:00 |
|
|
Xiaoyu Zhang
|
96a4dcdde8
|
[CI] Slim JIT kernel unit tests (#36887)
|
2026-08-29 07:26:49 +08:00 |
|
|
Xiaoyu Zhang
|
eebb99c049
|
[diffusion][kernel] avoid 4D scale-shift autotuning (#36521)
|
2026-08-28 16:58:19 +08:00 |
|
|
Xiaoyu Zhang
|
45424d8434
|
[diffusion][kernel] support transposed residual-gate add (#36504)
|
2026-08-28 16:54:37 +08:00 |
|
|
Xiaoyu Zhang
|
96b31770f9
|
[diffusion] fuse Helios paired transposed RoPE (#36502)
|
2026-08-28 08:57:37 +08:00 |
|
|
Xiaoyu Zhang
|
024a7a1031
|
[diffusion] Fix native LingBot-Video text encoding (#36542)
|
2026-08-27 22:58:22 +08:00 |
|
|
Xiaoyu Zhang
|
a7e3f590ca
|
[Diffusion] Fuse LongCat residual gate updates (#36577)
|
2026-08-27 21:07:04 +08:00 |
|
|
Xiaoyu Zhang
|
e061dd1b47
|
[Diffusion][Kernel] Fuse Wan FFN GELU epilogue (#36592)
|
2026-08-27 21:06:28 +08:00 |
|
|
Xiaoyu Zhang
|
1af95ffded
|
[diffusion] Fuse Cosmos3 Nano T2I attention on Hopper (#36571)
|
2026-08-27 20:59:15 +08:00 |
|
|
Xiaoyu Zhang
|
db4125bb56
|
[diffusion] Accept mesh benchmark artifacts (#36553)
|
2026-08-27 20:53:25 +08:00 |
|
|
Xiaoyu Zhang
|
d42fa5e10a
|
[diffusion] align video BCG warmup frame count (#36485)
|
2026-08-27 20:52:00 +08:00 |
|
|
Xiaoyu Zhang
|
ad911a5ec0
|
[kernel] Tune LingBot-Video MoE TMA configs for H100 (#36543)
|
2026-08-27 02:47:32 -07:00 |
|
|
Xiaoyu Zhang
|
702de26310
|
[diffusion] make benchmark caches seedable and cover missing native families (#36463)
|
2026-08-26 19:04:46 +08:00 |
|
|
Xiaoyu Zhang
|
fa3ac61661
|
[Diffusion] Bound reusable Ulysses A2A staging buffers across shapes (#36327)
|
2026-08-26 10:57:29 +08:00 |
|
|
Xiaoyu Zhang
|
46b92b22e2
|
[diffusion] Accelerate LingBot Video RMSNorm in quality=high (#35969)
|
2026-08-24 18:02:00 +08:00 |
|
|
Xiaoyu Zhang
|
9866fe910b
|
[diffusion] Speed up LingBot high-quality VAE decode (#36024)
|
2026-08-24 14:13:03 +08:00 |
|
|
Xiaoyu Zhang
|
cc74aba330
|
[diffusion] Honor XDG cache for model overlays (#36019)
|
2026-08-24 14:11:26 +08:00 |
|
|
Xiaoyu Zhang
|
6d40b8aebf
|
[diffusion] Fix Hunyuan QKV pack indexing at production video shapes (#36009)
|
2026-08-24 13:39:26 +08:00 |
|
|
Xiaoyu Zhang
|
b43931e878
|
[diffusion] Refresh quality and BCG benchmark skills (#36016)
Signed-off-by: BBuf <1182563586@qq.com>
|
2026-08-24 13:37:45 +08:00 |
|
|
Xiaoyu Zhang
|
344613c159
|
[diffusion] Default Hunyuan VAE to tiled decode (#36012)
|
2026-08-24 13:18:06 +08:00 |
|
|
Xiaoyu Zhang
|
8dcfb3b5e7
|
[diffusion] Fuse LongCat-Image QKNorm and interleaved RoPE (#35995)
|
2026-08-24 12:07:26 +08:00 |
|
|
Xiaoyu Zhang
|
09592f5889
|
[diffusion] Keep LongLive2 components resident on large GPUs (#35993)
|
2026-08-24 12:06:52 +08:00 |
|
|
Xiaoyu Zhang
|
e129fe21e5
|
[diffusion] Flatten Wan VAE RMSNorm row addressing (#35981)
|
2026-08-24 08:57:54 +08:00 |
|
|
Xiaoyu Zhang
|
b2eb0fa51e
|
[diffusion] Keep Cosmos3 Nano resident on high-memory GPUs (#36000)
|
2026-08-24 08:51:58 +08:00 |
|
|
Xiaoyu Zhang
|
447048dba2
|
[diffusion] Reject unsafe quality=high BCG replay (#36008)
|
2026-08-24 08:50:26 +08:00 |
|
|
Xiaoyu Zhang
|
f4448e677f
|
[diffusion] Reuse SANA fast paths in SANA-Video BCG (#35961)
|
2026-08-24 08:47:04 +08:00 |
|
|
Xiaoyu Zhang
|
96bfd2476c
|
[diffusion] Enable SANA-Video breakable CUDA graphs (#35729)
|
2026-08-22 12:57:09 +08:00 |
|
|
Xiaoyu Zhang
|
83e9ece672
|
[diffusion] Fuse SANA-Video interleaved RoPE (#35695)
|
2026-08-22 12:56:45 +08:00 |
|
|
Xiaoyu Zhang
|
39d4d65a51
|
[diffusion] Accelerate SANA-Video linear attention in quality=high (#35728)
|
2026-08-21 18:05:43 +08:00 |
|
|
Xiaoyu Zhang
|
a5c52a9358
|
[diffusion] Enable LongCat breakable CUDA graphs (#35724)
|
2026-08-21 17:59:16 +08:00 |
|
|
Xiaoyu Zhang
|
7e80e889a2
|
[diffusion] Fuse LTX-2.5 decoder 3D RoPE (#35698)
|
2026-08-21 10:13:09 +08:00 |
|
|
Xiaoyu Zhang
|
04444ee352
|
[diffusion] Refresh eager optimization skills and benchmark safeguards (#35679)
|
2026-08-20 22:03:57 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 5
|
9113fc6d93
|
[docs] Add a fused-kernels page for SGLang Diffusion (#35436)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-19 16:32:42 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 5
|
ae6945e112
|
[kernels] Reorganize ops/diffusion by operator domain behind a lazy facade (#35114)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-18 20:37:43 +08:00 |
|
|
Xiaoyu Zhang
|
0aa09ab40d
|
[diffusion] Reuse bit-exact modulation fast path for LTX-2.3 (#34930)
|
2026-08-17 09:04:10 +08:00 |
|
|
Xiaoyu Zhang
|
41abbb0d32
|
[diffusion] Accelerate Cosmos3 T2I QKNorm+RoPE (#34932)
|
2026-08-16 20:15:32 +08:00 |
|
|
Xiaoyu Zhang
|
095ec6c997
|
[diffusion][kernel] Accelerate Sana BCG with bit-exact conv post-processing (#34928)
|
2026-08-16 20:05:57 +08:00 |
|
|
Xiaoyu Zhang
|
0761d3f3a4
|
[diffusion] Accelerate lossless Ideogram norm post-processing (#34931)
|
2026-08-16 17:20:09 +08:00 |
|
|
Xiaoyu Zhang
|
b752f1e533
|
[diffusion] Enable breakable CUDA graphs for LTX-2.3 (#34929)
|
2026-08-16 17:18:43 +08:00 |
|
|
Xiaoyu Zhang
|
0c072235f4
|
[diffusion] Bound overlong weight lock filenames (#34825)
|
2026-08-15 17:20:30 +08:00 |
|
|
Xiaoyu Zhang
|
9c9a3273be
|
[diffusion] Fix Helios denoising profiler stepping (#34826)
|
2026-08-14 23:21:54 +08:00 |
|
|
Xiaoyu Zhang
|
5f2a6d6422
|
[diffusion] Fix symbolic replicated-mode counting under torch.compile (#34824)
|
2026-08-14 23:20:29 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
704e512836
|
[GDN] Honor configured linear-attn verify backend in the kernel dispatcher (#34592)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-14 08:59:52 +08:00 |
|
|
Xiaoyu Zhang
|
c255fbc4fe
|
[Diffusion] Add @triple-mu as a code owner (#34748)
|
2026-08-14 00:37:49 +08:00 |
|
|
Xiaoyu Zhang
|
ebca0bbde4
|
[Diffusion][ERNIE] Fuse QKNorm with full-width RoPE (#34620)
|
2026-08-13 23:23:21 +08:00 |
|
|
Xiaoyu Zhang
|
82f7afb881
|
[Diffusion] Make auto residency decisions component-scoped (#34615)
|
2026-08-13 23:20:55 +08:00 |
|
|
Xiaoyu Zhang
|
74c0322342
|
[Diffusion][FLUX.2] Fuse eager AdaLN and packed SwiGLU (#34616)
|
2026-08-13 19:55:53 +08:00 |
|
|
Xiaoyu Zhang
|
3c1791a7df
|
[Diffusion][HunyuanVideo] Fuse eager QKV packing and high-quality QKNorm (#34617)
|
2026-08-13 19:54:00 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
a23670ddbf
|
[diffusion] Wan2.2-TI2V: fuse per-token adaLN table add into contiguous slices + hoist rope cache (denoise -13.1% H100 / -12.6% H200, bit-exact; eager beats compile) (#34584)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-13 17:26:46 +08:00 |
|
|
Xiaoyu Zhang
|
26579d893e
|
[Diffusion][GLM-Image] Retune QK head LayerNorm for SM103 (#34619)
|
2026-08-13 10:49:13 +08:00 |
|