 Xiaoyu Zhang
|
3c1791a7df
|
[Diffusion][HunyuanVideo] Fuse eager QKV packing and high-quality QKNorm (#34617)
|
2026-08-13 19:54:00 +08:00 |
|
|
triple-muandXiaoyu Zhang
|
993e24df75
|
[diffusion] Add --dit-layerwise-residency-policy for strided DiT residency (#34534)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-13 19:49:56 +08:00 |
|
|
Liu ZhenlongandXiaoyu Zhang
|
b764194e81
|
[diffusion] model: support LongCat-Image (#23274)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-13 19:48:26 +08:00 |
|
|
Estrella-xx
|
eea2e5d6e5
|
Optimize delayed sample and mrope position computation (#32637)
|
2026-08-13 19:15:47 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
a23670ddbf
|
[diffusion] Wan2.2-TI2V: fuse per-token adaLN table add into contiguous slices + hoist rope cache (denoise -13.1% H100 / -12.6% H200, bit-exact; eager beats compile) (#34584)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-13 17:26:46 +08:00 |
|
|
|
34206c0017
|
[AMD] Run V4 MTP target-verify through the decode kernel (#34597)
Co-authored-by: RolaoDenthu <xinyis10@illinois.edu>
Co-authored-by: 1am9trash <1am9trash>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
|
2026-08-13 02:00:45 -07:00 |
|
|
Rainchar9119
|
dbebc1deb4
|
[Perf] Occupancy tuning for DSA indexer fp8-quant Q kernel (#32755)
Signed-off-by: Rainchar9119 <1134601163@qq.com>
|
2026-08-13 01:15:27 -07:00 |
|
|
|
fad376d3ee
|
[CPU][QUANT] add amx cpu support for auto-round (#29593)
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Signed-off-by: sys-lpot-val <sys_lpot_val@intel.com>
Co-authored-by: sys-lpot-val <sys_lpot_val@intel.com>
Co-authored-by: Weiwei Zhang <WeiweiZhang1@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-08-13 15:50:59 +08:00 |
|
|
Xinyi SongandThomas Wang
|
c034120cb8
|
[AMD] Enable draft-extend CUDA graph and reduce bubble for MTP (#29202)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-08-13 00:50:19 -07:00 |
|
|
AMD-yanfeiwangandZhangheng
|
a34f81251f
|
fix(hicache/umbp): support DeepSeek-V4 hybrid HostPoolGroup (multi-po… (#30762)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-08-13 15:40:07 +08:00 |
|
|
jacky.cheng
|
b7f87a2513
|
[AMD][Perf] Fuse GatedDeltaNet QKVZBA split/reshape/cat into a single Triton kernel for Qwen3.5-architecture MoE on HIP (#34421)
|
2026-08-13 00:18:35 -07:00 |
|
|
Ke Bao
|
5a5c3d309b
|
Drop the mmlu case from the unified radix cache kit (#34667)
|
2026-08-13 15:16:05 +08:00 |
|
|
Xinguo Zhu
|
3f6ef01322
|
Optimize MiniMax-M2.7 on CPU (#31956)
|
2026-08-13 15:04:16 +08:00 |
|
|
Gabriel Wu
|
889c2f31aa
|
feat(attention): add architecture-owned SM12x FA4 kernels (#32991)
|
2026-08-12 23:58:42 -07:00 |
|
|
Ke Bao
|
ebc144ce3f
|
Enable unified cache out-of-window slot freeing by default (#34653)
|
2026-08-13 14:31:42 +08:00 |
|
|
Mick
|
e8c7dddfa0
|
[VLM] add content-addressed preprocessing cache infrastructure (#34398)
|
2026-08-13 14:09:07 +08:00 |
|
|
elvischenv
|
035c622a14
|
Reenable breakable CUDA graph for NemotronH (#34538)
|
2026-08-13 13:58:10 +08:00 |
|
|
|
ef7208d41d
|
[kernel] add triton moe TMA up support (#33559)
Co-authored-by: undefined <zhouchen.arrebol@jd.com>
Co-authored-by: xq25478 <xq25478@qq.com>
Co-authored-by: xieminghe.simon <xieminghe.simon@jd.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-13 13:29:32 +08:00 |
|
|
Mick
|
69bf601e3c
|
fix: restore VLM nightly regression coverage (#34662)
|
2026-08-12 21:47:16 -07:00 |
|
|
Liangsheng Yin
|
8761b971f1
|
[CI] Fix nightly test failures (#34637)
|
2026-08-12 20:53:44 -07:00 |
|
|
Liangsheng Yin
|
26627e999d
|
[Fix] Snapshot req.prefix_indices when the prefix cache is disabled (#34644)
|
2026-08-12 20:50:46 -07:00 |
|
|
+76
|
bca8ed4afc
|
[minimax m3][npu]Adaptation of Minimax M3(w8a8) for NPU platforms [1/2] (#32941)
Signed-off-by: Devashish Lal <devcode@fb.com>
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Signed-off-by: Ryan Stewart <rystewart@nvidia.com>
Co-authored-by: ClownBin <chaobin1993@126.com>
Co-authored-by: huangzhenyu <q_m_p@qq.com>
Co-authored-by: clown <17490516+ClownBin@users.noreply.github.com>
Co-authored-by: badmer <374330057@qq.com.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Jimmy Shong <jimmysh341@gmail.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: siyu <liusy58@linux.alibaba.com>
Co-authored-by: Yuang Chen <cya539102@antgroup.com>
Co-authored-by: Yuang Chen <1131578721@qq.com>
Co-authored-by: 黄孝君 <dingfangsu23@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: TobyMint <130973409+TobyMint@users.noreply.github.com>
Co-authored-by: TobyMint <tobymint@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Tan Trinh <84185999+tanth47@users.noreply.github.com>
Co-authored-by: Lifan Shen <draftbks@gmail.com>
Co-authored-by: Justin Tong <justintong0323@outlook.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: AMD-yanfeiwang <yanfei.wang@amd.com>
Co-authored-by: QIN2DIM <62018067+QIN2DIM@users.noreply.github.com>
Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: DevashishLal-CB <devashish@rivosinc.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Michael Gschwind <mkgschwind+private@gmail.com>
Co-authored-by: weireweire <weiliangl@nvidia.com>
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: milesial <milesial@users.noreply.github.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: cctry <csycfl@gmail.com>
Co-authored-by: Jae B. <jlee5814@gmail.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
Co-authored-by: forrestl <16055533+forrestl111@users.noreply.github.com>
Co-authored-by: EchO <117733745+CyberSecurityErial@users.noreply.github.com>
Co-authored-by: Tanmay patil <tanmaypatil3151@gmail.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Hsiu-Chun, Hung <160560375+Emmanuel0612@users.noreply.github.com>
Co-authored-by: Hung <Emmanuel0612@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
Co-authored-by: Cherry_ming <136634645@qq.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Tingwei Huang <huangtingwei9988@gmail.com>
Co-authored-by: Kaixi <kaiximatteoc@nvidia.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Co-authored-by: Ryan Stewart <rystewart@nvidia.com>
Co-authored-by: gjsheu <gjsheu@163.com>
Co-authored-by: Jinyan Yi <yjy20010615@gmail.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
Co-authored-by: Jeremy Zhang <jeremy.zhang866@gmail.com>
Co-authored-by: Dmitrii Sergeev <dmi.sergeev@gmail.com>
Co-authored-by: Hao Zhang <zhisbug@users.noreply.github.com>
Co-authored-by: zhisbug <1654062+zhisbug@users.noreply.github.com>
Co-authored-by: Douglas Yang <dyang@college.harvard.edu>
Co-authored-by: gongwei1027 <gongwei833x@gmail.com>
Co-authored-by: ilyasher-harmonic <ilya.sherstyuk@harmonic.fun>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>
Co-authored-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
Co-authored-by: zijiec <zijie.chen@amd.com>
|
2026-08-13 11:23:14 +08:00 |
|
|
Xiaoyu Zhang
|
26579d893e
|
[Diffusion][GLM-Image] Retune QK head LayerNorm for SM103 (#34619)
|
2026-08-13 10:49:13 +08:00 |
|
|
Liangsheng Yin
|
50cc1aa241
|
[CI] Route mmlu and GB300 MMMU-Pro evals through sgl-eval (#34477)
|
2026-08-12 19:33:21 -07:00 |
|
|
Carrie ChenandBrayden Zhong
|
6a5a9eccaa
|
add flashinfer cute-dsl backend for mxfp8 gemm (#34042)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-08-13 08:50:01 +08:00 |
|
|
Lukas Humbel
|
40eaf34428
|
fix: make automatic NUMA binding configurable (#30394)
|
2026-08-12 17:40:28 -07:00 |
|
|
Mohammad Miadh Angkad
|
aefe2d0207
|
Revert "[Kimi K3] Fuse MLA gate projection into QKV-A GEMM" (#34642)
|
2026-08-13 08:35:38 +08:00 |
|
|
|
bbda7f32b1
|
[AMD][CI] CI: fix AMD 2-GPU multimodal-gen partition-count abort (#34328)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
|
2026-08-13 08:32:33 +08:00 |
|
|
jthomson04
|
385903b0ac
|
feat: add cache salt support to KV cache events (#30827)
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
|
2026-08-12 16:14:04 -07:00 |
|
|
Khoa PhamandClaude Opus 5
|
6c6294b7be
|
[DCP] Fuse the a2a pack/unpack copies in the MLA LSE reduce (#34614)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-12 16:04:46 -07:00 |
|
|
Liangsheng Yin
|
c05eb856f7
|
[CI] Fix nightly test failures (#34523)
|
2026-08-12 15:40:20 -07:00 |
|
|
binbin Deng
|
2b4381956f
|
fix(glm5.2): restrict MoE weights to local PP layers (#33793)
|
2026-08-12 12:32:08 -07:00 |
|
|
elvischenv
|
4f883636a2
|
[Perf] FlashInfer MLA: remove blocking D2H in spec-decode plan (#27689)
|
2026-08-12 12:29:03 -07:00 |
|
|
|
773faf992d
|
Reserve multimodal runtime allocations and keep padded inputs aligned (#34141)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: wangwenchen0407 <wangwenchen@meta.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
|
2026-08-12 11:04:07 -07:00 |
|
|
|
b501311fa1
|
[Kimi K3] Fuse MLA gate projection into QKV-A GEMM (#33623)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-13 00:21:34 +08:00 |
|
|
yiheng
|
8549cce11b
|
[BugFix] Fix race in c128 prefill plan kernel on ragged extend (#32467)
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
|
2026-08-13 00:15:41 +08:00 |
|
|
Mick
|
ad47dde65c
|
[diffusion] optimize: fuse cosmos qk norm, rope, and kv packing (#34275)
|
2026-08-12 23:18:16 +08:00 |
|
|
McZyWu
|
197832bcf5
|
[Kimi-K3][NPU] Support Kimi-K3 on NPU (#33465)
|
2026-08-12 21:20:14 +08:00 |
|
|
Mick
|
dc5f6c4883
|
[diffusion] optimize: stream and parallelize bit-exact video output saves (#34564)
|
2026-08-12 20:03:37 +08:00 |
|
|
Mick
|
9701cc138c
|
[diffusion] optimize: optimize bit-exact h3 reference video ingress (#34563)
|
2026-08-12 20:02:49 +08:00 |
|
|
Mick
|
b3bffef70a
|
[diffusion] UX: suppress noisy worker startup warnings (#34512)
|
2026-08-12 17:53:45 +08:00 |
|
|
Mick
|
644d55ebfa
|
[diffusion] feat: support native and peft minimax h3 loras (#34359)
|
2026-08-12 17:52:40 +08:00 |
|
|
Mohammad Miadh Angkad
|
00e57d74f0
|
Bump FlashInfer to 0.6.17 and remove Kimi K3 workarounds (#33997)
|
2026-08-12 02:17:26 -07:00 |
|
|
Yuzhen Zhou
|
2d76d537e5
|
feat: support deterministic FA4 for GLM-4.7-Flash (#33945)
|
2026-08-12 16:57:34 +08:00 |
|
|
Xiaoyu Zhang
|
1f008dc226
|
[Diffusion][LTX-2] Allocate AdaLN outputs from one contiguous slab (#34508)
|
2026-08-12 16:28:27 +08:00 |
|
|
Xiaoyu Zhang
|
daae3acb36
|
[Diffusion][Z-Image] Tune native QK RMSNorm launch for SM103 (#34507)
|
2026-08-12 16:27:44 +08:00 |
|
|
Xiaoyu Zhang
|
4827061247
|
[Diffusion] Make weight-only FP8 dequant cache torch.compile-safe (#34506)
|
2026-08-12 16:26:31 +08:00 |
|
|
Xiaoyu Zhang
|
84ce7502cf
|
[Diffusion][MiniMax H3] Extend exact QKNorm+RoPE rounding to SM103 (#34505)
|
2026-08-12 16:25:24 +08:00 |
|
|
Xiaoyu Zhang
|
45f7063335
|
[Diffusion] Tune QK head LayerNorm for SM103 (#34503)
|
2026-08-12 16:24:18 +08:00 |
|
|
Sam ShleiferandClaude Fable 5
|
a2e88279c2
|
metrics: don't clock-rebase unset time sentinels in ReqTimeStats deserialization (#34335)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-12 14:27:47 +08:00 |
|