Commit Graph
16500 Commits
Author SHA1 Message Date
elvischenv 4f883636a2 [Perf] FlashInfer MLA: remove blocking D2H in spec-decode plan (#27689) 2026-08-12 12:29:03 -07:00
Ke Bao 3974b00359 Add bit-exact unified radix cache KL test for hybrid SWA + mamba (#34607) 2026-08-13 02:15:36 +08:00
773faf992d Reserve multimodal runtime allocations and keep padded inputs aligned (#34141)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: wangwenchen0407 <wangwenchen@meta.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
2026-08-12 11:04:07 -07:00
YAMY e6250c7c70 docs: update Qwen3.8 disaggregated serving configs (#34601) 2026-08-12 11:02:35 -07:00
Ke Bao 126010c373 [misc] update CI_PERMISSIONS.json (#34610) 2026-08-13 01:58:21 +08:00
b501311fa1 [Kimi K3] Fuse MLA gate projection into QKV-A GEMM (#33623)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-08-13 00:21:34 +08:00
yiheng 8549cce11b [BugFix] Fix race in c128 prefill plan kernel on ragged extend (#32467)
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
2026-08-13 00:15:41 +08:00
Xinyuan Tong d21eefc94f [Docs] Rename Qwen3.8-Max-DSpark to Qwen3.8-2.4T-A95B-DSpark (#34590) 2026-08-12 15:25:48 +00:00
Mick ad47dde65c [diffusion] optimize: fuse cosmos qk norm, rope, and kv packing (#34275) 2026-08-12 23:18:16 +08:00
Yichi Zhang f28bc5a6de docs(cookbook): add BF16 recipes to Nemotron 3.5 Lightning (#34573) 2026-08-12 08:15:34 -07:00
zijiexiaandClaude Opus 5 8e7c07fae7 [Docs] Add Qwen3.8 cookbook (#34587)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-12 08:07:46 -07:00
McZyWu 197832bcf5 [Kimi-K3][NPU] Support Kimi-K3 on NPU (#33465) 2026-08-12 21:20:14 +08:00
Mick dc5f6c4883 [diffusion] optimize: stream and parallelize bit-exact video output saves (#34564) 2026-08-12 20:03:37 +08:00
Mick 9701cc138c [diffusion] optimize: optimize bit-exact h3 reference video ingress (#34563) 2026-08-12 20:02:49 +08:00
Zhaoyi Li 9deb6952af [AMD][DI][CI] Add GLM-5.2 MXFP4 wide-EP16 2P1D nightly recipes (#34476) 2026-08-12 03:53:14 -07:00
ajith-sirra-amdandgiovanniguastiamd b5d1453ed2 [AMD] GLM 5.2 MXFP4 SGLANG COOKBOOK (#34379)
Signed-off-by: Sirra <asirra@amd.com>
Co-authored-by: giovanniguastiamd <giovanni.guasti@amd.com>
2026-08-12 03:39:25 -07:00
00bdafe944 [AMD][CI] Swap the AMD PR gate to ROCm 7.2 and demote ROCm 7.0 to a daily shadow (#34204)
Co-authored-by: yctseng0211 <yctseng@smci355-ccs-aus-m12-17.cs-aus.dcgpu>
Co-authored-by: Chen <bingxche@amd.com>
2026-08-12 03:31:03 -07:00
Mick b3bffef70a [diffusion] UX: suppress noisy worker startup warnings (#34512) 2026-08-12 17:53:45 +08:00
Mick 644d55ebfa [diffusion] feat: support native and peft minimax h3 loras (#34359) 2026-08-12 17:52:40 +08:00
Mohammad Miadh Angkad 00e57d74f0 Bump FlashInfer to 0.6.17 and remove Kimi K3 workarounds (#33997) 2026-08-12 02:17:26 -07:00
Yuzhen Zhou 2d76d537e5 feat: support deterministic FA4 for GLM-4.7-Flash (#33945) 2026-08-12 16:57:34 +08:00
Xiaoyu Zhang 1f008dc226 [Diffusion][LTX-2] Allocate AdaLN outputs from one contiguous slab (#34508) 2026-08-12 16:28:27 +08:00
Xiaoyu Zhang daae3acb36 [Diffusion][Z-Image] Tune native QK RMSNorm launch for SM103 (#34507) 2026-08-12 16:27:44 +08:00
Xiaoyu Zhang 4827061247 [Diffusion] Make weight-only FP8 dequant cache torch.compile-safe (#34506) 2026-08-12 16:26:31 +08:00
Xiaoyu Zhang 84ce7502cf [Diffusion][MiniMax H3] Extend exact QKNorm+RoPE rounding to SM103 (#34505) 2026-08-12 16:25:24 +08:00
Xiaoyu Zhang 45f7063335 [Diffusion] Tune QK head LayerNorm for SM103 (#34503) 2026-08-12 16:24:18 +08:00
Sam ShleiferandClaude Fable 5 a2e88279c2 metrics: don't clock-rebase unset time sentinels in ReqTimeStats deserialization (#34335)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-12 14:27:47 +08:00
Xinyu Jiang 793a11dd27 [AMD] Publish an undated tag for the miles nightly images (#34521) 2026-08-12 14:27:23 +08:00
Mohammad Miadh Angkad 0dab252ffc Fix DFlash sliding attention causality defaults (#34524) 2026-08-11 23:05:55 -07:00
Xinyuan Tong 687967c70d Fix tokenizer warning filtering for processors (#34500) 2026-08-11 22:26:44 -07:00
Liangsheng Yin 9d2d737ebf [Benchmark] Remove 22 unmaintained benchmarks (#34520) 2026-08-11 22:24:43 -07:00
Juan MunetonandMa Mingfei cac3269305 [XPU] Fix NemotronH (hybrid mamba2) launch on --device xpu (#32227)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-12 13:23:23 +08:00
Liangsheng Yin 256981ce16 [CI] Align rerun-test environment with the test stages (#34195) 2026-08-11 21:37:10 -07:00
Xiaoyu Zhang 22e4b3a81f [Diffusion] Avoid slow cuBLASLt GELU epilogue on SM120 (#34350) 2026-08-12 12:12:00 +08:00
Mick a9a355774a [diffusion] feat: support dynamically cpu offload components (#34391) 2026-08-12 11:38:27 +08:00
+3 5899674504 [Fix] Make DeepSeek-V4 reasoning and tool-call streaming parsing chunk-invariant (#34458)
Co-authored-by: hao-cyber <89575785+hao-cyber@users.noreply.github.com>
Co-authored-by: Enrico Falco <enrico9034@gmail.com>
Co-authored-by: Svyatoslav <85786374+slivanovich@users.noreply.github.com>
Co-authored-by: Andreas Hassellof <andreas@ombori.com>
Co-authored-by: Leoyzen <leoyzen@gmail.com>
Co-authored-by: Chenglun Hu <chenglunhu@gmail.com>
Co-authored-by: robellliu-dev <robell.liu@huawei.com>
Co-authored-by: Gavin.Zhu <gavin.z@gmicloud.ai>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: tancheng33 <garrytancheng@gmail.com>
Co-authored-by: dineshx29 <dinesh.b.offl@gmail.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
2026-08-11 20:03:28 -07:00
Mick 2be9773a21 [diffusion] doc: update cosmos3 edge and distilled cookbook (#34497) 2026-08-12 10:51:11 +08:00
Xiaoyu Zhang 4aff4b1822 [Diffusion] Improve bit-exact fusion fallback diagnostics (#34412) 2026-08-12 10:42:48 +08:00
Xiaoyu Zhang 3f9d184833 [Diffusion] Tune QK head LayerNorm for SM120 (#34349) 2026-08-12 10:41:54 +08:00
f7b6800b22 [diffusion] model: support cosmos3 edge and distilled (#31590)
Co-authored-by: Kedi Wu <31940276+kediwu0331@users.noreply.github.com>
Co-authored-by: Kedi Wu <kediw@nvidia.com>
2026-08-12 10:29:40 +08:00
MickandClaude Opus 5 81c88da1ab [diffusion] fix: nightly diffusion benchmark passes the retired --warmup flag (#34423)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-12 10:25:14 +08:00
NVShreyasandClaude Opus 4.8 30cb848d4b [Bugfix][DSA] Fix num_splits "(b+1)" crash on prefill-CP speculative decode (#34443)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-11 19:13:49 -07:00
Xiaoyu Zhang a53d3636ce [diffusion][model] Add native SANA-Video T2V support (#32921) 2026-08-12 10:07:24 +08:00
zijiec 93e9db5eb8 [Fix][Qwen]: fused shared-expert detection PP-safe protection (#34447) 2026-08-11 18:50:05 -07:00
Xiaoyu ZhangandClaude Fable 5 37c631ef23 [diffusion] Ideogram-4: fuse Qwen3-style RoPE and SwiGLU silu-mul (denoise -5.1% H100 / -4.7% H200, bit-exact) (#34314)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-12 09:19:35 +08:00
Xiaoyu Zhang b1b8ce715b [Diffusion][MiniMax H3] Fix SM120 QKNorm+RoPE rounding (#34347) 2026-08-12 09:18:16 +08:00
Mick a2d723820e [diffusion] fix: fix model-driven dit layerwise offload auto policy (#34401) 2026-08-12 09:08:31 +08:00
Yanbin Jiang 1ce515a53d Refocus LoRA tests on regression coverage (#34464) 2026-08-11 17:37:52 -07:00
Shu Wang c7c03ec53b [NVIDIA] Add flashinfer MNNVL backend for allreduce only (#30700) 2026-08-11 16:46:46 -07:00
Baizhou Zhang 983dfd6a9a [Misc] Sanitize the structure of environ.py (#34472) 2026-08-11 16:31:33 -07:00