Commit Graph
19401 Commits
Author SHA1 Message Date
MickandMick Qian dd2ffdb680 [diffusion] nightly: keep nightly regression baselines on a comparable methodology (#42226)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 15:19:21 +08:00
438d9d2074 [Feature] DeepEP v2: expanded (do_expand=True) prefill dispatch (#37261)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-10-05 00:02:10 -07:00
cafb37a10d [JIT] Fuse FP8 KV-cache quantization into the prefix-valid commit kernel (#40785)
Co-authored-by: Jayden Yu <jaydenyu@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-05 14:47:54 +08:00
WenhaoZhangandMick Qian f218798006 [diffusion] CI: relax the load latency check and extend the 2-GPU retry deadline (#42505)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 14:43:27 +08:00
520d6d0229 [DSv4.1] Prefill indexer: raw selection, row-pair schedule ids, no host syncs (#41659)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-05 14:33:37 +08:00
Liangsheng Yin 503b898540 [Session] Count streaming session KV by owner in pool accounting (#42539) 2026-10-04 22:15:57 -07:00
Michael 456d533e61 Revert "[AMD][ROCm] Keep cos_sin_cache fp32 on HIP for fused QSA indexer kernel (#41282)" (#42541) 2026-10-04 21:59:12 -07:00
Liangsheng Yin 1818db4e54 [CI] Drop the echoed command from /rerun-test result replies (#42543) 2026-10-04 21:50:53 -07:00
ashwini rathi b1bbd74f28 [XPU][CI] Disable test_xpu_graph until tc_piecewise is removed (#41634) (#42524) 2026-10-05 11:09:26 +08:00
Xiaoyu Zhang f385390be5 [Refactor] Simplify GDN, vision RoPE and MLA kernel dispatch (#42506) 2026-10-05 09:37:53 +08:00
734cf3cf3b [PD] Reload NIXL peer metadata after the peer is invalidated (#41691)
Co-authored-by: agent <agent@local>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
2026-10-05 00:49:26 +00:00
Yuwei An f70e8c68fc [Dsv4.1] Bounded replay with sparse mla path (#42273) 2026-10-04 17:19:14 -07:00
Eric.Chin.AMDandBingxu Chen b792228b35 [ROCm] topk v2: split one long row across blocks, the CDNA cluster-path equivalent (#39931)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-10-04 16:54:37 -07:00
Cheng Wan 1f299e9f2f [Refactor] Build layer stacks in order with append_stages (#42481) 2026-10-04 16:40:24 -07:00
Cheng Wan a99567ab74 [Fix] GigaChat 3.5: build the stage boundaries once (#42480) 2026-10-04 16:39:34 -07:00
Cheng Wan 5c8fb9e938 [Fix] Offer the fused MoE finalize all-reduce only to a block that owes the sum (#42479) 2026-10-04 16:39:06 -07:00
Cheng Wan f07c1a398e [Refactor] Build the Qwen4 experimental decoders from stage boundaries (#42478) 2026-10-04 16:38:36 -07:00
Cheng Wan 92d60351e2 [Refactor] Build the Hunyuan V4 decoder from stage boundaries (#42477) 2026-10-04 16:38:03 -07:00
Lianmin Zhengandjiayisuse f5ccc4d7d9 [Kernel] Use explicit reciprocal scaling for recurrent Q/K normalization (#42486)
Co-authored-by: jiayisuse <jiayisuse@users.noreply.github.com>
2026-10-04 15:30:03 -07:00
Tarang Khanna d475b5a25c [weight_cache] Coordinate daemon readiness across ranks (#38828) 2026-10-04 15:20:13 -07:00
Aditya Sharma caf96324fc [Apple Silicon] Add an Apple Silicon (MPS) platform to the standard Torch model runner (#36780) 2026-10-04 15:03:40 -07:00
SuperSongandCheng Wan bab04cd791 fix(unified-memory): propagate unified-memory lazy checkpoint policy and handle unallocated session slots (#42072)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
2026-10-04 12:51:22 -07:00
Mohammad Miadh AngkadandMohammad Angkad fea3c088a1 [CI] Temporarily disable GB300 (#42463)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-04 12:24:04 -07:00
Zhang, Jiejingandkyle-256 aa0ce20201 [ROCm] GLM-5.2 decode path: decode-shaped MoE/MLA tiles, split speculative softmax, and bf16 GEMM routing (#41725)
Co-authored-by: kyle-256 <Kyle.Zhao@amd.com>
2026-10-04 11:19:37 -07:00
Xiaoyu Zhang 7a719e9a65 [AMD] Fix RoPE cache dtype and diffusion CI failures (#42494) 2026-10-05 00:36:26 +08:00
billishyahao 0343bc1483 [AMD][Docs] fix mori io and umbp playground (#42512) 2026-10-04 09:28:11 -07:00
Shuwen Wang 137c084000 [HiCache] refactor: retire in-flight storage prefetches through one helper (#41453) 2026-10-05 00:13:07 +08:00
WenhaoZhang affa261e3d [diffusion] feat: enable cuda graphs for observation encoding and denoising steps for action models (#42171) 2026-10-04 22:22:08 +08:00
WenhaoZhang 279d3f3888 [diffusion] feat: load ComfyUI/ai-toolkit fused gate_up LoRAs and diffusers metadata alpha for qwen-image-2.1 (#42174) 2026-10-04 22:21:13 +08:00
WenhaoZhang 44fac689f5 [diffusion] optimization: decode json pixel lists to numpy at the entrypoint (#41895) 2026-10-04 22:20:20 +08:00
Michael ab9d8f029c [AMD][DI][CI] mi355x spur: skip RDMA ports that are not PORT_ACTIVE; dump driver log on failure (#41405) 2026-10-04 21:23:54 +08:00
Shuwen Wang 35f3c96ff4 [CI] Fix bootstrap sender registration test on main (#42487) 2026-10-04 18:45:31 +08:00
Shangming CaiandClaude Opus 5 148da8e77d [PD] Validate decode state layout once at registration (#42051)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-10-04 18:32:30 +08:00
Xiaoyu Zhang bc5a055dd7 [diffusion] move kernel validation into launchers and simplify dispatch (#42391) 2026-10-04 18:23:29 +08:00
Michael 29bcb74a89 [AMD][CI] Fix ROCm kernel wheel sources: drop eagle_utils, add DSV4 kernels (#42461) 2026-10-04 17:54:28 +08:00
SuperSongandCheng Wan 6cec8f98ce [Bugfix] Fix unified-memory compaction gates and pending page reuse (#39982)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
2026-10-04 02:48:08 -07:00
SuperSongandCheng Wan 1d02a36bb7 fix(inkling): translate unified-memory checkpoint destinations to physical slots (#38229)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
2026-10-04 02:45:45 -07:00
WenhaoZhangandClaude Opus 5.5 1e490772e5 [diffusion] fix: pin the JoyAI-Echo overlay's source revision (#42471)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-04 17:19:09 +08:00
ba68306256 [diffusion] feat: let requests choose the video libx264 preset (#41797)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-04 16:22:36 +08:00
Tokha233andWenhaoZhang fbce0d9478 [diffusion] fix: load serialized h3 INT8 in ComfyUI integrated mode (#42121)
Signed-off-by: Tokha233 <61346912+Tokha233@users.noreply.github.com>
Co-authored-by: WenhaoZhang <42087078+niehen6174@users.noreply.github.com>
2026-10-04 16:08:56 +08:00
Mohammad Miadh AngkadandMohammad Angkad 0bdd0cc8dc [Deps] Upgrade the CUDA PyTorch stack to 2.14 (#38641)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-04 00:48:02 -07:00
Kotthagattu Meher Sai 9631f6f2d0 [XPU] Enable fused QK-norm + RoPE for Qwen3-MoE (#40190) 2026-10-04 15:45:18 +08:00
Mohammad Miadh AngkadandMohammad Angkad 7eb628612c [Fix] Publish the parallel config the CLIP attention test reads (#42460)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-04 00:44:51 -07:00
Baizhou Zhang 55c5415c17 [CP] Support scattered interleave CP inputs with expert parallelism (#42041) 2026-10-04 00:43:31 -07:00
937c0a6cfe Fix unified HiCache physical transfers (#39479)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yonghao Zhuang <yhzhuang@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
2026-10-04 00:38:56 -07:00
billishyahao 6cc661f223 [AMD][DCP 2/N] Enable aiter asm ps for kimi k3 prefill (#34438) 2026-10-03 23:34:45 -07:00
Liangsheng Yin 048b2a07f3 [Session] Release aborted streaming turns through the normal release path (#42330) 2026-10-03 22:30:25 -07:00
Mohammad Miadh AngkadandMohammad Angkad 1315d171a0 [Diffusion][CI] Add missing B200 Cirrascale runner E2E baselines (#42329)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-03 21:10:32 -07:00
Brayden ZhongandMohammad Angkad a3275295c4 [MoE] Use FlashInfer A2A for prefill instead of AG+RS (#39818)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-03 21:09:00 -07:00
Mohammad Miadh AngkadandMohammad Angkad c12bc635ca [CI] Install only userspace libgdrapi for GDRCopy (#42233)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-03 21:05:35 -07:00