Commit Graph
14603 Commits
Author SHA1 Message Date
b3a65efe7e [diffusion] perf: keep Cosmos3's fused kernels in the graph (#43577)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:53:43 +08:00
d45ef0f2d2 [diffusion] perf: keep Qwen-Image-2.1 and Ulysses graphs whole (#43586)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:52:43 +08:00
Shangming CaiandKevin Flansburg e1f43c9a61 [PD][HiCache] Fold the decode restore outcome into the MIN-reduced KV poll (#43562)
Co-authored-by: Kevin Flansburg <kflansburg@cloudflare.com>
2026-10-11 10:12:34 +08:00
Richard Wang d60e0c8570 [diffusion] Support LLaDA-Image BF16 generation and editing (#37907) 2026-10-11 02:10:51 +00:00
e4b423256e [diffusion] fix: serve whole graphs after offload-during-compile (#43631)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:03:47 +08:00
Richard Wang d7ed5b56f5 [diffusion] fix: keep the overlay probe from stalling cached startup (#43590) 2026-10-11 10:01:01 +08:00
156d54e56c fix: wait for HiCache load-back before hybrid MLA KV reads (#38217)
Co-authored-by: zhouzechun <zhouzechun@kuaishou.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
2026-10-11 09:50:13 +08:00
Jzz1943andXiaoyu Zhang 9336681310 [DSA] Support TileLang FP8 KV cache on CUDA (#42957)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-11 09:12:18 +08:00
Xiaoyu Zhang 33d2ef1756 [Fix] Reserve remaining tokens for ignore_eos requests during prefill admission (#43564) 2026-10-11 09:05:48 +08:00
WenhaoZhangandOnePunchMonk 5730345717 [diffusion] comfyui: fail early instead of silently dropping features in SGLD integrated mode (#43495)
Co-authored-by: OnePunchMonk <aggarwal.avaya@yahoo.com>
2026-10-11 08:58:23 +08:00
d1313dd5fe [diffusion] fix: skip inductor's saved multi-kernel pick for torch.compile (Z-Image warm starts crash or hang) (#43601)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:56:55 +08:00
3022989bad [diffusion] CI: skip the LTX-2 RMSNorm-modulation guard test off the CUDA platform (#43574)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:54:37 +08:00
65386cb95a [diffusion] perf: add the dynamic LoRA delta inside the second GEMM (#43501)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:50:53 +08:00
e328c7ecbd [diffusion] fix: skip QKV packing while layers are offloaded (#43576)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:47:35 +08:00
7373665085 [diffusion] fix: keep exported buffers out of expandable segments for IPC all-to-all(#43584)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:46:30 +08:00
5e872557cb [diffusion] feat: keep the TP all-reduce inside the graph (#43602)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:45:54 +08:00
664e4c6499 [diffusion] feat: warn instead of disabling on unvalidated models for BCG(#43568)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:40:28 +08:00
23764b1242 [diffusion] feat: bind each GPU worker to its GPU's NUMA node (#43565)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:38:58 +08:00
9933cf5437 [diffusion] feat: declare regional compile regions for flux (#43575)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:33:29 +08:00
68e1a3dbb1 [diffusion] fix: accept request-level profiling on the image API (#43573)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:30:20 +08:00
d32d8fa0d1 [Dsv4.1] Mega-mhc integration (#42808)
Co-authored-by: Yuwei An <yuwei.an@MacBook-Pro-yuweian.local>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
2026-10-10 17:25:17 -07:00
Liangsheng Yin 7187bb593e [Model] Keep gpt-oss router logits batch-invariant under deterministic inference (#43624) 2026-10-10 17:22:29 -07:00
Cheng Wan 234ccba7f6 [Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460) 2026-10-10 12:43:09 -07:00
Cheng Wan 3b16eeedce [Refactor] Declare pipeline neighbours from a shared declaration function (#43459) 2026-10-10 12:42:46 -07:00
Cheng Wan 3b717c0f13 [Refactor] Decide an exit's fixed facts when the stage is built (#43458) 2026-10-10 12:42:23 -07:00
Cheng Wan a956aa192a [Refactor] Bind a layer stack in one pass over each stage's data flow (#43457) 2026-10-10 12:42:00 -07:00
Cheng Wan d2c597c8db [Refactor] Decide input-scattered eligibility and stage rejections in one place (#43456) 2026-10-10 12:41:38 -07:00
Cheng Wan b0dde87de2 [Refactor] Make residual read and update capabilities explicit and checked (#43455) 2026-10-10 12:41:16 -07:00
Cheng Wan 514feb1afc [Fix] Keep residual rows and sums consistent across appends and pipeline handoffs (#43454) 2026-10-10 12:40:53 -07:00
Cheng Wan 8bd7f2d178 [Refactor] Record what a bound stage path does instead of reading it back (#43453) 2026-10-10 12:40:30 -07:00
0acd93c35c [Scheduler] Use committed length in spec mamba track boundary check (#43029)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
2026-10-10 12:29:40 -07:00
Shuwen WangandKe Bao f9cee8d2b2 [HiCache] Keep protected cgroup page cache charged in host budgets (#42788)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
2026-10-10 17:03:40 +00:00
Shunkangz de487f8039 [kv-shard 3/4] Enable Control Plane C (#40102) 2026-10-10 22:53:58 +08:00
huangtingwei 406540ab5f [HiCache] Add staged write-back for the page-unified KV cache layout (#39606) 2026-10-10 22:49:45 +08:00
Shuwen Wang 99d6f4e158 [MemCache] refactor: require an anchored lock receipt for non-root releases (#41452) 2026-10-10 22:43:49 +08:00
Shuwen Wang 44bc478863 [HiSparse] Avoid host synchronization in eager backup (#41446) 2026-10-10 21:49:55 +08:00
hhy-seven 616178a596 [Responses] Fix max_output_tokens overestimate on multimodal requests (#35524) 2026-10-10 13:42:53 +00:00
a510340aeb [diffusion] perf: run head_dim-128 QK-norm + RoPE two rows per warp for every RoPE layout (#43508)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 21:34:54 +08:00
72657f7ca5 [diffusion] perf: pipeline every USPAttention Ulysses path's exchange over the copy engine (#43521)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 21:34:18 +08:00
Liangsheng Yin c55790d38b [CI] Drop CPU tests with no bug-catching signal and run Rust workspace tests in their own workflow (#43503) 2026-10-10 02:13:53 -07:00
siliangchen-amd ff19159e16 [AMD] Add an opt-in AITER CK blockscale GEMM for gfx942 block-FP8 linears (#41071)
Signed-off-by: siliangchen-amd <SiLiang.Chen@amd.com
2026-10-10 01:31:20 -07:00
d7d22e8a30 [AMD] Resolving bug in per batch size graph capture due to multiple capture runs per batch size (#39840)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-10-10 00:47:13 -07:00
d8c5eca3ac [diffusion] fix: keep a LoRA unmerged under merge_mode auto when merging would round its update away (#43385)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 15:02:03 +08:00
tao 6e8f3e09dd [Model Loader] Add InstantTensor loader support (#40453) 2026-10-09 23:01:59 -07:00
cctry 33f6b00f32 Clamp default decode CUDA graph max_bs to max_running_requests (#43172) 2026-10-09 22:54:32 -07:00
Yuwei An 8b2aaf7060 [Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287) 2026-10-09 22:42:35 -07:00
YAMY 17852cdfe8 [DSv4.1] Initialize the full-to-SWA mapping for request-window pools (#43165) 2026-10-09 22:39:26 -07:00
Frederik Gossen 3831e7e091 [diffusion] Z-Image: autotune the shared transformer block at both token scales (#35755) 2026-10-10 13:04:43 +08:00
Raymond HuangandClaude Opus 5 aa79087017 [diffusion] fix: fail MiniMax-H3 quality="high" closed on substituted DiT weights (#34978)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-10-10 13:03:44 +08:00
ccae3b3639 [diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against cuDNN SDPA on Blackwell (#43373)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 12:58:30 +08:00