Commit Graph
13926 Commits
Author SHA1 Message Date
MickandMick Qian 04f740580c [VLM] fix: repair multimodal VMM lease cleanup and source-stream ordering (#43475)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-11 19:13:39 +08:00
efd14cfb66 [DeepSeek-V4.1] Use num_stages=1 for the hc_mix stats partial kernel (#43070)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yuan Luo <4908075+yuan-luo@users.noreply.github.com>
2026-10-11 19:03:19 +08:00
Sage 53295c6972 [kvevents] fix missing topics in replayed kv events (#43386)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-10-11 17:25:43 +08:00
Liangsheng Yin 0a21a3b798 [Scheduler] Keep a DP-converted decode batch as the running batch (#43283) 2026-10-11 01:23:51 -07:00
jiaqiang-dot-liu 41652225d0 [Sampler] Sort only the max(top_k) leading columns in the torch sampler (#43346) 2026-10-11 01:00:59 -07:00
Liangsheng Yin dab108b9f3 [Scheduler] Hold back decode rows on a mixed step when they do not fit the KV pool (#43290) 2026-10-11 00:18:27 -07:00
Liangsheng Yin 89e24e7a20 [KV canary] Expect sweep counters on the target runner only (#43286) 2026-10-10 23:52:17 -07:00
Liangsheng Yin ad8b1e1f85 [Test] Do not hang scripted-runtime teardown when the server died (#43285) 2026-10-10 23:13:56 -07:00
Liangsheng Yin 448759b235 [Scheduler] Requeue preempted requests when admission admits nothing (#43298) 2026-10-10 22:46:55 -07:00
Qiaolin Yu 047405f534 [qwen 3.8 next] Fuse QSA prefill KV gathering and dtype conversion (#41933) 2026-10-10 22:40:23 -07:00
paulzhang-tm 5678b71b6c [Spec] Allow Qwen3.5 backends to opt into packed target verification (#43037) 2026-10-10 22:39:17 -07:00
Nikolai 22d63f5e43 [AMD]Qwen add Sparse attention to capturing hip graphs (#43383) 2026-10-10 22:03:54 -07:00
Jzz1943 260551ebe9 [KDA] Support Helion MTP verification and harden prefill, decode (#42857) 2026-10-11 12:47:57 +08:00
SunskyXHandXiaoyu Zhang 65e6bb6be7 [GDN] Fix CuTe DSL decode to read the [N, HV, V, K] state layout (#43332)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-11 12:43:16 +08:00
a1500b10e3 [diffusion] Don't report video jobs completed after their outputs are deleted (#43084)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-11 12:42:38 +08:00
Chunan ZengandClaude Opus 5.5 aa5c969dc3 [Perf] Fuse BF16 writes to native HND KV cache storage (#43237)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 12:41:18 +08:00
Shuwen Wang 58cb1a2be6 [Scheduler] Keep waiting-prefix LRU refresh consistent across TP ranks (#43479) 2026-10-10 21:18:41 -07:00
Avaya Aggarwalandniehen6174 3458c94fad [diffusion] comfyui: consolidate executor conditioning-cache fixes (#43492)
Co-authored-by: niehen6174 <1639206518@qq.com>
2026-10-11 11:42:00 +08:00
Avaya Aggarwalandniehen6174 638330d975 [diffusion] comfyui: consolidate FluxAdapter correctness fixes (#43490)
Co-authored-by: niehen6174 <1639206518@qq.com>
2026-10-11 11:41:36 +08:00
Khoa Pham 6576e50cd5 [1/N][DSv41] Enable DP attention with MegaMoE (#43228) 2026-10-10 20:36:35 -07:00
b931b2c8bd [diffusion] perf: run the attention section eager under torch.compile for MiniMax-H3 (#43634)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 11:02:54 +08:00
b21826e609 [diffusion] fix: replay Qwen-Image-2.1 BCG graphs across prompt lengths (#43633)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:55:01 +08:00
b237afa547 [diffusion] fix: Qwen-Image BCG prompt padding misses every graph and attends the pad (#43632)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:54:18 +08:00
b3a65efe7e [diffusion] perf: keep Cosmos3's fused kernels in the graph (#43577)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:53:43 +08:00
d45ef0f2d2 [diffusion] perf: keep Qwen-Image-2.1 and Ulysses graphs whole (#43586)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:52:43 +08:00
Shangming CaiandKevin Flansburg e1f43c9a61 [PD][HiCache] Fold the decode restore outcome into the MIN-reduced KV poll (#43562)
Co-authored-by: Kevin Flansburg <kflansburg@cloudflare.com>
2026-10-11 10:12:34 +08:00
Richard Wang d60e0c8570 [diffusion] Support LLaDA-Image BF16 generation and editing (#37907) 2026-10-11 02:10:51 +00:00
e4b423256e [diffusion] fix: serve whole graphs after offload-during-compile (#43631)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:03:47 +08:00
Richard Wang d7ed5b56f5 [diffusion] fix: keep the overlay probe from stalling cached startup (#43590) 2026-10-11 10:01:01 +08:00
156d54e56c fix: wait for HiCache load-back before hybrid MLA KV reads (#38217)
Co-authored-by: zhouzechun <zhouzechun@kuaishou.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
2026-10-11 09:50:13 +08:00
Jzz1943andXiaoyu Zhang 9336681310 [DSA] Support TileLang FP8 KV cache on CUDA (#42957)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-11 09:12:18 +08:00
Xiaoyu Zhang 33d2ef1756 [Fix] Reserve remaining tokens for ignore_eos requests during prefill admission (#43564) 2026-10-11 09:05:48 +08:00
WenhaoZhangandOnePunchMonk 5730345717 [diffusion] comfyui: fail early instead of silently dropping features in SGLD integrated mode (#43495)
Co-authored-by: OnePunchMonk <aggarwal.avaya@yahoo.com>
2026-10-11 08:58:23 +08:00
d1313dd5fe [diffusion] fix: skip inductor's saved multi-kernel pick for torch.compile (Z-Image warm starts crash or hang) (#43601)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:56:55 +08:00
3022989bad [diffusion] CI: skip the LTX-2 RMSNorm-modulation guard test off the CUDA platform (#43574)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:54:37 +08:00
65386cb95a [diffusion] perf: add the dynamic LoRA delta inside the second GEMM (#43501)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:50:53 +08:00
e328c7ecbd [diffusion] fix: skip QKV packing while layers are offloaded (#43576)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:47:35 +08:00
7373665085 [diffusion] fix: keep exported buffers out of expandable segments for IPC all-to-all(#43584)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:46:30 +08:00
5e872557cb [diffusion] feat: keep the TP all-reduce inside the graph (#43602)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:45:54 +08:00
664e4c6499 [diffusion] feat: warn instead of disabling on unvalidated models for BCG(#43568)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:40:28 +08:00
23764b1242 [diffusion] feat: bind each GPU worker to its GPU's NUMA node (#43565)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:38:58 +08:00
9933cf5437 [diffusion] feat: declare regional compile regions for flux (#43575)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:33:29 +08:00
68e1a3dbb1 [diffusion] fix: accept request-level profiling on the image API (#43573)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:30:20 +08:00
d32d8fa0d1 [Dsv4.1] Mega-mhc integration (#42808)
Co-authored-by: Yuwei An <yuwei.an@MacBook-Pro-yuweian.local>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
2026-10-10 17:25:17 -07:00
Liangsheng Yin 7187bb593e [Model] Keep gpt-oss router logits batch-invariant under deterministic inference (#43624) 2026-10-10 17:22:29 -07:00
Cheng Wan 234ccba7f6 [Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460) 2026-10-10 12:43:09 -07:00
Cheng Wan 3b16eeedce [Refactor] Declare pipeline neighbours from a shared declaration function (#43459) 2026-10-10 12:42:46 -07:00
Cheng Wan 3b717c0f13 [Refactor] Decide an exit's fixed facts when the stage is built (#43458) 2026-10-10 12:42:23 -07:00
Cheng Wan a956aa192a [Refactor] Bind a layer stack in one pass over each stage's data flow (#43457) 2026-10-10 12:42:00 -07:00
Cheng Wan d2c597c8db [Refactor] Decide input-scattered eligibility and stage rejections in one place (#43456) 2026-10-10 12:41:38 -07:00