 MickandMick Qian
|
04f740580c
|
[VLM] fix: repair multimodal VMM lease cleanup and source-stream ordering (#43475)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-11 19:13:39 +08:00 |
|
 
|
efd14cfb66
|
[DeepSeek-V4.1] Use num_stages=1 for the hc_mix stats partial kernel (#43070)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yuan Luo <4908075+yuan-luo@users.noreply.github.com>
|
2026-10-11 19:03:19 +08:00 |
|
Sage
|
53295c6972
|
[kvevents] fix missing topics in replayed kv events (#43386)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-11 17:25:43 +08:00 |
|
Liangsheng Yin
|
0a21a3b798
|
[Scheduler] Keep a DP-converted decode batch as the running batch (#43283)
|
2026-10-11 01:23:51 -07:00 |
|
jiaqiang-dot-liu
|
41652225d0
|
[Sampler] Sort only the max(top_k) leading columns in the torch sampler (#43346)
|
2026-10-11 01:00:59 -07:00 |
|
Liangsheng Yin
|
dab108b9f3
|
[Scheduler] Hold back decode rows on a mixed step when they do not fit the KV pool (#43290)
|
2026-10-11 00:18:27 -07:00 |
|
Liangsheng Yin
|
89e24e7a20
|
[KV canary] Expect sweep counters on the target runner only (#43286)
|
2026-10-10 23:52:17 -07:00 |
|
Liangsheng Yin
|
ad8b1e1f85
|
[Test] Do not hang scripted-runtime teardown when the server died (#43285)
|
2026-10-10 23:13:56 -07:00 |
|
Liangsheng Yin
|
448759b235
|
[Scheduler] Requeue preempted requests when admission admits nothing (#43298)
|
2026-10-10 22:46:55 -07:00 |
|
Qiaolin Yu
|
047405f534
|
[qwen 3.8 next] Fuse QSA prefill KV gathering and dtype conversion (#41933)
|
2026-10-10 22:40:23 -07:00 |
|
paulzhang-tm
|
5678b71b6c
|
[Spec] Allow Qwen3.5 backends to opt into packed target verification (#43037)
|
2026-10-10 22:39:17 -07:00 |
|
Nikolai
|
22d63f5e43
|
[AMD]Qwen add Sparse attention to capturing hip graphs (#43383)
|
2026-10-10 22:03:54 -07:00 |
|
Jzz1943
|
260551ebe9
|
[KDA] Support Helion MTP verification and harden prefill, decode (#42857)
|
2026-10-11 12:47:57 +08:00 |
|
 SunskyXHandXiaoyu Zhang
|
65e6bb6be7
|
[GDN] Fix CuTe DSL decode to read the [N, HV, V, K] state layout (#43332)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 12:43:16 +08:00 |
|
 
|
a1500b10e3
|
[diffusion] Don't report video jobs completed after their outputs are deleted (#43084)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 12:42:38 +08:00 |
|
 Chunan ZengandClaude Opus 5.5
|
aa5c969dc3
|
[Perf] Fuse BF16 writes to native HND KV cache storage (#43237)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 12:41:18 +08:00 |
|
Shuwen Wang
|
58cb1a2be6
|
[Scheduler] Keep waiting-prefix LRU refresh consistent across TP ranks (#43479)
|
2026-10-10 21:18:41 -07:00 |
|
 Avaya Aggarwalandniehen6174
|
3458c94fad
|
[diffusion] comfyui: consolidate executor conditioning-cache fixes (#43492)
Co-authored-by: niehen6174 <1639206518@qq.com>
|
2026-10-11 11:42:00 +08:00 |
|
 Avaya Aggarwalandniehen6174
|
638330d975
|
[diffusion] comfyui: consolidate FluxAdapter correctness fixes (#43490)
Co-authored-by: niehen6174 <1639206518@qq.com>
|
2026-10-11 11:41:36 +08:00 |
|
Khoa Pham
|
6576e50cd5
|
[1/N][DSv41] Enable DP attention with MegaMoE (#43228)
|
2026-10-10 20:36:35 -07:00 |
|
 
|
b931b2c8bd
|
[diffusion] perf: run the attention section eager under torch.compile for MiniMax-H3 (#43634)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 11:02:54 +08:00 |
|
 
|
b21826e609
|
[diffusion] fix: replay Qwen-Image-2.1 BCG graphs across prompt lengths (#43633)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 10:55:01 +08:00 |
|
 
|
b237afa547
|
[diffusion] fix: Qwen-Image BCG prompt padding misses every graph and attends the pad (#43632)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 10:54:18 +08:00 |
|
 
|
b3a65efe7e
|
[diffusion] perf: keep Cosmos3's fused kernels in the graph (#43577)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 10:53:43 +08:00 |
|
 
|
d45ef0f2d2
|
[diffusion] perf: keep Qwen-Image-2.1 and Ulysses graphs whole (#43586)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 10:52:43 +08:00 |
|
 Shangming CaiandKevin Flansburg
|
e1f43c9a61
|
[PD][HiCache] Fold the decode restore outcome into the MIN-reduced KV poll (#43562)
Co-authored-by: Kevin Flansburg <kflansburg@cloudflare.com>
|
2026-10-11 10:12:34 +08:00 |
|
Richard Wang
|
d60e0c8570
|
[diffusion] Support LLaDA-Image BF16 generation and editing (#37907)
|
2026-10-11 02:10:51 +00:00 |
|
 
|
e4b423256e
|
[diffusion] fix: serve whole graphs after offload-during-compile (#43631)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 10:03:47 +08:00 |
|
Richard Wang
|
d7ed5b56f5
|
[diffusion] fix: keep the overlay probe from stalling cached startup (#43590)
|
2026-10-11 10:01:01 +08:00 |
|
 
|
156d54e56c
|
fix: wait for HiCache load-back before hybrid MLA KV reads (#38217)
Co-authored-by: zhouzechun <zhouzechun@kuaishou.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
|
2026-10-11 09:50:13 +08:00 |
|
 Jzz1943andXiaoyu Zhang
|
9336681310
|
[DSA] Support TileLang FP8 KV cache on CUDA (#42957)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 09:12:18 +08:00 |
|
Xiaoyu Zhang
|
33d2ef1756
|
[Fix] Reserve remaining tokens for ignore_eos requests during prefill admission (#43564)
|
2026-10-11 09:05:48 +08:00 |
|
 WenhaoZhangandOnePunchMonk
|
5730345717
|
[diffusion] comfyui: fail early instead of silently dropping features in SGLD integrated mode (#43495)
Co-authored-by: OnePunchMonk <aggarwal.avaya@yahoo.com>
|
2026-10-11 08:58:23 +08:00 |
|
 
|
d1313dd5fe
|
[diffusion] fix: skip inductor's saved multi-kernel pick for torch.compile (Z-Image warm starts crash or hang) (#43601)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:56:55 +08:00 |
|
 
|
3022989bad
|
[diffusion] CI: skip the LTX-2 RMSNorm-modulation guard test off the CUDA platform (#43574)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:54:37 +08:00 |
|
 
|
65386cb95a
|
[diffusion] perf: add the dynamic LoRA delta inside the second GEMM (#43501)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:50:53 +08:00 |
|
 
|
e328c7ecbd
|
[diffusion] fix: skip QKV packing while layers are offloaded (#43576)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:47:35 +08:00 |
|
 
|
7373665085
|
[diffusion] fix: keep exported buffers out of expandable segments for IPC all-to-all(#43584)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:46:30 +08:00 |
|
 
|
5e872557cb
|
[diffusion] feat: keep the TP all-reduce inside the graph (#43602)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:45:54 +08:00 |
|
 
|
664e4c6499
|
[diffusion] feat: warn instead of disabling on unvalidated models for BCG(#43568)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:40:28 +08:00 |
|
 
|
23764b1242
|
[diffusion] feat: bind each GPU worker to its GPU's NUMA node (#43565)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:38:58 +08:00 |
|
 
|
9933cf5437
|
[diffusion] feat: declare regional compile regions for flux (#43575)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:33:29 +08:00 |
|
 
|
68e1a3dbb1
|
[diffusion] fix: accept request-level profiling on the image API (#43573)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:30:20 +08:00 |
|
 
|
d32d8fa0d1
|
[Dsv4.1] Mega-mhc integration (#42808)
Co-authored-by: Yuwei An <yuwei.an@MacBook-Pro-yuweian.local>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
|
2026-10-10 17:25:17 -07:00 |
|
Liangsheng Yin
|
7187bb593e
|
[Model] Keep gpt-oss router logits batch-invariant under deterministic inference (#43624)
|
2026-10-10 17:22:29 -07:00 |
|
Cheng Wan
|
234ccba7f6
|
[Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460)
|
2026-10-10 12:43:09 -07:00 |
|
Cheng Wan
|
3b16eeedce
|
[Refactor] Declare pipeline neighbours from a shared declaration function (#43459)
|
2026-10-10 12:42:46 -07:00 |
|
Cheng Wan
|
3b717c0f13
|
[Refactor] Decide an exit's fixed facts when the stage is built (#43458)
|
2026-10-10 12:42:23 -07:00 |
|
Cheng Wan
|
a956aa192a
|
[Refactor] Bind a layer stack in one pass over each stage's data flow (#43457)
|
2026-10-10 12:42:00 -07:00 |
|
Cheng Wan
|
d2c597c8db
|
[Refactor] Decide input-scattered eligibility and stage rejections in one place (#43456)
|
2026-10-10 12:41:38 -07:00 |
|