Liangsheng Yin
|
3f6c313389
|
[Fix] diffusion: Restore the kernel registry import after #41894 (#45775)
|
2026-10-22 01:25:13 -07:00 |
|
jacky.cheng
|
b5137693a5
|
[Fix] [AMD] diffusion: Enable --quantization fp8 on gfx1250 (torch.compile lowering + per-channel weight scales) (#45304)
|
2026-10-22 01:05:36 -07:00 |
|
 WenhaoZhangandMick Qian
|
24e45961c6
|
[Perf] diffusion: fuse QKV norm + RoPE, cached RoPE tables for FLUX 3 video VAE (#41894)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-22 15:44:54 +08:00 |
|
 James XuandCursor
|
c64886f9e3
|
[Perf] diffusion: fuse Wan VAE DupUp3D shortcut add (#32860)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-22 15:38:51 +08:00 |
|
 Ankit DhallandAnkit Dhall
|
f727076ed0
|
[Feat] diffusion: support wan-animate-2 distilled model (#44085)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
|
2026-10-22 15:37:08 +08:00 |
|
Shuwen Wang
|
9d5386fd13
|
[Perf] dsv41: Fuse request-window layout construction (#45726)
|
2026-10-22 00:13:33 -07:00 |
|
shun8686
|
33a0734ca1
|
[CI] [NPU] precise-test: collect multimodal_gen coverage per test case (#45553)
|
2026-10-22 15:11:47 +08:00 |
|
Baizhou Zhang
|
779adb4b82
|
[Perf] cuda-graph: Raise MLA prefill capture default to chunked size capped at 8192 (#45565)
|
2026-10-21 23:49:25 -07:00 |
|
 
|
f68e82e7bc
|
[Fix] epd: Accept tokens-in requests on scheduler-side transfer backends (#41376)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-22 14:45:38 +08:00 |
|
Liangsheng Yin
|
82f7249ce6
|
[Perf] dsv4: Gather V4.1 index-K slots once per prefill graph replay (#45741)
|
2026-10-21 23:34:17 -07:00 |
|
Shangming Cai
|
9569a36561
|
[Feat] scheduler: Gate --prefill-decode-interval on running batch size (#44001)
|
2026-10-22 14:30:12 +08:00 |
|
Richard Wang
|
ce66b3ab59
|
[Feat] systemone: serve Kev pointer head decision models (#45413)
|
2026-10-22 14:16:52 +08:00 |
|
Shangming Cai
|
a6a6beffac
|
[Refactor] disaggregation: Share the flag all-reduce and host-destination predicate in the decode transfer queue (#45641)
|
2026-10-22 13:42:55 +08:00 |
|
 WenhaoZhangandMick
|
d9ce511646
|
[Feat] diffusion: support FastH3 Omni (Ref2VA 8-step PDD) (#45530)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-22 13:07:13 +08:00 |
|
 MickandMick Qian
|
3472e16f96
|
[Refactor] diffusion: remove the deprecated kitchen_int8 alias (#45706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-22 13:06:07 +08:00 |
|
 ApeiriaandRain Jiang
|
8d7df07a56
|
[Feat] rust-server: Add HiCache storage management endpoints (#44726)
Signed-off-by: 0130w <1157374677@qq.com>
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
|
2026-10-22 04:01:35 +00:00 |
|
Liangsheng Yin
|
17babd67b4
|
[Fix] dsv4: Never read attention metadata for idle SWA stores (#45699)
|
2026-10-21 20:56:40 -07:00 |
|
WenhaoZhang
|
45de4adde9
|
[Feat] diffusion: Add worker-side ComfyUI compatibility patches (#44841)
|
2026-10-21 20:41:51 -07:00 |
|
Khoa Pham
|
f1e26dc658
|
[Perf] logits: Write lm_head logits straight into the fp32 logits buffer (#45631)
|
2026-10-21 20:32:16 -07:00 |
|
WenhaoZhang
|
1962cbeebe
|
[Perf] diffusion: convrot_int8 comfy_kitchen issues one GEMM per layer by default (#44179)
|
2026-10-22 11:30:32 +08:00 |
|
Shuwen Wang
|
6929afb528
|
[Fix] hisparse: Keep PD destination host pages until the decode KV release (#45108)
|
2026-10-22 11:19:21 +08:00 |
|
 
|
8dc7f98005
|
[Perf] pd: Send prefill KV chunks without a host sync on the scheduler thread (#45492)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-10-21 20:11:16 -07:00 |
|
 Tamir BaydasovandClaude Opus 5.5
|
b057d5b3f1
|
[Fix] [NPU] mla-pool: DCP allocator page and index-K bound, short-pool warning (#42976)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-22 05:24:14 +03:00 |
|
 
|
b453996b7d
|
[Doc] diffusion/minimax-h3: Refresh VDN-H3 B200 benchmarks, fix 8-step bench presets and popular-models snippet (#45267)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-22 10:09:13 +08:00 |
|
 em-dreyerandClaude Opus 5.5
|
3d508d614f
|
[CI] [NVIDIA] gb300: Run DSV4.1-Flash tests on 2 GPUs with engram host tables (#45294)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-21 18:53:24 -07:00 |
|
wutao
|
67bbfcee3c
|
[Perf] [NPU] scheduler: Remove blocking seq_lens D2H from graph replay (#45170)
|
2026-10-22 09:50:04 +08:00 |
|
Liangsheng Yin
|
d61f618276
|
[Perf] spec: Let DSPARK prefill publish read-done by placing its draft KV inject before the target forward (#45682)
|
2026-10-21 18:40:44 -07:00 |
|
 
|
4049941a82
|
[Fix] [NPU] scope: fix dtype error in sampling backend ascend (#39609)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Артем Савкин <58187114+OrangeRedeng@users.noreply.github.com>
|
2026-10-22 04:34:29 +03:00 |
|
 Khoa PhamandClaude Opus 5.5
|
aa10927271
|
[Perf] dsv41: Mega-mHC and the wo_a einsum write MXFP8 for wqkv_a and wo_b (#45632)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-21 18:27:21 -07:00 |
|
Baizhou Zhang
|
59149553b9
|
[Refactor] attention: centralize linear and draft TP group selection (#45684)
|
2026-10-21 18:25:40 -07:00 |
|
Jimmy Shong
|
9301ca37a0
|
[Fix] modelopt: Correct NVFP4 TRT-LLM clamps for untied gate/up scales (#45386)
|
2026-10-21 17:37:07 -07:00 |
|
  
|
eacd0a07d7
|
[Feat] bench: support --tokenize-prompt for generated-shared-prefix (#40900)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: chaoyujiang <chaoyujiang@hygon.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-22 08:17:15 +08:00 |
|
Khoa Pham
|
ed89693c4a
|
[Perf] dsv41: Fuse the q_norm MXFP8 quantize for wq_b at every row count (#45633)
|
2026-10-21 16:56:45 -07:00 |
|
Liangsheng Yin
|
da7b97a737
|
[Perf] dsv4: Publish prefill read-done under the request window and on V4.1 (#45582)
|
2026-10-21 16:29:28 -07:00 |
|
 
|
ed1f56fead
|
[Fix] [Apple] mlx: Give the stub model a shared-expert layout (#45419)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-10-21 15:54:49 -07:00 |
|
Baizhou Zhang
|
f4035cab0b
|
[Feat] cp: Enable GLM-5.3 Flash interleave BCG with batched prefill and DFlash2 (#43182)
|
2026-10-21 15:51:28 -07:00 |
|
   
|
991b846227
|
[Perf] speculative: Parallelize EAGLE spec-decode KV index building over token blocks (flashinfer draft decode; verify/draft-extend for flashinfer, flashinfer_mla, aiter) (#42803)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
|
2026-10-21 15:26:35 -07:00 |
|
maocheng23
|
4b9936b5e3
|
[Fix] deepseek_v4: Fix mHC prewarm when chunked prefill is disabled (#43448)
|
2026-10-21 15:21:31 -07:00 |
|
Liangsheng Yin
|
99cf403c9e
|
[Fix] dsv4: Write idle SWA stores to an idle request-window layout (#45586)
|
2026-10-21 15:18:34 -07:00 |
|
em-dreyer
|
aa5880e2b8
|
[Fix] bailing: Renormalize top-k routing weights by default for Ling-2.5/2.6 (#45662)
|
2026-10-21 14:53:58 -07:00 |
|
Liangsheng Yin
|
f3f0f7b68c
|
[Perf] dsv4: Let the decoder tail leave the prefill graph under DP attention with MegaMoE (#45581)
|
2026-10-21 14:44:21 -07:00 |
|
Liangsheng Yin
|
f5eca05b05
|
[Fix] [SM100] quantization: Honor deep_gemm for 32x32 block-FP8 linears (#45585)
|
2026-10-21 14:42:50 -07:00 |
|
 
|
29e78045fb
|
[Fix] dsv4: Skip DP-attention pad rows in the engram hasher and low-ratio sources (#40424)
Co-authored-by: jiashuai <jiashuai@baidu.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-21 14:37:55 -07:00 |
|
Liangsheng Yin
|
f7d4f06242
|
[Perf] dsv4: Compute request-window history rows once per batch (#45579)
|
2026-10-21 14:01:19 -07:00 |
|
Liangsheng Yin
|
bc412213c1
|
[Perf] dsv4: Gather V4.1 index-K slots once per forward and cache the prefill index plan (#45577)
|
2026-10-21 14:00:35 -07:00 |
|
Liangsheng Yin
|
620718c8ea
|
[Fix] moe: Keep the DeepSeek V4.1 vision router off the packed-ids path under routing simulation (#45575)
|
2026-10-21 13:58:44 -07:00 |
|
Liangsheng Yin
|
97945831f9
|
[Perf] dsv4: Restore sparse prefill for request-window rows (#45573)
|
2026-10-21 13:54:32 -07:00 |
|
 Liangsheng Yinandlixiufei-leo
|
2c7a9e3b50
|
[Fix] radix-cache: Order linker offloads behind the forward that writes the pages (#45559)
Co-authored-by: lixiufei-leo <294029388+lixiufei-leo@users.noreply.github.com>
|
2026-10-21 13:53:37 -07:00 |
|
Khoa Pham
|
028de2c5d4
|
[Perf] dsv41: Use tuned MXFP8 tactics at decode sizes (#45630)
|
2026-10-21 13:35:56 -07:00 |
|
 Yoni GozlanandJimmy Shong
|
a2e4ffbcea
|
[Fix] parser: Accept whole-number floats for integer tool arguments (#43941)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-21 13:04:15 -07:00 |
|