 
|
e902207a4e
|
[Speculative] Support block verification for the DFlash family (#43012)
Co-authored-by: maocheng <mao.cheng@MacBook-Pro-MD663G60VV.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 13:59:52 -07:00 |
|
 
|
d1ba943016
|
[Model] Add support for EmbeddingGemma 2 (#42782)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 13:54:45 -07:00 |
|
 metamergebotandhanming-lu
|
93f2acf614
|
[Metrics] Use widely supported bucket boundaries for the DP attention imbalance ratio (#43187)
Co-authored-by: hanming-lu <hanming-lu@users.noreply.github.com>
|
2026-10-08 12:58:58 -07:00 |
|
Ming Yang
|
3fef129ff8
|
[PD] Allow state-only KV checksum inputs (#42904)
|
2026-10-08 12:54:03 -07:00 |
|
 
|
075fd8fa0b
|
[Mamba] Describe the track snapshot dtype by its kernel instead of fp32 (#43192)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: jiayisuse <jiayisuse@users.noreply.github.com>
|
2026-10-08 12:47:46 -07:00 |
|
 
|
e3c5719713
|
[DFlash] Build the attention QKV projection through an overridable hook (#43179)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-08 12:46:28 -07:00 |
|
kunchengit
|
00b3a48753
|
[dLLM] Add JointThresholdInDel algorithm for insertion & deletion decoding (#31773)
|
2026-10-08 12:44:14 -07:00 |
|
 Aurick QiaoandQiaolin-Yu
|
b2cb24995d
|
[Debug] Add opt-in NaN detection before sampling (#42690)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2026-10-08 12:20:57 -07:00 |
|
 Shenxiu LiuandQiaolin-Yu
|
393eaed509
|
[Fix] overlap scheduler: record_stream mix_running_indices for the forward-stream relay gather (#34076)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2026-10-08 12:19:35 -07:00 |
|
shodoco
|
1638c5d699
|
[http_server] Let custom /generate routes skip the second contract check (#43114)
|
2026-10-08 11:56:06 -07:00 |
|
 
|
214347891a
|
[Bugfix] Skip post-experts EP all-reduce on the FlashInfer cutlass FP4 all-gather MoE path (#41072)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-08 18:01:27 +00:00 |
|
shodoco
|
e2fbc6a550
|
Stream a chunk once stream_interval tokens are unsent (#42643)
|
2026-10-08 10:12:37 -07:00 |
|
Eric Zhang
|
344b8a863b
|
[Perf] Fuse short-convolution checkpoint tracking metadata (#43013)
|
2026-10-09 00:26:15 +08:00 |
|
Ke Bao
|
642e81fbb8
|
Fix DSA index host buffer cleanup (#43100)
|
2026-10-09 00:21:38 +08:00 |
|
Ke Bao
|
46ad9eb439
|
Fix K-only host buffer cleanup (#43101)
|
2026-10-09 00:21:27 +08:00 |
|
billishyahao
|
4ab4d90d78
|
[AMD][DCP 3/N] add aiter asm for kimi k3 target verify (#34537)
|
2026-10-08 09:13:03 -07:00 |
|
 MickandMick Qian
|
3030e31ff8
|
[diffusion] refactor: deduplicate request extraction and ComfyUI test helpers (#42903)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 23:44:35 +08:00 |
|
 
|
11b1fb21de
|
[MiniMax-M3] Decode: paged K/V tile loads and a tiny GEMM for the router projection (#38841)
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 19:39:31 +08:00 |
|
  
|
6e6ccb26f2
|
[MiniMax-M3] Instantiate the decode block top-k in register buckets (#38615)
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-08 19:33:17 +08:00 |
|
 MickandMick Qian
|
7dd512b0e8
|
[diffusion] refactor: deduplicate FLUX positions and RoPE application (#43002)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 18:18:39 +08:00 |
|
Horace He
|
8ad24fb560
|
[Perf] Cache compiled ModelOpt exclusion patterns (#42927)
|
2026-10-08 17:10:25 +08:00 |
|
Liangsheng Yin
|
4b384df0c9
|
[CI] Keep the KL tests' LongBench cache outside the checkout and bound its download (#43068)
|
2026-10-08 01:17:31 -07:00 |
|
Liangsheng Yin
|
7b9c42cf49
|
[CI] Remove the unregistered chunked-prefill tests under test/manual (#43081)
|
2026-10-08 01:16:39 -07:00 |
|
Liangsheng Yin
|
89b5935793
|
[MemCache] Return only the loaded length from init_load_back; drop empty_device_indices (#43023)
|
2026-10-08 01:14:33 -07:00 |
|
Liangsheng Yin
|
5a4d01a3ae
|
[MemCache] Return only the matched length from match_prefix; read KV indices off the node path (#42923)
|
2026-10-08 01:10:14 -07:00 |
|
Spandan Tiwari
|
2d26823f94
|
[AMD] Drop static input_scale on aiter per-token FP8 path (use dynamic per-token) (#42152)
|
2026-10-08 01:06:34 -07:00 |
|
Cheng Wan
|
b3e6c87be3
|
[Refactor] Translate each KV loc once per iteration (#42753)
|
2026-10-08 00:58:28 -07:00 |
|
 
|
508ddc859a
|
[unified-memory] Admit DFLASH and DSPARK with fused draft KV (#40492)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:56:21 -07:00 |
|
 
|
c2d491e38b
|
[unified-memory] Admit EAGLE/EAGLE3 onto fused draft KV, on mamba-MHA and MLA hosts (#40491)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:55:54 -07:00 |
|
 
|
8b80808366
|
[unified-memory] Fuse the draft model's KV into the target's page envelope (mechanism) (#37628)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:54:19 -07:00 |
|
 
|
08d30f2300
|
[unified-memory] Speculative decoding on the unified memory pool: translate every read and write path (#37627)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:52:21 -07:00 |
|
 
|
33883a5fa3
|
[AMD] Small-M W8A8 FP8 projection GEMM for Qwen3.5 AttnFP8 on gfx950 (#41134)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-08 00:50:16 -07:00 |
|
 
|
b2cd65b8b0
|
[AMD] One-launch small-M MoE router for Qwen3.5 on gfx950 (#41133)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-08 00:47:52 -07:00 |
|
Chunan Zeng
|
785005d21b
|
[DSpark] Mask uncommitted slots before commit-inject cache lookups (#42624)
|
2026-10-08 00:16:54 -07:00 |
|
Yuwei An
|
54b551df8e
|
[Refactor][TCPCG] Bind live forward batches in BCG eager calls (2/9) (#42286)
|
2026-10-07 23:55:41 -07:00 |
|
 MickandMick Qian
|
5c5f593110
|
[diffusion] refactor: share KL VAE encode/decode and tiling operations (#42841)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 14:43:19 +08:00 |
|
 MickandMick Qian
|
d1b751d958
|
[diffusion] refactor: inherit existing defaults instead of repeating overrides (#42963)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 14:42:21 +08:00 |
|
 
|
74308cf1d6
|
[diffusion] fix: wait for multimodal process teardown (#40765)
Signed-off-by: Xucheng Zhou <aden1350@outlook.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 14:36:17 +08:00 |
|
  
|
4f320fb85a
|
[diffusion] perf: FastH3 8-Step V2 native support, native Blackwell VSA and batched H3 VAE decode (#37662)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-08 14:35:27 +08:00 |
|
 MickandMick Qian
|
57e9ff5403
|
[diffusion] refactor: share timestep retrieval across pipeline stages (#42967)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 14:33:39 +08:00 |
|
Jzz1943
|
b7b2975b57
|
fix(dsa): align FA3 metadata with unpadded queries (#42793)
|
2026-10-07 21:37:21 -07:00 |
|
 hmalgewattaandAlex Nails
|
7327fb225f
|
[DSV4] Guard V4.1 indexer SM100 check on non-CUDA devices (#42114)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-08 12:06:28 +08:00 |
|
 chilltongxandchilltongx
|
e7530a3a26
|
[diffusion] fix: fix forward multimodal token type IDs in image encoding (#34494)
Co-authored-by: chilltongx <284668524+chilltongx@users.noreply.github.com>
|
2026-10-08 10:55:55 +08:00 |
|
WenhaoZhang
|
b0d7254fbc
|
[diffusion] CI: rebase LTX H100 timing references on recent CI runs (#42986)
|
2026-10-08 10:42:12 +08:00 |
|
 Jiajun LiandClaude Opus 5.5
|
99463390f8
|
[Fix] MiMo-V2: accept checkpoints with the split attention layout (#40978)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 19:18:32 -07:00 |
|
 
|
c892301ff7
|
[Platform] Thread vendor KV pool classes through the in-tree builders; add PlatformCapabilities (#35594)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
|
2026-10-07 19:16:10 -07:00 |
|
 MickandMick Qian
|
21fa2251a0
|
[diffusion] refactor: share sigma schedules and causal cross-attention (#42848)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 09:29:33 +08:00 |
|
 MickandMick Qian
|
28c08b02c3
|
[diffusion] refactor: deduplicate MOVA initialization (#42983)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 09:28:06 +08:00 |
|
 MickandMick Qian
|
243f3dc35f
|
[diffusion] refactor: deduplicate Qwen-VL inputs and component accuracy suites (#42860)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 09:27:22 +08:00 |
|
 MickandMick Qian
|
2489bd1d2e
|
[diffusion] refactor: share ModelOpt checkpoint conversion I/O (#42856)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-08 09:26:39 +08:00 |
|