 
|
c2d491e38b
|
[unified-memory] Admit EAGLE/EAGLE3 onto fused draft KV, on mamba-MHA and MLA hosts (#40491)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:55:54 -07:00 |
|
Michael
|
5afe4d6334
|
[AMD] Fix DSpark draft bucket tests for the raw in-graph metadata default (#42230)
|
2026-10-08 00:54:26 -07:00 |
|
 
|
8b80808366
|
[unified-memory] Fuse the draft model's KV into the target's page envelope (mechanism) (#37628)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:54:19 -07:00 |
|
 
|
08d30f2300
|
[unified-memory] Speculative decoding on the unified memory pool: translate every read and write path (#37627)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:52:21 -07:00 |
|
 
|
33883a5fa3
|
[AMD] Small-M W8A8 FP8 projection GEMM for Qwen3.5 AttnFP8 on gfx950 (#41134)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-08 00:50:16 -07:00 |
|
 
|
b2cd65b8b0
|
[AMD] One-launch small-M MoE router for Qwen3.5 on gfx950 (#41133)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-08 00:47:52 -07:00 |
|
 
|
f795fe352d
|
[Test] Add a docs drift check for server_arguments.mdx (#38520)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:37:22 -07:00 |
|
Chunan Zeng
|
785005d21b
|
[DSpark] Mask uncommitted slots before commit-inject cache lookups (#42624)
|
2026-10-08 00:16:54 -07:00 |
|
Yuwei An
|
54b551df8e
|
[Refactor][TCPCG] Bind live forward batches in BCG eager calls (2/9) (#42286)
|
2026-10-07 23:55:41 -07:00 |
|
  
|
4f320fb85a
|
[diffusion] perf: FastH3 8-Step V2 native support, native Blackwell VSA and batched H3 VAE decode (#37662)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-08 14:35:27 +08:00 |
|
Liangsheng Yin
|
0f5bc4af4b
|
[CI] Fix stale fakes in the NPU CUDA-graph backend unit test (#43056)
|
2026-10-07 23:04:48 -07:00 |
|
 AndyLi429andAndyLi429
|
89bea053ac
|
[NPU] Add NPU cudagraph runner unit tests (#40404)
Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
|
2026-10-08 11:18:38 +08:00 |
|
 
|
c892301ff7
|
[Platform] Thread vendor KV pool classes through the in-tree builders; add PlatformCapabilities (#35594)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
|
2026-10-07 19:16:10 -07:00 |
|
Richard Wang
|
5cb7fb886c
|
[Feature] support pplx-decider-v1.1 and update the pplx-decider cookbooks (#42645)
|
2026-10-08 09:03:50 +08:00 |
|
Cheng Wan
|
7760d5264a
|
[Refactor] Use destination layouts for model checkpoint mappings (#42590)
|
2026-10-07 16:24:22 -07:00 |
|
Cheng Wan
|
5e12831cec
|
[Refactor] Load auxiliary and expert checkpoints using owner partitions (#42589)
|
2026-10-07 16:24:03 -07:00 |
|
Cheng Wan
|
64c7f65eac
|
[Refactor] Retain process groups in parallel linear layers (#42588)
|
2026-10-07 16:23:40 -07:00 |
|
Cheng Wan
|
267e34516c
|
[Refactor] Select parallel groups for remaining model projections (#42587)
|
2026-10-07 16:22:57 -07:00 |
|
Cheng Wan
|
dec5d9d6fc
|
[Refactor] Let vision encoders select their parallel group (#42586)
|
2026-10-07 16:22:32 -07:00 |
|
Cheng Wan
|
b83827ea02
|
[Fix] Quantize reloaded FP8 weights after native sharding (#42585)
|
2026-10-07 16:20:47 -07:00 |
|
Cheng Wan
|
59740a728f
|
[Refactor] Let MLA projections select their parallel group (#42484)
|
2026-10-07 16:19:33 -07:00 |
|
Cheng Wan
|
961d7290fe
|
[Refactor] Let model MLPs select their parallel group (#42468)
|
2026-10-07 16:18:14 -07:00 |
|
Cheng Wan
|
4c5130ac5a
|
[Refactor] Let linear layers select their parallel group (#42426)
|
2026-10-07 16:15:26 -07:00 |
|
Liangsheng Yin
|
1066decce6
|
[Scheduler] Replace extend_range with extend_end derived from prefix_len (#42822)
|
2026-10-07 16:07:16 -07:00 |
|
Liangsheng Yin
|
5349d3e9d2
|
[Scheduler] Derive prefix KV indices from last_node at allocation; drop Req.prefix_indices (#42825)
|
2026-10-07 16:03:09 -07:00 |
|
Liangsheng Yin
|
e9240b3243
|
[Scheduler] Track prefill progress as prefix_len (#42824)
|
2026-10-07 15:59:06 -07:00 |
|
Liangsheng Yin
|
4bf8f28d15
|
[Scheduler] Fold match write-back into match_kv_cache (#42823)
|
2026-10-07 15:43:05 -07:00 |
|
Liangsheng Yin
|
b1ffe5c16a
|
[dLLM] Keep the request row across FDFO blocks (#42846)
|
2026-10-07 15:39:33 -07:00 |
|
 Ping QiuandZhiqiang Xie
|
685d4d453d
|
[HiCache] Add SeaweedFS L3 storage backend (#42399)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-10-07 15:05:37 -07:00 |
|
 
|
00b21d6415
|
[diffusion] fix: reset DiT cache state at the start of each request (#42437)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-07 23:25:49 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
1e86143bf0
|
[Bugfix] Return None for empty reasoning_content outside K2 Horizon (#42962)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 21:02:40 +08:00 |
|
Rain Jiang
|
c52dcc5a01
|
The sgalng api specs (#41585)
|
2026-10-07 01:55:01 -07:00 |
|
 Shuwen WangandClaude Opus 5
|
2889158792
|
[MemCache] test: require every ComponentData field to be classified by each split hook (#42518)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-07 14:53:34 +08:00 |
|
paulzhang-tm
|
c721602ad2
|
Cover SWA admission after declined HiCache restores (#39839)
|
2026-10-07 14:51:45 +08:00 |
|
Mark
|
b0dff4009f
|
[diffusion] cli: restore gated Diffusers model detection (#34903)
|
2026-10-07 14:21:37 +08:00 |
|
 AMD-yanfeiwangandThomas Wang
|
9ddbba50dd
|
[AMD][DSV4] feat: enable PCP with fp8 unified_kv on gfx950 (#39923)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-10-06 22:09:18 -07:00 |
|
Khoa Pham
|
9e26600f3a
|
[DSA] Clarify pooled-page naming and ownership (#42671)
|
2026-10-06 21:05:29 -07:00 |
|
 Tuan Nguyen GiaandCursor
|
c0df52be2d
|
[AMD] Fix Quark W4A4 MXFP4 MoE clamped-SwiGLU on the AITER path (#34540)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-07 03:20:40 +00:00 |
|
 Yi (Vincent) ZhongandClaude Opus 5.5
|
012cd3858b
|
[Fix] Make the fused KDA beta sigmoid bit-identical to torch.sigmoid (#42611)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 20:04:59 -07:00 |
|
 Yash AkhauriandBBuf
|
9c8fc6a8e4
|
[Bugfix] Preserve empty K2 Horizon reasoning in chat responses (#42623)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-10-07 10:44:55 +08:00 |
|
 
|
d7190b0122
|
[Perf] Accelerate DiffusionGemma with FA4 and CUDA graphs on Blackwell (#42239)
Co-authored-by: lianghougong <lianghouhong@xiaohongshu.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-07 10:31:00 +08:00 |
|
 
|
660b17e8dc
|
[AMD] Let AITER unified verify run without host seq_lens (#42635)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: zx3xyy <zx3xyy@users.noreply.github.com>
|
2026-10-06 18:27:27 -07:00 |
|
 
|
f1065423d3
|
[PD] Stop reserving unallocated mamba spec-verify scratch in prefill KV sizing (#42649)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-06 17:16:22 -07:00 |
|
 
|
08aad0c196
|
[HiCache] Manage buffer-mode backups per storage pool (#42633)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-06 16:45:05 -07:00 |
|
 jain-riaandishandhanani
|
fd62ee84f7
|
feat(grpc): expose follower metadata and node-local KV sources (#39659)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-10-06 16:39:01 -07:00 |
|
 Chunan ZengandCheng Wan
|
90aa1cb0fb
|
[Scheduler] Gather prefill-delayer queue timeout across ranks (#42625)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-10-06 16:15:34 -07:00 |
|
 
|
264d1c2015
|
Back the DFlash-family draft KV pool to the post-capture token count (#42651)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-06 14:23:18 -07:00 |
|
 
|
4506927635
|
[Metrics] Add per-rank DP attention imbalance metrics (#42755)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: hanming-lu <hanming-lu@users.noreply.github.com>
|
2026-10-06 14:20:41 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
3eec178e48
|
[Spec][MegaMoE] Let the speculative draft choose its own W4A4 MXFP4 MegaMoE MMA type (#42022)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 14:09:57 -07:00 |
|
Liangsheng Yin
|
12004043b8
|
[Metrics] Read scheduled prefill KV tokens from batch prefix_lens (#42797)
|
2026-10-06 13:11:29 -07:00 |
|