Jzz1943
|
260551ebe9
|
[KDA] Support Helion MTP verification and harden prefill, decode (#42857)
|
2026-10-11 12:47:57 +08:00 |
|
 SunskyXHandXiaoyu Zhang
|
65e6bb6be7
|
[GDN] Fix CuTe DSL decode to read the [N, HV, V, K] state layout (#43332)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 12:43:16 +08:00 |
|
Shuwen Wang
|
58cb1a2be6
|
[Scheduler] Keep waiting-prefix LRU refresh consistent across TP ranks (#43479)
|
2026-10-10 21:18:41 -07:00 |
|
Khoa Pham
|
6576e50cd5
|
[1/N][DSv41] Enable DP attention with MegaMoE (#43228)
|
2026-10-10 20:36:35 -07:00 |
|
 Shangming CaiandKevin Flansburg
|
e1f43c9a61
|
[PD][HiCache] Fold the decode restore outcome into the MIN-reduced KV poll (#43562)
Co-authored-by: Kevin Flansburg <kflansburg@cloudflare.com>
|
2026-10-11 10:12:34 +08:00 |
|
Richard Wang
|
d60e0c8570
|
[diffusion] Support LLaDA-Image BF16 generation and editing (#37907)
|
2026-10-11 02:10:51 +00:00 |
|
 
|
156d54e56c
|
fix: wait for HiCache load-back before hybrid MLA KV reads (#38217)
Co-authored-by: zhouzechun <zhouzechun@kuaishou.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
|
2026-10-11 09:50:13 +08:00 |
|
 Jzz1943andXiaoyu Zhang
|
9336681310
|
[DSA] Support TileLang FP8 KV cache on CUDA (#42957)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 09:12:18 +08:00 |
|
Xiaoyu Zhang
|
33d2ef1756
|
[Fix] Reserve remaining tokens for ignore_eos requests during prefill admission (#43564)
|
2026-10-11 09:05:48 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
c640dc97ce
|
[CI] Fix Kimi-Linear DCP PD test startup (#43598)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-10 16:53:54 -07:00 |
|
Cheng Wan
|
234ccba7f6
|
[Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460)
|
2026-10-10 12:43:09 -07:00 |
|
Cheng Wan
|
3b16eeedce
|
[Refactor] Declare pipeline neighbours from a shared declaration function (#43459)
|
2026-10-10 12:42:46 -07:00 |
|
Cheng Wan
|
3b717c0f13
|
[Refactor] Decide an exit's fixed facts when the stage is built (#43458)
|
2026-10-10 12:42:23 -07:00 |
|
Cheng Wan
|
a956aa192a
|
[Refactor] Bind a layer stack in one pass over each stage's data flow (#43457)
|
2026-10-10 12:42:00 -07:00 |
|
Cheng Wan
|
d2c597c8db
|
[Refactor] Decide input-scattered eligibility and stage rejections in one place (#43456)
|
2026-10-10 12:41:38 -07:00 |
|
Cheng Wan
|
b0dde87de2
|
[Refactor] Make residual read and update capabilities explicit and checked (#43455)
|
2026-10-10 12:41:16 -07:00 |
|
Cheng Wan
|
514feb1afc
|
[Fix] Keep residual rows and sums consistent across appends and pipeline handoffs (#43454)
|
2026-10-10 12:40:53 -07:00 |
|
Cheng Wan
|
8bd7f2d178
|
[Refactor] Record what a bound stage path does instead of reading it back (#43453)
|
2026-10-10 12:40:30 -07:00 |
|
 
|
0acd93c35c
|
[Scheduler] Use committed length in spec mamba track boundary check (#43029)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-10-10 12:29:40 -07:00 |
|
 Shuwen WangandKe Bao
|
f9cee8d2b2
|
[HiCache] Keep protected cgroup page cache charged in host budgets (#42788)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-10-10 17:03:40 +00:00 |
|
Shunkangz
|
de487f8039
|
[kv-shard 3/4] Enable Control Plane C (#40102)
|
2026-10-10 22:53:58 +08:00 |
|
huangtingwei
|
406540ab5f
|
[HiCache] Add staged write-back for the page-unified KV cache layout (#39606)
|
2026-10-10 22:49:45 +08:00 |
|
Shuwen Wang
|
99d6f4e158
|
[MemCache] refactor: require an anchored lock receipt for non-root releases (#41452)
|
2026-10-10 22:43:49 +08:00 |
|
hhy-seven
|
616178a596
|
[Responses] Fix max_output_tokens overestimate on multimodal requests (#35524)
|
2026-10-10 13:42:53 +00:00 |
|
 
|
a510340aeb
|
[diffusion] perf: run head_dim-128 QK-norm + RoPE two rows per warp for every RoPE layout (#43508)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 21:34:54 +08:00 |
|
Shuwen Wang
|
416ebe6090
|
[CI] Fix EAGLE3 CUDA parity prefill chunk alignment (#43538)
|
2026-10-10 21:11:17 +08:00 |
|
Sage
|
6fc8d9da32
|
[rust-server] preserve PD routing in chat and completions (#42989)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-10 17:29:46 +08:00 |
|
Liangsheng Yin
|
c55790d38b
|
[CI] Drop CPU tests with no bug-catching signal and run Rust workspace tests in their own workflow (#43503)
|
2026-10-10 02:13:53 -07:00 |
|
chuyeh
|
e35f60b9bc
|
[AMD][CI] Drop removed tp_rank/tp_size kwargs from small-M FP8 proj test (#43318)
|
2026-10-10 00:52:28 -07:00 |
|
  ![github-actions[bot]](/assets/img/avatar_default.png)
|
d7d22e8a30
|
[AMD] Resolving bug in per batch size graph capture due to multiple capture runs per batch size (#39840)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-10-10 00:47:13 -07:00 |
|
Richard Wang
|
441de659f4
|
[CI] Fix Python 3.10 failure in prefill complete integration test (#43505)
|
2026-10-10 00:00:03 -07:00 |
|
tao
|
6e8f3e09dd
|
[Model Loader] Add InstantTensor loader support (#40453)
|
2026-10-09 23:01:59 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
16be9df25f
|
[CI] Remove the GLM-5.3-Flash PTX KDA prefill nightly test (#43470)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-09 22:52:17 -07:00 |
|
Yuwei An
|
8b2aaf7060
|
[Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287)
|
2026-10-09 22:42:35 -07:00 |
|
Yuwei An
|
0aa580f904
|
[Dsv4.1] Add DeepSeek V4.1 DSPARK TP and DP EP accuracy coverage (#43478)
|
2026-10-09 22:41:30 -07:00 |
|
YAMY
|
17852cdfe8
|
[DSv4.1] Initialize the full-to-SWA mapping for request-window pools (#43165)
|
2026-10-09 22:39:26 -07:00 |
|
Shangming Cai
|
1814ece57f
|
[PP+PD] Harden PPConsensusStore: msgspec wire format, drop malformed messages (#43329)
|
2026-10-10 12:38:38 +08:00 |
|
cctry
|
20948cdcc6
|
[PD] Reclaim parked optimistic prefills when request slots are exhausted (#43442)
|
2026-10-09 20:31:24 -07:00 |
|
Liangsheng Yin
|
7d44269907
|
[MemCache] Fix the strict busy check on prefill-aware SWA and tidy small leftovers (#43474)
|
2026-10-09 20:27:27 -07:00 |
|
 
|
f2e9a2bed1
|
[unified memory pool] Allocate without transfer waits, pin floating SWA reservations, drop the HiCache startup asserts (#43206)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: ZYHowell <ZYHowell@users.noreply.github.com>
|
2026-10-09 20:19:30 -07:00 |
|
 Benjamin TruongandXiaoyu Zhang
|
37678784c6
|
[Gemma4][Attention] Enable Gemma4 FA4 on SM90 with head-dim 512 support (#42019)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-10 10:40:19 +08:00 |
|
 
|
a338b9858a
|
[PD] Receive decode KV into separate paged SWA host pools; let host-capable receivers own abort drain tracking (#43410)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: cctry <cctry@users.noreply.github.com>
|
2026-10-09 19:33:06 -07:00 |
|
 Vladislav NosivskoyandBBuf
|
2ff3e6dce1
|
[SM90] Use native block32 DeepGEMM for DeepSeek-V4.1 (#42604)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-10-10 10:29:42 +08:00 |
|
Liangsheng Yin
|
465253ef52
|
[Scheduler] Fix the deterministic-inference hang when a prefill chunk is shorter than its alignment (#43444)
|
2026-10-09 19:06:18 -07:00 |
|
 
|
78218194ad
|
perf(kda): rebalance MTP verify precompute and state synchronization (#42683)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-10 10:03:19 +08:00 |
|
Michael
|
37114afe20
|
[AMD][Fix] Saturate FP8 KV commits instead of reproducing e4m3fnuz NaN overflow (#42982)
|
2026-10-10 09:49:56 +08:00 |
|
 
|
5f94a45896
|
[srt] Allow mixed chunk prefill on the Full prefill CUDA graph backend (#43461)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-09 18:21:22 -07:00 |
|
 
|
e8fb52c526
|
[Fix] Keep request-pool row generations monotonic across clear() (#43439)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: colinchan15 <colinchan15@users.noreply.github.com>
|
2026-10-09 18:08:54 -07:00 |
|
ashwini rathi
|
8cf4d73c84
|
[XPU] Fix XPU CI breaks from #41105 (KDA chunk_offsets) and #42588 (int4 test tp_group) (#43334)
|
2026-10-10 09:06:24 +08:00 |
|
 
|
ff3aa58f11
|
[diffusion] perf: run MiniMax-H3's QK-norm + RoPE two rows per war while bit-identical (#43337)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 09:03:36 +08:00 |
|