 MickandMick Qian
|
04f740580c
|
[VLM] fix: repair multimodal VMM lease cleanup and source-stream ordering (#43475)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-11 19:13:39 +08:00 |
|
Sage
|
53295c6972
|
[kvevents] fix missing topics in replayed kv events (#43386)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-11 17:25:43 +08:00 |
|
Liangsheng Yin
|
0a21a3b798
|
[Scheduler] Keep a DP-converted decode batch as the running batch (#43283)
|
2026-10-11 01:23:51 -07:00 |
|
jiaqiang-dot-liu
|
41652225d0
|
[Sampler] Sort only the max(top_k) leading columns in the torch sampler (#43346)
|
2026-10-11 01:00:59 -07:00 |
|
Liangsheng Yin
|
dab108b9f3
|
[Scheduler] Hold back decode rows on a mixed step when they do not fit the KV pool (#43290)
|
2026-10-11 00:18:27 -07:00 |
|
Liangsheng Yin
|
89e24e7a20
|
[KV canary] Expect sweep counters on the target runner only (#43286)
|
2026-10-10 23:52:17 -07:00 |
|
Liangsheng Yin
|
448759b235
|
[Scheduler] Requeue preempted requests when admission admits nothing (#43298)
|
2026-10-10 22:46:55 -07:00 |
|
Qiaolin Yu
|
047405f534
|
[qwen 3.8 next] Fuse QSA prefill KV gathering and dtype conversion (#41933)
|
2026-10-10 22:40:23 -07:00 |
|
Jzz1943
|
260551ebe9
|
[KDA] Support Helion MTP verification and harden prefill, decode (#42857)
|
2026-10-11 12:47:57 +08:00 |
|
 SunskyXHandXiaoyu Zhang
|
65e6bb6be7
|
[GDN] Fix CuTe DSL decode to read the [N, HV, V, K] state layout (#43332)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 12:43:16 +08:00 |
|
Shuwen Wang
|
58cb1a2be6
|
[Scheduler] Keep waiting-prefix LRU refresh consistent across TP ranks (#43479)
|
2026-10-10 21:18:41 -07:00 |
|
Khoa Pham
|
6576e50cd5
|
[1/N][DSv41] Enable DP attention with MegaMoE (#43228)
|
2026-10-10 20:36:35 -07:00 |
|
 Shangming CaiandKevin Flansburg
|
e1f43c9a61
|
[PD][HiCache] Fold the decode restore outcome into the MIN-reduced KV poll (#43562)
Co-authored-by: Kevin Flansburg <kflansburg@cloudflare.com>
|
2026-10-11 10:12:34 +08:00 |
|
Richard Wang
|
d60e0c8570
|
[diffusion] Support LLaDA-Image BF16 generation and editing (#37907)
|
2026-10-11 02:10:51 +00:00 |
|
 
|
156d54e56c
|
fix: wait for HiCache load-back before hybrid MLA KV reads (#38217)
Co-authored-by: zhouzechun <zhouzechun@kuaishou.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
|
2026-10-11 09:50:13 +08:00 |
|
 Jzz1943andXiaoyu Zhang
|
9336681310
|
[DSA] Support TileLang FP8 KV cache on CUDA (#42957)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 09:12:18 +08:00 |
|
Xiaoyu Zhang
|
33d2ef1756
|
[Fix] Reserve remaining tokens for ignore_eos requests during prefill admission (#43564)
|
2026-10-11 09:05:48 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
c640dc97ce
|
[CI] Fix Kimi-Linear DCP PD test startup (#43598)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-10 16:53:54 -07:00 |
|
Cheng Wan
|
234ccba7f6
|
[Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460)
|
2026-10-10 12:43:09 -07:00 |
|
Cheng Wan
|
3b16eeedce
|
[Refactor] Declare pipeline neighbours from a shared declaration function (#43459)
|
2026-10-10 12:42:46 -07:00 |
|
Cheng Wan
|
3b717c0f13
|
[Refactor] Decide an exit's fixed facts when the stage is built (#43458)
|
2026-10-10 12:42:23 -07:00 |
|
Cheng Wan
|
a956aa192a
|
[Refactor] Bind a layer stack in one pass over each stage's data flow (#43457)
|
2026-10-10 12:42:00 -07:00 |
|
Cheng Wan
|
d2c597c8db
|
[Refactor] Decide input-scattered eligibility and stage rejections in one place (#43456)
|
2026-10-10 12:41:38 -07:00 |
|
Cheng Wan
|
b0dde87de2
|
[Refactor] Make residual read and update capabilities explicit and checked (#43455)
|
2026-10-10 12:41:16 -07:00 |
|
Cheng Wan
|
514feb1afc
|
[Fix] Keep residual rows and sums consistent across appends and pipeline handoffs (#43454)
|
2026-10-10 12:40:53 -07:00 |
|
Cheng Wan
|
8bd7f2d178
|
[Refactor] Record what a bound stage path does instead of reading it back (#43453)
|
2026-10-10 12:40:30 -07:00 |
|
 
|
0acd93c35c
|
[Scheduler] Use committed length in spec mamba track boundary check (#43029)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-10-10 12:29:40 -07:00 |
|
 Shuwen WangandKe Bao
|
f9cee8d2b2
|
[HiCache] Keep protected cgroup page cache charged in host budgets (#42788)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-10-10 17:03:40 +00:00 |
|
Shunkangz
|
de487f8039
|
[kv-shard 3/4] Enable Control Plane C (#40102)
|
2026-10-10 22:53:58 +08:00 |
|
huangtingwei
|
406540ab5f
|
[HiCache] Add staged write-back for the page-unified KV cache layout (#39606)
|
2026-10-10 22:49:45 +08:00 |
|
Shuwen Wang
|
99d6f4e158
|
[MemCache] refactor: require an anchored lock receipt for non-root releases (#41452)
|
2026-10-10 22:43:49 +08:00 |
|
hhy-seven
|
616178a596
|
[Responses] Fix max_output_tokens overestimate on multimodal requests (#35524)
|
2026-10-10 13:42:53 +00:00 |
|
 
|
a510340aeb
|
[diffusion] perf: run head_dim-128 QK-norm + RoPE two rows per warp for every RoPE layout (#43508)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 21:34:54 +08:00 |
|
Shuwen Wang
|
416ebe6090
|
[CI] Fix EAGLE3 CUDA parity prefill chunk alignment (#43538)
|
2026-10-10 21:11:17 +08:00 |
|
Sage
|
6fc8d9da32
|
[rust-server] preserve PD routing in chat and completions (#42989)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-10 17:29:46 +08:00 |
|
Liangsheng Yin
|
c55790d38b
|
[CI] Drop CPU tests with no bug-catching signal and run Rust workspace tests in their own workflow (#43503)
|
2026-10-10 02:13:53 -07:00 |
|
chuyeh
|
e35f60b9bc
|
[AMD][CI] Drop removed tp_rank/tp_size kwargs from small-M FP8 proj test (#43318)
|
2026-10-10 00:52:28 -07:00 |
|
  ![github-actions[bot]](/assets/img/avatar_default.png)
|
d7d22e8a30
|
[AMD] Resolving bug in per batch size graph capture due to multiple capture runs per batch size (#39840)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-10-10 00:47:13 -07:00 |
|
Richard Wang
|
441de659f4
|
[CI] Fix Python 3.10 failure in prefill complete integration test (#43505)
|
2026-10-10 00:00:03 -07:00 |
|
tao
|
6e8f3e09dd
|
[Model Loader] Add InstantTensor loader support (#40453)
|
2026-10-09 23:01:59 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
16be9df25f
|
[CI] Remove the GLM-5.3-Flash PTX KDA prefill nightly test (#43470)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-09 22:52:17 -07:00 |
|
Yuwei An
|
8b2aaf7060
|
[Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287)
|
2026-10-09 22:42:35 -07:00 |
|
Yuwei An
|
0aa580f904
|
[Dsv4.1] Add DeepSeek V4.1 DSPARK TP and DP EP accuracy coverage (#43478)
|
2026-10-09 22:41:30 -07:00 |
|
YAMY
|
17852cdfe8
|
[DSv4.1] Initialize the full-to-SWA mapping for request-window pools (#43165)
|
2026-10-09 22:39:26 -07:00 |
|
Shangming Cai
|
1814ece57f
|
[PP+PD] Harden PPConsensusStore: msgspec wire format, drop malformed messages (#43329)
|
2026-10-10 12:38:38 +08:00 |
|
cctry
|
20948cdcc6
|
[PD] Reclaim parked optimistic prefills when request slots are exhausted (#43442)
|
2026-10-09 20:31:24 -07:00 |
|
Liangsheng Yin
|
7d44269907
|
[MemCache] Fix the strict busy check on prefill-aware SWA and tidy small leftovers (#43474)
|
2026-10-09 20:27:27 -07:00 |
|
 
|
f2e9a2bed1
|
[unified memory pool] Allocate without transfer waits, pin floating SWA reservations, drop the HiCache startup asserts (#43206)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: ZYHowell <ZYHowell@users.noreply.github.com>
|
2026-10-09 20:19:30 -07:00 |
|
 Benjamin TruongandXiaoyu Zhang
|
37678784c6
|
[Gemma4][Attention] Enable Gemma4 FA4 on SM90 with head-dim 512 support (#42019)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-10 10:40:19 +08:00 |
|
 
|
a338b9858a
|
[PD] Receive decode KV into separate paged SWA host pools; let host-capable receivers own abort drain tracking (#43410)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: cctry <cctry@users.noreply.github.com>
|
2026-10-09 19:33:06 -07:00 |
|