 Niko Ma
|
18d728967a
|
[PD][MoRI] Drive KV transfers with a sharded synchronous worker pool (#26922)
|
2026-06-08 00:49:25 -07:00 |
|
|
fzyzcjy
|
71a0b10462
|
Fix the _chunked_req_scheduled_last_iter flag with a content-based stash gate (#26938)
|
2026-06-08 14:55:41 +08:00 |
|
|
fzyzcjy
|
259a2da3e0
|
Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637)
|
2026-06-08 14:52:18 +08:00 |
|
|
fzyzcjy
|
f5fdf9c5d8
|
Speed up dump comparator percentile computation using numpy (#26874)
|
2026-06-08 14:50:31 +08:00 |
|
|
fzyzcjy
|
995e649190
|
Add parallel-rank dump filenames and pipeline-global layer remapping to dumper (#26850)
|
2026-06-08 14:49:22 +08:00 |
|
|
Han Yu
|
3d2165a286
|
Fix dual-chunk sparse fallback index overflow (#27361)
|
2026-06-07 23:15:37 -07:00 |
|
|
Liangsheng Yin
|
f68c79675f
|
Support topk > 1 tree drafting for mamba/hybrid-linear models on spec v2 (#27463)
|
2026-06-07 17:04:09 -07:00 |
|
|
Hubert Lu
|
10d33bd77e
|
[AMD] Enable Piecewise CUDA Graph for AMD GPUs (#22299)
|
2026-06-07 16:28:20 -07:00 |
|
|
fzyzcjy
|
0a190d1c97
|
Fix PP is_fully_idle missing in-flight microbatches (#27446)
|
2026-06-07 17:38:26 +08:00 |
|
|
Zhangheng
|
a39c428d3f
|
[UnifiedTree][CI]: Reduce HiCache PP KL test concurrency to avoid decode OOM (#27483)
|
2026-06-07 17:12:42 +08:00 |
|
|
Liangsheng Yin
|
0ce3db3c0a
|
[Bug] Fix out-of-range token id crashing tp=1 VocabParallelEmbedding (#27482)
|
2026-06-06 23:00:17 -07:00 |
|
|
Mohammad Miadh AngkadandLianmin Zheng
|
52f221cce0
|
Fix Req array token-id concatenation (#26182)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-06 19:59:51 -07:00 |
|
|
Zhangheng
|
fe548f36b0
|
[UnifiedTree]: Fix SWA admission budget under-counts HiCache load-back consumption (#27391)
|
2026-06-07 10:47:08 +08:00 |
|
|
shuwenn
|
e57323cae9
|
[mem_cache][4/N] refactor: extract MambaTokenToKVPoolAllocator into allocator/ (#27256)
|
2026-06-07 10:46:29 +08:00 |
|
|
Liangsheng Yin
|
032c9efb46
|
Enable async-assert invariant probes by default in CI (#27461)
|
2026-06-06 16:23:21 -07:00 |
|
|
Qiaolin Yu
|
4b0f629082
|
[perf] reduce radix cache match overhead by changing the match algorithm (#27364)
|
2026-06-06 15:40:28 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
9097647090
|
Route the eager forward path through the CUDA graph input-buffer registry (#27407)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-06 14:35:53 -07:00 |
|
|
Liangsheng Yin
|
84ca0ffb8c
|
Spec v2 tree drafting (topk>1) with page_size>1 (#26972)
|
2026-06-06 12:00:27 -07:00 |
|
|
|
4e14b50c48
|
[NPU]Support torch_npu profiler patch API drift (#26356)
Co-authored-by: leland17 <lileliao@foxmail.com>
Co-authored-by: OmX <omx@oh-my-codex.dev>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-06 16:27:51 +03:00 |
|
|
fzyzcjy
|
99cf0a4399
|
Fix flaky test_self_e2e_pd_perturb (#27426)
|
2026-06-06 19:31:08 +08:00 |
|
|
Baizhou Zhang
|
9a48bf75f5
|
Add GB300 base C CI suite (#27427)
|
2026-06-06 02:27:30 -07:00 |
|
|
|
42fe025280
|
[HiCache] Fix the compatibility between PP and HiCache (L2). (#27285)
Co-authored-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-06-06 16:57:23 +08:00 |
|
|
EduardDurech
|
e9dbbd19e9
|
[model] Apertus Tool/Function and Reasoning parser (#25100)
|
2026-06-06 00:04:31 -07:00 |
|
|
Hanming Lu
|
163fafba51
|
fix test_qwen3_next_models flaky (#27419)
|
2026-06-06 14:26:32 +08:00 |
|
|
kkandwunhuang
|
aa55657e9e
|
[AMD][WA] force to use gate_mode interleaved to fix tp2/tp4/tp8 acc issue (#27201)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-06-05 20:18:11 -07:00 |
|
|
fzyzcjy
|
bf4f2ccc78
|
Add scripted-runtime unit, core integration, and chunked-prefill tests (#27413)
|
2026-06-06 09:08:35 +08:00 |
|
|
fzyzcjy
|
21201ef718
|
Add kv_canary PP self-test fixture and SWA divergence coverage (#27410)
|
2026-06-06 09:06:19 +08:00 |
|
|
xutizhou
|
29591594f5
|
Support Waterfill with dynamic EPLB (#27150)
|
2026-06-05 16:01:16 -07:00 |
|
|
|
6b180959a8
|
[SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055)
Co-authored-by: 坤钧 <maoyuhan.myh@antgroup.co>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
Co-authored-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: shuwenn <2508695655@qq.com>
|
2026-06-05 15:43:02 -07:00 |
|
|
Zhangheng
|
86b9bf5812
|
[CI]: Fix CI Stage for 3fs backend test (#27388)
|
2026-06-06 00:38:03 +08:00 |
|
|
Zhangheng
|
6cfdc18585
|
HiCache: Fix Flaky CI For 3FS Backend (#27358)
|
2026-06-05 22:00:19 +08:00 |
|
|
Aurick Qiao
|
c06802dc16
|
Fix customized_info incremental streaming (#27205)
|
2026-06-05 21:55:01 +08:00 |
|
|
huangtingwei
|
00fefef16b
|
[PD & HiSparse] Add DeepSeek V4 support for HiSparse direct Prefill-to-Decode DRAM (#24880)
|
2026-06-05 15:39:48 +08:00 |
|
|
|
6cbc035dc9
|
FrozenKVMTPVerifyInput: add _draft_preprocess_idle call for when all requests in the verify batch finish in the same iteration (#26859)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Harmya Bhatt <harmyacs@gmail.com>
|
2026-06-04 21:47:32 -07:00 |
|
|
liuxianglong17
|
aed0808e18
|
6-5 nightly failed test case fix (#27335)
|
2026-06-05 11:39:23 +08:00 |
|
|
Yuhao Yang
|
46c58b5c70
|
bench: fix MMMU VLM eval max_tokens for CoT prompt (#27327)
|
2026-06-05 10:28:16 +08:00 |
|
|
|
2c8357f794
|
[XPU] Enable Gemma 4 E2B / E4B / 31B/ 26B-A4B on Intel XPU (#23280)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: jmunetong <jmunetong@users.noreply.github.com>
Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>
Co-authored-by: ckvermaAI <ckverma@habana.ai>
|
2026-06-05 10:05:07 +08:00 |
|
|
Zhangheng
|
631db6c757
|
[UnifiedTree]: Sync sidecar component hits across TP ranks and make SWA prefetch all-or-nothing (#27264)
|
2026-06-05 09:23:54 +08:00 |
|
|
Cheng WanandClaude Opus 4.8
|
7dc7376697
|
fix(attn): delegate init_mha_chunk_metadata in HybridLinearAttnBackend (#27316)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-04 17:44:23 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
0aa72a9e76
|
Replace skip_attn_backend_init with a batch-carried attention plan marker (+ staleness re-plan) (#27193)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-04 17:13:18 -07:00 |
|
|
Lianmin Zheng
|
448d3afb76
|
fix(spec): complete CustomSpecAlgo duck-typing interface and guard against drift (#27300)
|
2026-06-04 15:52:46 -07:00 |
|
|
Bowen WangandXinyuan Tong
|
07f326c184
|
Fix multimodal synthetic benchmark prompt generation to exclude special tokens (#26864)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-04 22:27:43 +00:00 |
|
|
Liangsheng Yin
|
cd98d97037
|
Use level-1 (quiet) busy memory check in chunked-prefill and streaming tests (#27303)
|
2026-06-04 17:04:27 -04:00 |
|
|
Liangsheng Yin
|
687cfe9198
|
Enable runtime busy memory check for speculation topk>1 (#27228)
|
2026-06-04 16:46:20 -04:00 |
|
|
YC Yen-Ching Tseng
|
69623f4b11
|
[AMD] Guard aiter greedy_sample OOB token id (fixes VLM MMMU CI) (#27247)
|
2026-06-04 12:53:58 -07:00 |
|
|
Chengze FanandHaiShaw
|
8e836e7dc9
|
Support optional kwargs in AITER fused_moe runner (#26746)
Co-authored-by: HaiShaw <hixiao@gmail.com>
|
2026-06-04 08:25:03 -07:00 |
|
|
liuxianglong17
|
8933ec8772
|
fix test cases failed on 5/30 in nightly pipeline (#26775)
|
2026-06-04 20:07:20 +08:00 |
|
|
liuxianglong17
|
4167f211b1
|
Solving the problem of test case failures caused by timeouts (#27027)
|
2026-06-04 20:07:04 +08:00 |
|
|
liuxianglong17
|
364c2bfea8
|
Test case restoration in the full test. (#26933)
|
2026-06-04 20:06:44 +08:00 |
|
|
shuwenn
|
1af53f67b2
|
[mem_cache][2/N] refactor: move SWATokenToKVPoolAllocator to allocator/swa.py (#26676)
|
2026-06-04 15:10:37 +08:00 |
|