fzyzcjy
|
1368717248
|
Add more testing for chunked prefill (#27506)
|
2026-06-09 20:19:30 +08:00 |
|
fzyzcjy
|
609f5f549c
|
Add mixed-prefix gsm8k eval and its CPU unit test (#27502)
|
2026-06-09 20:17:41 +08:00 |
|
  
|
2218622f50
|
Fix spec v2 stop output boundary (#25980)
Co-authored-by: gss <2783977641@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-06-09 00:32:21 -07:00 |
|
  
|
d145a6127a
|
fix: stop-string check misses early matches during speculative decoding (#23802)
Co-authored-by: xythink <xythink@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-06-08 23:25:58 -07:00 |
|
 
|
c2eae96c56
|
MSCCL++ Integration (#22734)
Co-authored-by: Caio Rocha <caiorocha@microsof.com>
Co-authored-by: empyreus <rjsouza1995@gmail.com>
|
2026-06-08 21:13:13 -07:00 |
|
Khoa Pham
|
0f8673851c
|
test: fix gemma GSM8K thresholds in nightly text eval (#27342)
|
2026-06-08 19:58:42 -07:00 |
|
 jianan-guandMa Mingfei
|
db143e5212
|
[Intel GPU][Encoder] Add xpu_attn backend for encoder vision attention (#26460)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-06-09 09:47:44 +08:00 |
|
 ashwini rathiandClaude Opus 4.7
|
009a0ceefa
|
[XPU CI] Re-enable stage B with docker-pull flow and split tests (#27526)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-09 09:26:11 +08:00 |
|
 Zhiy-Zhangandqiufan.zzy
|
a09e85d677
|
Fix(spec): Fix the crash issue in the FA3 backend when running with top-k > 1 and page_size > 1 (#25077)
Co-authored-by: qiufan.zzy <qiufan.zzy@antgroup.com>
|
2026-06-08 17:14:29 -07:00 |
|
Liangsheng Yin
|
3fe6bc390b
|
[Spec] Naming cleanup: contiguous draft-loc kernel + accepted->accept (#27599)
|
2026-06-08 15:04:58 -07:00 |
|
Khoa Pham
|
c95179bc85
|
[Spec] Fuse small kenrels under gather_spec_extras (#27233)
|
2026-06-08 15:02:04 -07:00 |
|
Liangsheng Yin
|
b5c64b94d5
|
[Spec] Rename token resolver to _resolve_spec_v2_tokens; remove dead V1 helpers (#27552)
|
2026-06-08 14:42:21 -07:00 |
|
 YAMYandYuwei An
|
ca66e6fb5e
|
[BCG] Support breakable CUDA graph for DeepSeek V4 DP attention (#25195)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-06-08 13:54:58 -07:00 |
|
Liangsheng Yin
|
28c1a3cb45
|
[Spec] Deprecate Spec V1 (#25464)
|
2026-06-08 13:10:27 -07:00 |
|
Lianmin Zheng
|
fca4ef9d69
|
Fix SWA pool resolution for EAGLE draft workers (#27491)
|
2026-06-08 11:00:29 -07:00 |
|
 Elizaveta MartirosianandElizaveta Martirosian
|
593eb2e0fa
|
[NPU] Fix CI (#27577)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
|
2026-06-08 20:44:57 +03:00 |
|
 Stella-17andxinyue.fan
|
12de907bc2
|
[MUSA][23/N] CI: Fix torchada preflight lock cleanup and add LLM server smoke test (#27242)
Co-authored-by: xinyue.fan <xinyue.fan@mthreads.com>
|
2026-06-08 08:45:16 -07:00 |
|
  ![github-actions[bot]](/assets/img/avatar_default.png)
|
40030d8af8
|
[NPU] Add GitHub test summary and deduplicate test code. Part 2 (#24689)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-08 18:08:45 +03:00 |
|
Niko Ma
|
18d728967a
|
[PD][MoRI] Drive KV transfers with a sharded synchronous worker pool (#26922)
|
2026-06-08 00:49:25 -07:00 |
|
fzyzcjy
|
71a0b10462
|
Fix the _chunked_req_scheduled_last_iter flag with a content-based stash gate (#26938)
|
2026-06-08 14:55:41 +08:00 |
|
fzyzcjy
|
259a2da3e0
|
Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637)
|
2026-06-08 14:52:18 +08:00 |
|
fzyzcjy
|
f5fdf9c5d8
|
Speed up dump comparator percentile computation using numpy (#26874)
|
2026-06-08 14:50:31 +08:00 |
|
fzyzcjy
|
995e649190
|
Add parallel-rank dump filenames and pipeline-global layer remapping to dumper (#26850)
|
2026-06-08 14:49:22 +08:00 |
|
Han Yu
|
3d2165a286
|
Fix dual-chunk sparse fallback index overflow (#27361)
|
2026-06-07 23:15:37 -07:00 |
|
Liangsheng Yin
|
f68c79675f
|
Support topk > 1 tree drafting for mamba/hybrid-linear models on spec v2 (#27463)
|
2026-06-07 17:04:09 -07:00 |
|
Hubert Lu
|
10d33bd77e
|
[AMD] Enable Piecewise CUDA Graph for AMD GPUs (#22299)
|
2026-06-07 16:28:20 -07:00 |
|
fzyzcjy
|
0a190d1c97
|
Fix PP is_fully_idle missing in-flight microbatches (#27446)
|
2026-06-07 17:38:26 +08:00 |
|
Zhangheng
|
a39c428d3f
|
[UnifiedTree][CI]: Reduce HiCache PP KL test concurrency to avoid decode OOM (#27483)
|
2026-06-07 17:12:42 +08:00 |
|
Liangsheng Yin
|
0ce3db3c0a
|
[Bug] Fix out-of-range token id crashing tp=1 VocabParallelEmbedding (#27482)
|
2026-06-06 23:00:17 -07:00 |
|
 Mohammad Miadh AngkadandLianmin Zheng
|
52f221cce0
|
Fix Req array token-id concatenation (#26182)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-06 19:59:51 -07:00 |
|
Zhangheng
|
fe548f36b0
|
[UnifiedTree]: Fix SWA admission budget under-counts HiCache load-back consumption (#27391)
|
2026-06-07 10:47:08 +08:00 |
|
shuwenn
|
e57323cae9
|
[mem_cache][4/N] refactor: extract MambaTokenToKVPoolAllocator into allocator/ (#27256)
|
2026-06-07 10:46:29 +08:00 |
|
Liangsheng Yin
|
032c9efb46
|
Enable async-assert invariant probes by default in CI (#27461)
|
2026-06-06 16:23:21 -07:00 |
|
Qiaolin Yu
|
4b0f629082
|
[perf] reduce radix cache match overhead by changing the match algorithm (#27364)
|
2026-06-06 15:40:28 -07:00 |
|
 Cheng WanandClaude Opus 4.8
|
9097647090
|
Route the eager forward path through the CUDA graph input-buffer registry (#27407)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-06 14:35:53 -07:00 |
|
Liangsheng Yin
|
84ca0ffb8c
|
Spec v2 tree drafting (topk>1) with page_size>1 (#26972)
|
2026-06-06 12:00:27 -07:00 |
|
  
|
4e14b50c48
|
[NPU]Support torch_npu profiler patch API drift (#26356)
Co-authored-by: leland17 <lileliao@foxmail.com>
Co-authored-by: OmX <omx@oh-my-codex.dev>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-06 16:27:51 +03:00 |
|
fzyzcjy
|
99cf0a4399
|
Fix flaky test_self_e2e_pd_perturb (#27426)
|
2026-06-06 19:31:08 +08:00 |
|
Baizhou Zhang
|
9a48bf75f5
|
Add GB300 base C CI suite (#27427)
|
2026-06-06 02:27:30 -07:00 |
|
   
|
42fe025280
|
[HiCache] Fix the compatibility between PP and HiCache (L2). (#27285)
Co-authored-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-06-06 16:57:23 +08:00 |
|
EduardDurech
|
e9dbbd19e9
|
[model] Apertus Tool/Function and Reasoning parser (#25100)
|
2026-06-06 00:04:31 -07:00 |
|
Hanming Lu
|
163fafba51
|
fix test_qwen3_next_models flaky (#27419)
|
2026-06-06 14:26:32 +08:00 |
|
 kkandwunhuang
|
aa55657e9e
|
[AMD][WA] force to use gate_mode interleaved to fix tp2/tp4/tp8 acc issue (#27201)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-06-05 20:18:11 -07:00 |
|
fzyzcjy
|
bf4f2ccc78
|
Add scripted-runtime unit, core integration, and chunked-prefill tests (#27413)
|
2026-06-06 09:08:35 +08:00 |
|
fzyzcjy
|
21201ef718
|
Add kv_canary PP self-test fixture and SWA divergence coverage (#27410)
|
2026-06-06 09:06:19 +08:00 |
|
xutizhou
|
29591594f5
|
Support Waterfill with dynamic EPLB (#27150)
|
2026-06-05 16:01:16 -07:00 |
|
    
|
6b180959a8
|
[SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055)
Co-authored-by: 坤钧 <maoyuhan.myh@antgroup.co>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
Co-authored-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: shuwenn <2508695655@qq.com>
|
2026-06-05 15:43:02 -07:00 |
|
Zhangheng
|
86b9bf5812
|
[CI]: Fix CI Stage for 3fs backend test (#27388)
|
2026-06-06 00:38:03 +08:00 |
|
Zhangheng
|
6cfdc18585
|
HiCache: Fix Flaky CI For 3FS Backend (#27358)
|
2026-06-05 22:00:19 +08:00 |
|
Aurick Qiao
|
c06802dc16
|
Fix customized_info incremental streaming (#27205)
|
2026-06-05 21:55:01 +08:00 |
|