 Lianmin ZhengandShiyan Deng
|
d7f235daca
|
[Memory] Retire graph borrow pool before updating static runs (#37966)
Co-authored-by: Shiyan Deng <dsy842974287@meta.com>
|
2026-09-04 02:59:52 -07:00 |
|
 
|
44c786679f
|
[sp] Make attention-TP sequence sharding a per-forward batch property (#37546)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-09-04 02:11:03 -07:00 |
|
 
|
67248e04b4
|
[mem_cache] Route hybrid SWA full-side kv-row frees through free_segment (#37876)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: Sam Shleifer <sshleifer@gmail.com>
|
2026-09-04 01:48:33 -07:00 |
|
 Ke Baoandadityakamat24
|
0b57847ebf
|
Fix mamba radix cache ssm state indexing (#37836)
Co-authored-by: adityakamat24 <adityakamat007@gmail.com>
|
2026-09-04 15:46:33 +08:00 |
|
Xiaoyu Zhang
|
54c2c99feb
|
[Diffusion] Fuse LingBot per-token gated residual and RMSNorm modulate (#37910)
|
2026-09-04 14:35:13 +08:00 |
|
 Yu-Yun ChangandHAI
|
cb32dbc9e0
|
[AMD] [Kimi-K3] Fuse the KDA input projection into a single GEMM on ROCm (#35176)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-09-03 23:30:08 -07:00 |
|
 Alex NailsandClaude Opus 5
|
ebae8ee21e
|
[Fix] Register triton.runtime.cache.triton_key in the MPS stub so torch.compile keeps working (#37937)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-03 22:56:14 -07:00 |
|
 
|
f478b2bb2d
|
Fix: abort handling for dispatched requests after client disconnect (#35255)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: cctry <cctry@fb.com>
|
2026-09-03 21:51:57 -07:00 |
|
ashwini rathi
|
e787de5478
|
[XPU][CI] Move XPU tests to nightly and add per-subclass server launch timeout (#37532)
|
2026-09-04 12:51:26 +08:00 |
|
Baizhou Zhang
|
ff1285cc28
|
[CP V1 Deprecation 2/5] Make strategy prefill CP canonical (#36223)
|
2026-09-03 20:24:19 -07:00 |
|
 junduandMa Mingfei
|
8770c1db1f
|
[CPU][CI]: rename Xeon CPU CI suites to stage-*-intel (#37395)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-04 10:08:41 +08:00 |
|
 eigenandYingyi Huang
|
516cfbd362
|
Fix UNO test adapter subdirectory resolution (#37872)
Co-authored-by: Yingyi Huang <averyh@nvidia.com>
|
2026-09-03 18:07:09 -07:00 |
|
heziiop
|
9ed2721c6d
|
[NPU] fix extend_seq_lens_cpu shape in eager mode (#36843)
|
2026-09-04 09:03:30 +08:00 |
|
Zhiqiang Xie
|
a480f388b2
|
[HiCache] L3 storage prefetch lifecycle metrics and cross-tier attribution fixes (#37503)
|
2026-09-03 16:00:04 -07:00 |
|
 Yonghao Zhuangandyhzhuang
|
4dc9cda5f9
|
[PD] Gate deferred decode KV release on backend capability (#37454)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
|
2026-09-03 15:42:21 -07:00 |
|
Baizhou Zhang
|
fd70325c10
|
[CI] Add dspark + dsv4 e2e test (#37665)
|
2026-09-03 14:26:25 -07:00 |
|
Liangsheng Yin
|
0e5414fd2f
|
[Test] Allow top-k cutoff ties in test_sampling_mask_matches_topk_logprobs (#37873)
|
2026-09-03 14:13:26 -07:00 |
|
Liangsheng Yin
|
2a980cbf10
|
[mem_cache] Require page-aligned starts in free_segment and drop the boundary trim (#37729)
|
2026-09-03 13:28:33 -07:00 |
|
Zhiqiang Xie
|
d0c95f6c91
|
[HiCache] buffer mode: anchor-lock staged prefetches by default (#37464)
|
2026-09-03 12:08:22 -07:00 |
|
 Zhanghengand晟海
|
abed680320
|
[Unified Cache][5/N]: Integrate external linker mode end to end (#37381)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-09-04 02:02:58 +08:00 |
|
cctry
|
33a22b1b08
|
[Cache] Forward fast prefix matching capability (#37844)
|
2026-09-03 10:33:30 -07:00 |
|
 Vincent Gaoandinkcherry
|
54cadad151
|
[Router] Add composable scoring and eligibility policies (#37731)
Co-authored-by: inkcherry <mingzhi.liu@amd.com>
|
2026-09-04 00:01:41 +08:00 |
|
 Quanli Liand全力
|
4e37882a93
|
[Diffusion][minimax-h3] Add SM120 support for SubBlock sparse attention (#37332)
Co-authored-by: 全力 <liquanli.lql@antgroup.com>
|
2026-09-03 22:05:22 +08:00 |
|
pllimax
|
3239baef25
|
[CI][NPU] Fix kimi_k2_6 16p in64k perf test and dsv4-flash testcases (#37760)
|
2026-09-03 21:57:14 +08:00 |
|
 
|
2bb25dc18b
|
[Speculative Decoding] Add native UNO serving support (#37667)
Co-authored-by: drproduck <drproduck@MacBook-Air-2.local>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-03 20:08:41 +08:00 |
|
Cheng Wan
|
a11dba1a01
|
[Feature] Unified memory: support decode context parallelism for the trtllm_mla family (#37693)
|
2026-09-03 03:37:12 -07:00 |
|
 
|
27b7a2dc3b
|
[Kimi K3] Rework skipped-think fix as opt-in force_nonempty_content with streaming coverage (#34187)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-09-03 17:37:28 +08:00 |
|
 kkandwunhuang
|
a6001478f4
|
[AMD] Perf Kimi-K3 MoE optimization (#33838)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-09-03 02:28:28 -07:00 |
|
 Xinyi SongandThomas Wang
|
7ed29eba80
|
[AMD] Fix FP4 indexer OOR (#37660)
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
|
2026-09-03 01:49:46 -07:00 |
|
Polisetty V R K Jyothendra Varma
|
e59a576f03
|
fix test/manual/test_forward_split_prefill.py UT due to many refactors and design changes (#36617)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
|
2026-09-03 01:48:55 -07:00 |
|
 
|
3bac084d4e
|
[Model] Add native IFM K2 Horizon serving support (#37654)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-03 16:39:43 +08:00 |
|
 YC Yen-Ching TsengandPhil Li
|
1fb85053e7
|
[AMD][Diffusion] Migrate FlyDSL fused norm kernels to the v0.3.0 stable API (#36349)
Co-authored-by: Phil Li <haicli@amd.com>
|
2026-09-02 23:03:08 -07:00 |
|
 xiaobochen-amdandZhang, Jiejing
|
030d7e7e9b
|
[ROCm] Define the DSA head-gate graph helpers on HIP (#37118)
Co-authored-by: Zhang, Jiejing <jiejing.zhang@amd.com>
|
2026-09-02 22:55:45 -07:00 |
|
 Alex NailsandAlison Shao
|
28262c20df
|
[CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
|
2026-09-02 19:46:08 -07:00 |
|
    
|
2641e427be
|
Xpu/weekly simple model enablement 2026 08 30 (#37193)
Co-authored-by: dayanandav <dayananda.vasantha.kumar@intel.com>
Co-authored-by: Girijala, Pavan Sivaram <pavan.sivaram.girijala@intel.com>
Co-authored-by: Cui, Lily <lily.cui@intel.com>
Co-authored-by: Juan Muneton <juan.muneton.gallego@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
|
2026-09-03 09:35:59 +08:00 |
|
Liangsheng Yin
|
a522c8a4b6
|
[misc] Extract PP dynamic chunk sizing into a DynamicChunkSizer scheduler component (#37674)
|
2026-09-02 18:35:43 -07:00 |
|
Mick
|
0dd66def7c
|
[chore] harden checkpoint quantization metadata parsing (#36922)
|
2026-09-03 09:27:22 +08:00 |
|
  
|
fbf909b460
|
[Fix] Alpha-channel images and tool-result media ordering (port of #36507) (#37320)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-09-02 18:23:06 -07:00 |
|
 Lee NauandYangmin Li
|
6e41f1ad29
|
[Fix] Preserve FP32 in SM107 MXFP8 fallback (#37489)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
|
2026-09-02 17:55:14 -07:00 |
|
   
|
87d60a2229
|
Improve CUDA graph and speculative execution output handling (#37329)
Co-authored-by: jiayisuse <jiayisuse@fb.com>
Co-authored-by: Yinghai Lu <yinghai@meta.com>
Co-authored-by: Hao Zhang <zhisbug@users.noreply.github.com>
Co-authored-by: Yichao Fu <yichaofu@meta.com>
|
2026-09-02 17:25:27 -07:00 |
|
Alison Shao
|
db1eb48651
|
[CI] Graceful teardown for the PD and HiSparse server fixtures (#37485)
|
2026-09-02 17:22:18 -07:00 |
|
 
|
ff04a00d73
|
Reduce tokenizer overhead and offload CUDA VMM publication (#37330)
Co-authored-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Yinghai Lu <yinghai@meta.com>
|
2026-09-02 17:21:08 -07:00 |
|
Liangsheng Yin
|
5c46ce37f5
|
[Fix] Apply the attention-CP broadcast result in PP dynamic-chunk profiling (#37669)
|
2026-09-02 17:20:07 -07:00 |
|
 Byron HsuandByronHsu
|
046cdaabaa
|
[Sampling] Capture masks from sampler support (#36630)
Co-authored-by: ByronHsu <ByronHsu@users.noreply.github.com>
|
2026-09-02 17:13:28 -07:00 |
|
 Cheng WanandClaude Opus 5
|
5ddca6819e
|
Fix unified SWA: size a non-owner's v2p by the id space it must address (#37560)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-02 16:56:18 -07:00 |
|
 Cheng WanandClaude Opus 5
|
d9848b9ecd
|
Build the unified read stream directly, without the page-table rectangle (#37512)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-02 16:55:16 -07:00 |
|
 Cheng WanandClaude Opus 5
|
18d5ffb42a
|
Size the unified read-table grid from bs, and fuse the allocator's tombstone scatters (#37511)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-02 16:54:26 -07:00 |
|
  
|
c05f8ae830
|
[PD] Optimize paged allocator free-list release (#37146)
Co-authored-by: wangwenming.41 <wangwenming.41@jd.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-02 16:51:37 -07:00 |
|
Mohammad Miadh Angkad
|
718bd39fe0
|
[Fix] DP attention: correct the decode->extend prefix off-by-one (#37505)
|
2026-09-02 16:14:16 -07:00 |
|
 paulzhang-tmandQiaolin-Yu
|
3fa6b86504
|
[Spec] Publish the final multi-layer EAGLE shared-read event (#36752)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2026-09-02 15:57:50 -07:00 |
|