 Cao E
|
2d1856bf45
|
Support encoder_decoder on cpu_graph_runner (#10950)
|
2026-06-08 10:30:11 +08:00 |
|
|
Liangsheng Yin
|
303757ccd8
|
[Attn] Fix aiter MLA verify kv_indices under-alloc + shared assert_buffer_fits guard (#27485)
|
2026-06-07 17:06:25 -07:00 |
|
|
Liangsheng Yin
|
f68c79675f
|
Support topk > 1 tree drafting for mamba/hybrid-linear models on spec v2 (#27463)
|
2026-06-07 17:04:09 -07:00 |
|
|
Liangsheng Yin
|
70db73afce
|
[Spec] Clamp multimodal pad sentinels in spec-v2 draft prefill embedding (#27512)
|
2026-06-07 17:00:49 -07:00 |
|
|
Hubert Lu
|
10d33bd77e
|
[AMD] Enable Piecewise CUDA Graph for AMD GPUs (#22299)
|
2026-06-07 16:28:20 -07:00 |
|
|
Mick
|
02be2e7189
|
[diffusion] support tp for ideogram4 (#27393)
|
2026-06-07 23:14:58 +08:00 |
|
|
Lianmin Zheng
|
a07d813ec8
|
Revert "Fix TRTLLM target verify query metadata (#27473)" (#27494)
|
2026-06-07 02:48:52 -07:00 |
|
|
Lianmin ZhengandMing Yang
|
db58e76c33
|
Add all_to_all_single to GroupCoordinator (#27492)
Co-authored-by: Ming Yang <minos.future@gmail.com>
|
2026-06-07 02:48:47 -07:00 |
|
|
Lianmin Zheng
|
5be0b0c8c0
|
Fix TRTLLM target verify query metadata (#27473)
|
2026-06-07 02:46:01 -07:00 |
|
|
fzyzcjy
|
0a190d1c97
|
Fix PP is_fully_idle missing in-flight microbatches (#27446)
|
2026-06-07 17:38:26 +08:00 |
|
|
fzyzcjy
|
14b8f98a21
|
Complete server warmup before scripted runtime scripts start (#27445)
|
2026-06-07 17:37:37 +08:00 |
|
|
Liangsheng Yin
|
eab2e02fa0
|
[spec] Dedup draft kv_indices sizing into spec_utils helpers (#27475)
|
2026-06-07 00:42:29 -07:00 |
|
|
Liangsheng Yin
|
5e2e0d5b49
|
[spec] Make spec_utils module-importable: type-only imports under TYPE_CHECKING (#27484)
|
2026-06-07 00:01:32 -07:00 |
|
|
Xiaoyu Zhang
|
ff8b97406d
|
[diffusion] optimize: precompute ideogram4 denoising metadata (#27443)
|
2026-06-07 14:27:41 +08:00 |
|
|
Liangsheng Yin
|
0ce3db3c0a
|
[Bug] Fix out-of-range token id crashing tp=1 VocabParallelEmbedding (#27482)
|
2026-06-06 23:00:17 -07:00 |
|
|
Liangsheng Yin
|
80eee2d92c
|
[Spec] Guard async-assert probes against None tensor (#27478)
|
2026-06-06 22:14:00 -07:00 |
|
|
|
52a5c01eba
|
[plugin] enable OOT platforms to provide custom quant configs (#25347)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <laldevashish@gmail.com>
|
2026-06-07 12:48:55 +08:00 |
|
|
huangtingwei
|
857ecb2dbc
|
[HiSparse & HiCache]Support mooncake store layer first layout (#27454)
|
2026-06-07 12:46:42 +08:00 |
|
|
Mohammad Miadh AngkadandLianmin Zheng
|
52f221cce0
|
Fix Req array token-id concatenation (#26182)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-06 19:59:51 -07:00 |
|
|
Liangsheng Yin
|
066b4a2180
|
[core] Probe set_kv_buffer / set_mla_kv_buffer slot ids for OOB (#27459)
|
2026-06-06 19:51:09 -07:00 |
|
|
Zhangheng
|
fe548f36b0
|
[UnifiedTree]: Fix SWA admission budget under-counts HiCache load-back consumption (#27391)
|
2026-06-07 10:47:08 +08:00 |
|
|
shuwenn
|
e57323cae9
|
[mem_cache][4/N] refactor: extract MambaTokenToKVPoolAllocator into allocator/ (#27256)
|
2026-06-07 10:46:29 +08:00 |
|
|
Trevor Morris
|
5da265de30
|
[NVIDIA] Fix FP8 gemm performance with fp16 models (MInimax-M2.5) (#22300)
|
2026-06-07 02:45:00 +00:00 |
|
|
Xiaoyu Zhang
|
2c3e84affe
|
[Diffusion] Enable Cosmos3 denoising profiling (#27439)
|
2026-06-07 10:32:28 +08:00 |
|
|
Yueming Yuan
|
4c8a022f38
|
Fix DeepSeek V4 DP reduce scatter when use attention DP + MoE TP (#27191)
|
2026-06-06 18:24:33 -07:00 |
|
|
Liangsheng Yin
|
5160f7914e
|
Fix MLA EAGLE draft CUDA-graph kv_indices under-allocation for topk > 1 (#27460)
|
2026-06-06 16:28:34 -07:00 |
|
|
Liangsheng Yin
|
032c9efb46
|
Enable async-assert invariant probes by default in CI (#27461)
|
2026-06-06 16:23:21 -07:00 |
|
|
Qiaolin Yu
|
4b0f629082
|
[perf] reduce radix cache match overhead by changing the match algorithm (#27364)
|
2026-06-06 15:40:28 -07:00 |
|
|
Liangsheng Yin
|
1c7acba579
|
[spec] Consolidate the per-decode KV alloc reserve into one helper (#27458)
|
2026-06-06 14:58:50 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
9097647090
|
Route the eager forward path through the CUDA graph input-buffer registry (#27407)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-06 14:35:53 -07:00 |
|
|
Liangsheng Yin
|
84ca0ffb8c
|
Spec v2 tree drafting (topk>1) with page_size>1 (#26972)
|
2026-06-06 12:00:27 -07:00 |
|
|
|
88a7b0fd30
|
Classify malformed-multimodal rejects as invalid_request (#27451)
Co-authored-by: cctry <cctry@meta.com>
Co-authored-by: cctry <cctry@fb.com>
|
2026-06-06 10:19:22 -07:00 |
|
|
|
bd7fea0740
|
[diffusion] Fix LingBot-World crash on camera control with ulysses>1 (#27437)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-06 22:02:29 +08:00 |
|
|
Xiaoyu Zhang
|
7c6f9542c7
|
[Diffusion] Avoid GPU syncs in UniPC scheduler (#27440)
|
2026-06-06 22:01:41 +08:00 |
|
|
|
4e14b50c48
|
[NPU]Support torch_npu profiler patch API drift (#26356)
Co-authored-by: leland17 <lileliao@foxmail.com>
Co-authored-by: OmX <omx@oh-my-codex.dev>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-06 16:27:51 +03:00 |
|
|
shuwenn
|
280280ace9
|
[SPEC] fix: import copy module for eagle sampling info clone (#27390)
|
2026-06-06 12:12:46 +00:00 |
|
|
fzyzcjy
|
99cf0a4399
|
Fix flaky test_self_e2e_pd_perturb (#27426)
|
2026-06-06 19:31:08 +08:00 |
|
|
|
42fe025280
|
[HiCache] Fix the compatibility between PP and HiCache (L2). (#27285)
Co-authored-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-06-06 16:57:23 +08:00 |
|
|
Liangsheng Yin
|
aa5213abb1
|
[debug] Register #27338 EAGLE draft kv_indices revert in pr_fix_toggle (#27428)
|
2026-06-06 00:30:13 -07:00 |
|
|
Liangsheng Yin
|
26b9053dcc
|
[Spec] Fix fa3 EAGLE draft-decode expand page_table scatter OOB for topk>1 + page_size>1 (#27360)
|
2026-06-06 00:24:34 -07:00 |
|
|
EduardDurech
|
e9dbbd19e9
|
[model] Apertus Tool/Function and Reasoning parser (#25100)
|
2026-06-06 00:04:31 -07:00 |
|
|
Qiaolin Yu
|
8c47b7678a
|
[attn backend] clean legacy init_mha_chunk_metadata in trtllm_mla backend (#27403)
|
2026-06-05 23:30:21 -07:00 |
|
|
Xiaoyu ZhangandBBuf
|
f57f8a8afd
|
Optimize Gemma4 H200 MoE and extend attention (#26588)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
|
2026-06-06 14:14:25 +08:00 |
|
|
|
e513c13e2e
|
Optimize ngram decode token table update (#24756)
Co-authored-by: Codex <codex@example.com>
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
|
2026-06-06 14:13:45 +08:00 |
|
|
zijiexiaandClaude Opus 4.8
|
9da88e32e0
|
[Cohere2Moe] Enable flashinfer_trtllm NVFP4 fused-MoE via SigmoidRenorm routing (#27401)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-05 22:49:20 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
38ae22e08c
|
Nemotron perf changes (#26733)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-05 22:31:46 -07:00 |
|
|
Yuxuan Zhang
|
393d0e169e
|
[Bugfix] Restore overridden HF config fields and support index_skip_topk_offset for DSA topk sharing (#27114)
|
2026-06-06 13:26:04 +08:00 |
|
|
kkandwunhuang
|
aa55657e9e
|
[AMD][WA] force to use gate_mode interleaved to fix tp2/tp4/tp8 acc issue (#27201)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-06-05 20:18:11 -07:00 |
|
|
Mick
|
bf66b7b6da
|
[diffusion] model: support Ideogram4 NVFP4 (#27379)
|
2026-06-06 11:14:28 +08:00 |
|
|
Mick
|
e8668508d1
|
[diffusion] optimize: optimize LingBot realtime sp cache path (#27383)
|
2026-06-06 09:37:29 +08:00 |
|