 fzyzcjy
|
f746e4a608
|
Fix fill_len asymmetric assignment statement in ignore-eos branch (#26999)
|
2026-06-08 14:53:21 +08:00 |
|
|
fzyzcjy
|
9034c2f9ae
|
Fix Req fill_len (fill_ids) having dual semantics by restricting to truncated/committed semantics (#26659)
|
2026-06-08 14:52:48 +08:00 |
|
|
fzyzcjy
|
259a2da3e0
|
Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637)
|
2026-06-08 14:52:18 +08:00 |
|
|
fzyzcjy
|
4201de11de
|
Extract release_req and retract_all as module-level free functions (#26548)
|
2026-06-08 14:51:45 +08:00 |
|
|
fzyzcjy
|
3197808283
|
Avoid calling filter_batch with chunked_req_to_exclude being things unrelated to chunked reqs (#26547)
|
2026-06-08 14:51:21 +08:00 |
|
|
fzyzcjy
|
f5fdf9c5d8
|
Speed up dump comparator percentile computation using numpy (#26874)
|
2026-06-08 14:50:31 +08:00 |
|
|
fzyzcjy
|
995e649190
|
Add parallel-rank dump filenames and pipeline-global layer remapping to dumper (#26850)
|
2026-06-08 14:49:22 +08:00 |
|
|
Han Yu
|
3d2165a286
|
Fix dual-chunk sparse fallback index overflow (#27361)
|
2026-06-07 23:15:37 -07:00 |
|
|
Liangsheng Yin
|
6365d6faee
|
[spec] Misc defensive guards for EAGLE draft KV indexing (#27486)
|
2026-06-07 21:27:46 -07:00 |
|
|
Xiaoyu Zhangandxiaoyu.zhang
|
6c2770149b
|
[diffusion] Fix native text-encoder loading for T5/UMT5 encoder-decoder models (#27432)
Co-authored-by: xiaoyu.zhang <xiaoyu.zhang@radixark.net>
|
2026-06-08 12:23:16 +08:00 |
|
|
Xiaoyu Zhang
|
5bf7dd8e4a
|
Update SGLang diffusion skills (#27496)
|
2026-06-08 12:22:45 +08:00 |
|
|
David Wang
|
bf7fb6b925
|
fix dflash rope config parsing for updated transformers (#27477)
|
2026-06-07 20:52:07 -07:00 |
|
|
kkandwunhuang
|
1c73ff8ad3
|
[AMD] Optimize gpt-oss-120B performance (#27063)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-06-07 20:06:30 -07:00 |
|
|
Cao E
|
2d1856bf45
|
Support encoder_decoder on cpu_graph_runner (#10950)
|
2026-06-08 10:30:11 +08:00 |
|
|
Liangsheng Yin
|
303757ccd8
|
[Attn] Fix aiter MLA verify kv_indices under-alloc + shared assert_buffer_fits guard (#27485)
|
2026-06-07 17:06:25 -07:00 |
|
|
Liangsheng Yin
|
f68c79675f
|
Support topk > 1 tree drafting for mamba/hybrid-linear models on spec v2 (#27463)
|
2026-06-07 17:04:09 -07:00 |
|
|
Liangsheng Yin
|
70db73afce
|
[Spec] Clamp multimodal pad sentinels in spec-v2 draft prefill embedding (#27512)
|
2026-06-07 17:00:49 -07:00 |
|
|
Hubert Lu
|
10d33bd77e
|
[AMD] Enable Piecewise CUDA Graph for AMD GPUs (#22299)
|
2026-06-07 16:28:20 -07:00 |
|
|
Mick
|
02be2e7189
|
[diffusion] support tp for ideogram4 (#27393)
|
2026-06-07 23:14:58 +08:00 |
|
|
Lianmin Zheng
|
a07d813ec8
|
Revert "Fix TRTLLM target verify query metadata (#27473)" (#27494)
|
2026-06-07 02:48:52 -07:00 |
|
|
Lianmin ZhengandMing Yang
|
db58e76c33
|
Add all_to_all_single to GroupCoordinator (#27492)
Co-authored-by: Ming Yang <minos.future@gmail.com>
|
2026-06-07 02:48:47 -07:00 |
|
|
Lianmin Zheng
|
5be0b0c8c0
|
Fix TRTLLM target verify query metadata (#27473)
|
2026-06-07 02:46:01 -07:00 |
|
|
fzyzcjy
|
0a190d1c97
|
Fix PP is_fully_idle missing in-flight microbatches (#27446)
|
2026-06-07 17:38:26 +08:00 |
|
|
fzyzcjy
|
14b8f98a21
|
Complete server warmup before scripted runtime scripts start (#27445)
|
2026-06-07 17:37:37 +08:00 |
|
|
Liangsheng Yin
|
eab2e02fa0
|
[spec] Dedup draft kv_indices sizing into spec_utils helpers (#27475)
|
2026-06-07 00:42:29 -07:00 |
|
|
Liangsheng Yin
|
5e2e0d5b49
|
[spec] Make spec_utils module-importable: type-only imports under TYPE_CHECKING (#27484)
|
2026-06-07 00:01:32 -07:00 |
|
|
Xiaoyu Zhang
|
ff8b97406d
|
[diffusion] optimize: precompute ideogram4 denoising metadata (#27443)
|
2026-06-07 14:27:41 +08:00 |
|
|
Liangsheng Yin
|
0ce3db3c0a
|
[Bug] Fix out-of-range token id crashing tp=1 VocabParallelEmbedding (#27482)
|
2026-06-06 23:00:17 -07:00 |
|
|
Liangsheng Yin
|
80eee2d92c
|
[Spec] Guard async-assert probes against None tensor (#27478)
|
2026-06-06 22:14:00 -07:00 |
|
|
|
52a5c01eba
|
[plugin] enable OOT platforms to provide custom quant configs (#25347)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <laldevashish@gmail.com>
|
2026-06-07 12:48:55 +08:00 |
|
|
huangtingwei
|
857ecb2dbc
|
[HiSparse & HiCache]Support mooncake store layer first layout (#27454)
|
2026-06-07 12:46:42 +08:00 |
|
|
Mohammad Miadh AngkadandLianmin Zheng
|
52f221cce0
|
Fix Req array token-id concatenation (#26182)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-06 19:59:51 -07:00 |
|
|
Liangsheng Yin
|
066b4a2180
|
[core] Probe set_kv_buffer / set_mla_kv_buffer slot ids for OOB (#27459)
|
2026-06-06 19:51:09 -07:00 |
|
|
Zhangheng
|
fe548f36b0
|
[UnifiedTree]: Fix SWA admission budget under-counts HiCache load-back consumption (#27391)
|
2026-06-07 10:47:08 +08:00 |
|
|
shuwenn
|
e57323cae9
|
[mem_cache][4/N] refactor: extract MambaTokenToKVPoolAllocator into allocator/ (#27256)
|
2026-06-07 10:46:29 +08:00 |
|
|
Trevor Morris
|
5da265de30
|
[NVIDIA] Fix FP8 gemm performance with fp16 models (MInimax-M2.5) (#22300)
|
2026-06-07 02:45:00 +00:00 |
|
|
Xiaoyu Zhang
|
2c3e84affe
|
[Diffusion] Enable Cosmos3 denoising profiling (#27439)
|
2026-06-07 10:32:28 +08:00 |
|
|
Yueming Yuan
|
4c8a022f38
|
Fix DeepSeek V4 DP reduce scatter when use attention DP + MoE TP (#27191)
|
2026-06-06 18:24:33 -07:00 |
|
|
Liangsheng Yin
|
5160f7914e
|
Fix MLA EAGLE draft CUDA-graph kv_indices under-allocation for topk > 1 (#27460)
|
2026-06-06 16:28:34 -07:00 |
|
|
Liangsheng Yin
|
032c9efb46
|
Enable async-assert invariant probes by default in CI (#27461)
|
2026-06-06 16:23:21 -07:00 |
|
|
Qiaolin Yu
|
4b0f629082
|
[perf] reduce radix cache match overhead by changing the match algorithm (#27364)
|
2026-06-06 15:40:28 -07:00 |
|
|
Liangsheng Yin
|
1c7acba579
|
[spec] Consolidate the per-decode KV alloc reserve into one helper (#27458)
|
2026-06-06 14:58:50 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
9097647090
|
Route the eager forward path through the CUDA graph input-buffer registry (#27407)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-06 14:35:53 -07:00 |
|
|
Liangsheng Yin
|
84ca0ffb8c
|
Spec v2 tree drafting (topk>1) with page_size>1 (#26972)
|
2026-06-06 12:00:27 -07:00 |
|
|
|
88a7b0fd30
|
Classify malformed-multimodal rejects as invalid_request (#27451)
Co-authored-by: cctry <cctry@meta.com>
Co-authored-by: cctry <cctry@fb.com>
|
2026-06-06 10:19:22 -07:00 |
|
|
|
bd7fea0740
|
[diffusion] Fix LingBot-World crash on camera control with ulysses>1 (#27437)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-06 22:02:29 +08:00 |
|
|
Xiaoyu Zhang
|
7c6f9542c7
|
[Diffusion] Avoid GPU syncs in UniPC scheduler (#27440)
|
2026-06-06 22:01:41 +08:00 |
|
|
|
4e14b50c48
|
[NPU]Support torch_npu profiler patch API drift (#26356)
Co-authored-by: leland17 <lileliao@foxmail.com>
Co-authored-by: OmX <omx@oh-my-codex.dev>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-06 16:27:51 +03:00 |
|
|
shuwenn
|
280280ace9
|
[SPEC] fix: import copy module for eagle sampling info clone (#27390)
|
2026-06-06 12:12:46 +00:00 |
|
|
fzyzcjy
|
99cf0a4399
|
Fix flaky test_self_e2e_pd_perturb (#27426)
|
2026-06-06 19:31:08 +08:00 |
|