 YAMY
|
5ae00ecd48
|
[Disagg][NIXL] Support Mamba state slice transfer for heterogeneous TP (Step 2/2 for Qwen3.5) (#22240)
|
2026-04-07 23:47:31 +08:00 |
|
|
YAMY
|
3148742ddb
|
[Disagg][NIXL] Fix heterogeneous TP KV transfer for non-MLA models (same logic with mooncake, Step 1/2 for Qwen3.5 support) (#22145)
|
2026-04-07 14:52:02 +08:00 |
|
|
YAMYandShangming Cai
|
dc125afffb
|
Add staging buffer CI test and documentation for heterogeneous TP (#21921)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-04-06 14:00:20 +08:00 |
|
|
YAMY
|
821a8a99fb
|
[Disagg] GPU staging buffer with dynamic ring allocator for heterogeneous TP KV transfer (#19890)
|
2026-04-01 14:09:18 -07:00 |
|
|
YAMYandShangming Cai
|
cfead25bbf
|
[Qwen3.5] mamba slice fix (Prefill TP != Decode TP & decode TP size>1) (#20655)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-03-17 19:30:58 +08:00 |
|
|
YAMY
|
08957c88ea
|
[Logging] Fix prefill side logging in pd disagg (#19350)
|
2026-02-25 12:42:18 -08:00 |
|
|
YAMYandShangming Cai
|
f75abb4521
|
[Fix][Qwen3.5] Fix KV cache slice transfer for GQA models with replicated KV heads (#19086)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-02-25 16:26:44 +08:00 |
|
|
YAMY
|
73fe389dd1
|
[Qwen3.5] Raise Exception when radix_cache and extra_buffer are enabled at the same time (#19169)
|
2026-02-25 15:04:37 +08:00 |
|
|
YAMY
|
5995bfec63
|
[Qwen3-Next] Enable fused_qkvzba_split_reshape_cat also for prefill (#18917)
|
2026-02-22 13:57:17 +08:00 |
|
|
YAMY
|
cef353f338
|
[Fix] Quick fix for int32 overflow in Mooncakes' send_kvcache_slice (#19076)
|
2026-02-22 12:00:33 +08:00 |
|
|
YAMY
|
8541b1118d
|
[Fix][Qwen3.5] Pass max_mamba_cache_size to mamba pool in disaggregation decode path (#19002)
|
2026-02-20 14:31:26 +08:00 |
|
|
YAMY
|
454676811e
|
[Flashinfer Autotune] Fix FlashInfer FP4 MoE autotuning crash by removing incorrect flatten on hidden_states_scale (#18500)
|
2026-02-12 13:31:27 +08:00 |
|
|
YAMY
|
a45e0e5df4
|
[SPEC_V2] Enable cudagraph draft_extend for trtllm_mla_backend and Acclen Fix for DP under cudagraph mode (#16974)
|
2026-01-18 15:56:21 +08:00 |
|
|
YAMY
|
daa4841e86
|
[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051)
|
2026-01-16 15:32:42 +08:00 |
|
|
YAMY
|
2740ed1ae7
|
[eval] GSM8k support for run_eval (#17041)
|
2026-01-16 11:10:17 +08:00 |
|
|
YAMY
|
3fd88ea9b5
|
[MTP][spec_v2] Fix TRTLLM MLA backend crash in EAGLE draft_extend mode (#15790)
|
2026-01-10 19:58:23 +08:00 |
|
|
YAMY
|
2d088b85d9
|
[IDLE FORWARD][Indexer] Fix forward_idle bs mismatch issue in DeepseekV3.2's NSAIndexer (#15227)
|
2026-01-10 18:14:30 +08:00 |
|
|
YAMY
|
959343795f
|
[test] update acc len threshold to 2.7 for eagle dp attention tests (#16463)
|
2026-01-06 17:38:35 +08:00 |
|
|
YAMY
|
12cde0df99
|
[SPEC_V2] Fix Acclen drop when enabling DP Attention for Spec-Overlap (#16310)
|
2026-01-05 11:39:23 +08:00 |
|
|
YAMY
|
6014365564
|
[EAGLE] Fix slow Triton compilation in EAGLE KV cache copy by chunking large num_locs_upper (#15111)
|
2025-12-21 14:14:14 +08:00 |
|
|
YAMY
|
c96903074c
|
[NSA] Fix NSA backend assertion error when running DeepSeek-V3.2 PP with radix-cache (#15086)
|
2025-12-14 17:13:18 -08:00 |
|
|
YAMY
|
0e7d7969d5
|
[PP Prefill][NIXL] Fix PP mode transfer completion tracking to wait for all ranks (#15027)
|
2025-12-13 00:55:28 -08:00 |
|
|
YAMY
|
7dfcc78155
|
[DeepseekV3.2][NSA][Indexer] Fix PAGED top-k transform for NSA indexer chunked execution on H200 (#14325)
|
2025-12-04 10:25:03 -08:00 |
|
|
YAMY
|
1f2b84d28d
|
Fix NSA Bug in Centralize NSA Dispatch Logic (#14245)
|
2025-12-01 13:18:18 -08:00 |
|
|
YAMY
|
decb48965d
|
[DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646)
|
2025-11-30 15:59:23 -08:00 |
|
|
YAMYandhlu1
|
5eed5fc0b0
|
[DeepSeekV3.2] Centralize NSA dispatch logic in NativeSparseAttnBackend (#13544)
Co-authored-by: hlu1 <14827759+hlu1@users.noreply.github.com>
|
2025-11-25 11:32:30 -08:00 |
|
|
YAMY
|
98b38de3f2
|
Fix: Safe RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds in EAGLE + Long-Sequence Workloads (#11871)
|
2025-11-25 01:19:06 +08:00 |
|
|
YAMY
|
53fffefd5d
|
Upgrade flashmla kernel for NSA tp support (#13718)
|
2025-11-23 01:36:49 -08:00 |
|
|
YAMY
|
fa92441027
|
[DeepseekV3.2] Deepseek fp8 support for MHA path (#12964)
|
2025-11-20 11:13:36 -08:00 |
|
|
YAMY
|
190002c613
|
[Docs][DeepseekV3.2] Update deepseekv3.2 docs for mha short seq prefill (#12868)
|
2025-11-08 00:11:02 -08:00 |
|
|
YAMY
|
7257525cce
|
[DeepSeek-V3.2][NSA] Enable MHA Pathway for Short Sequence Prefill on B200 (SM100) (#12788)
|
2025-11-06 17:26:08 -08:00 |
|
|
YAMY
|
f235498eca
|
DeepSeek-V3.2: Add Adaptive MHA Attention Pathway for Short-Sequence Prefill (#11892)
|
2025-11-05 19:33:26 -08:00 |
|
|
YAMY
|
c8492978a1
|
Fix Illegal Instruction/IMA errors when using DP attention -- num_tokens_for_logprob calculation (#12115)
|
2025-10-25 12:28:26 -07:00 |
|
|
YAMY
|
80407b0493
|
Fix: Dynamic RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds in EAGLE + Long-Sequence Workloads (#10788)
|
2025-10-19 11:37:43 +08:00 |
|
|
YAMYandXinyuan Tong
|
5a9170d993
|
Optimize copy_kv_cache for spec decoding (#11126)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-10-08 10:43:30 +08:00 |
|
|
|
b045841bae
|
Feature/function calling update (#2700)
Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
|
2025-01-26 09:57:51 -08:00 |
|