 Hanming Lu
|
a5a64a311a
|
[Spec] trtllm mha supports overlap plan stream (#25925)
|
2026-05-23 03:25:57 -07:00 |
|
|
Hanming Lu
|
ddf3817924
|
Revert "[AMD]fix: use CUDA event for targeted draft-to-verify sync in… (#25917)
|
2026-05-20 18:49:01 -07:00 |
|
|
Hanming Lu
|
371b6c9ea0
|
[Scheduler] fix chunked prefill not always being full (#25741)
|
2026-05-20 15:03:11 -07:00 |
|
|
Hanming Lu
|
862d39e06c
|
[Mamba] Fix extra_buffer overlap schedule races (#24954)
|
2026-05-19 12:13:20 +08:00 |
|
|
Hanming Lu
|
afc7c9f7f3
|
[TRTLLM/SWA/Spec] fix trtllm mha + swa + spec accept length drop (#25103)
|
2026-05-15 17:15:31 -07:00 |
|
|
Hanming Lu
|
92f281f856
|
[Spec][trtllm] use decode kernel for draft extend (#24566)
|
2026-05-07 02:25:26 -07:00 |
|
|
Hanming Lu
|
9d5f16d456
|
[SWA] fix swa radix cache match_len_since_tombstone update when hits swa_tombstone (#17061)
|
2026-01-15 11:28:33 +08:00 |
|
|
Hanming Lu
|
5dcff94791
|
[nemetron/mtp] fix nemotron mtp (#16275)
|
2026-01-09 23:22:21 +08:00 |
|
|
Hanming Lu
|
41609b52fe
|
support page size large than 64 for mamba radix cache with fix (#16768)
|
2026-01-09 13:28:37 +08:00 |
|
|
Hanming Lu
|
e61dabf5e4
|
[Qwen3-next] support mamba radix cache for overlap scheduler (#14792)
|
2025-12-14 18:54:16 -08:00 |
|
|
Hanming Lu
|
e592ee6545
|
[Qwen3-next] remove heuristics and add radix cache kl test (#14520)
|
2025-12-06 12:11:40 -08:00 |
|
|
Hanming Lu
|
a0dde90af6
|
[CODEOWNER] update codeowner for qwen3-next related (#14522)
|
2025-12-05 16:15:10 -08:00 |
|
|
Hanming Luandyizhang2077
|
48d6bea1ea
|
[GDN/SWA] mamba and swa radix cache edge case fix (#12111)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-11-04 11:03:37 +08:00 |
|
|
Hanming Lu
|
66fb9b1307
|
[ServerArgs] allow --mamba-ssm-dtype extend (#12481)
|
2025-11-02 11:50:04 -08:00 |
|
|
Hanming Lu
|
97d857c096
|
[Mamba] Increase default mamba_full_memory_ratio to 0.9 (#11679)
|
2025-10-16 09:56:43 +08:00 |
|
|
Hanming LuandYing Sheng
|
9379da77de
|
SWA Prefix Cache (#7367)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
|
2025-07-13 12:31:07 -07:00 |
|