 Ziming Huang
|
997ea57eaf
|
Fix tensor mismatch error in sepc + topk > 1 + page_size > 1 (#14874)
|
2025-12-15 01:10:58 +08:00 |
|
|
Ziming Huang
|
a244c0309c
|
[Fix] Qwen3Next lmhead dtype (#13708)
|
2025-11-21 16:01:33 +08:00 |
|
|
Ziming Huang
|
e8114102fa
|
[Fix] Update text_chunks in bench_serving chat completions (#13041)
|
2025-11-11 11:41:11 -08:00 |
|
|
Ziming Huang
|
5de25f786e
|
[BugFix] Fix prefill memory leak in PD + GDN (#12994)
|
2025-11-12 00:48:07 +08:00 |
|
|
Ziming HuangandShangming Cai
|
6d2d0ce285
|
[PD] Improve eagle acceptance rate by transferring draft model hidden states (#10801)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-20 11:52:18 +08:00 |
|
|
Ziming Huang
|
b73ac629cd
|
[BugFix] Fix incorrect hidden_states_tensor in pd disaggregation + eagle (#9976)
|
2025-09-17 10:37:14 -07:00 |
|
|
Ziming Huang
|
9abe1163ac
|
fix duplicate args in schedule_batch (#7816)
|
2025-07-07 01:31:03 -07:00 |
|