|
6491728797
|
[Perf] Overlap NSA-CP key all-gather with query computation for DeepSeek-V3.2 (#20438)
Co-authored-by: Shurui Jia <18817781975@163.com>
Co-authored-by: Baidu-AIAK <baiduaiak~123>
|
2026-03-23 21:31:48 -07:00 |
|
|
Baidu-AIAKandvincent
|
6851613b93
|
[Bugfix] For cp: Fixed hang problem in prefix cache and kvcache support fp8 in-seq-split mode (#19656)
Co-authored-by: vincent <vincent@vincentdeMacBook-Pro.local>
|
2026-03-03 19:19:46 -08:00 |
|
|
|
922aad2faa
|
Cleanup disagg decode prebuilt flow and add cross-stream sync in merge_batch (#19568)
Co-authored-by: vincent <vincent@vincentdeMacBook-Pro.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-03-01 21:52:27 -08:00 |
|
|
Baidu-AIAKandsunhailiang
|
bc3ca30023
|
[PD] Support fake decode for PD disaggregation without prefill node (#14628)
Co-authored-by: sunhailiang <sunhailiang@baidu.com>
|
2025-12-23 12:43:33 +08:00 |
|
|
Baidu-AIAK
|
9b64f6f359
|
[fix] Fixes accuracy issues caused by incorrect use of rope (#13495)
|
2025-11-18 14:17:33 -08:00 |
|