Commit Graph
12 Commits
Author SHA1 Message Date
weireweire f9a3720e2b Skip empty non-idle output batches (#28504) 2026-06-26 02:40:01 +08:00
weireweireandweireweire 5f30fa258c Support DP-aware PD router dispatch (#26245)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-06-24 15:02:51 -07:00
weireweireandweireweire 7fd63f4cf2 Remove stale load collection from output streaming hot path (#28408)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-06-17 15:02:20 -07:00
weireweire bf38a0b03d Fix disaggregated decode load token accounting (#25736) 2026-06-15 11:37:41 +08:00
weireweireandZhangheng 034dd39189 Support KV events for UnifiedRadixCache (#26387)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-05-27 22:10:40 +08:00
weireweire 629b6c6a85 correct allreduce fusion and dummy_run alignment in SCATTERED MLP mode (moe_dense_tp_size=1) (#19918) 2026-05-22 19:18:25 -07:00
weireweire 684638e053 Fix prefill batch iter logging under overlap (#20845) 2026-05-07 02:10:42 -07:00
weireweire 9191b02eda Fix cuda graph max bs capture upper bound (#21005) 2026-03-31 15:20:56 -07:00
weireweireandWeiliangl User 4455d17619 [PD] Refactor Disagg Conn and Fix Hang with total_request/total_tokens Balancing (#21299)
Co-authored-by: Weiliangl User <weiliangl@login-node.hosted.internal>
2026-03-31 18:01:50 +08:00
weiliang 6559e43f30 Support FP8 MLA prefill and 128k context. (#14395) 2025-12-19 01:24:00 -08:00
weiliang a18161875c Fix Flashinfer Backend for SM120 Usage (#12325) 2025-10-29 11:51:55 -07:00
weiliang 88596739a4 Support running FP4 Deepseek on SM120. (#11708) 2025-10-27 17:37:49 -07:00