Commit Graph
10 Commits
Author SHA1 Message Date
Xingyu Liu 8874c51a96 [Benchmark] Add an opt-out for the token-capacity check (#39284) 2026-09-14 17:17:12 -07:00
8b596c10b0 [PD] Diversify fake-prefill handoff tokens (#37302)
Co-authored-by: xingyuliu <xingyuliu@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-09-01 18:34:38 -07:00
Xingyu Liuandxingyuliu 7dcaf11987 [Fix] Select custom all-reduce v2 by topology capability (#35061)
Co-authored-by: xingyuliu <xingyuliu@fb.com>
2026-08-18 10:30:10 -07:00
Xingyu Liu aa06433709 Avoid TRTLLM prefill output copy (#33306) 2026-08-04 12:54:04 -07:00
Xingyu Liu 5e6c37f2b4 [cuda_graph] Gate breakable-CG capture_inputs retention to DP-gather paths (#32678)
Signed-off-by: xingyuliu <charlotteliu12x@gmail.com>
2026-08-04 02:23:34 -07:00
Xingyu Liu 572924634b [mem_cache] Build empty-prefix last_loc sentinel on-device to avoid per-call H2D sync (#32575)
Signed-off-by: xingyuliu <charlotteliu12x@gmail.com>
2026-08-03 18:55:03 -07:00
Xingyu Liu 578d27e56a [bugfix] Honor cast_x_before_out_mul in RMSNorm.forward_cuda residual path (#25920)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
2026-05-28 01:22:46 -07:00
Xingyu Liu 770c51b127 [Bug] Forward fixed_split_size in SWA / cross-attention paths of FlashInfer backend (#26412)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
2026-05-28 00:52:26 -07:00
Xingyu Liu 2279b79f35 Add --model-config-parser registry for pluggable config formats (#25050)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
2026-05-14 01:54:06 -07:00
Xingyu Liu 98f38b14df Add registration API for external linear attention backend (#21983)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
2026-04-07 02:47:40 -07:00