 Xingyu Liu
|
aa06433709
|
Avoid TRTLLM prefill output copy (#33306)
|
2026-08-04 12:54:04 -07:00 |
|
|
Xingyu Liu
|
5e6c37f2b4
|
[cuda_graph] Gate breakable-CG capture_inputs retention to DP-gather paths (#32678)
Signed-off-by: xingyuliu <charlotteliu12x@gmail.com>
|
2026-08-04 02:23:34 -07:00 |
|
|
Xingyu Liu
|
572924634b
|
[mem_cache] Build empty-prefix last_loc sentinel on-device to avoid per-call H2D sync (#32575)
Signed-off-by: xingyuliu <charlotteliu12x@gmail.com>
|
2026-08-03 18:55:03 -07:00 |
|
|
Xingyu Liu
|
578d27e56a
|
[bugfix] Honor cast_x_before_out_mul in RMSNorm.forward_cuda residual path (#25920)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
|
2026-05-28 01:22:46 -07:00 |
|
|
Xingyu Liu
|
770c51b127
|
[Bug] Forward fixed_split_size in SWA / cross-attention paths of FlashInfer backend (#26412)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
|
2026-05-28 00:52:26 -07:00 |
|
|
Xingyu Liu
|
2279b79f35
|
Add --model-config-parser registry for pluggable config formats (#25050)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
|
2026-05-14 01:54:06 -07:00 |
|
|
Xingyu Liu
|
98f38b14df
|
Add registration API for external linear attention backend (#21983)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
|
2026-04-07 02:47:40 -07:00 |
|