 inkcherryandDuyi-Wang
|
eb9483b5c2
|
[PD][AMD]: incremental KV transfer with decode radix cache (#26288)
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-06-13 00:06:44 -07:00 |
|
|
inkcherryandAlex Nails
|
e5b8e3a66a
|
Optimize streaming detokenizer updates (#24659)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-06-02 23:44:21 -07:00 |
|
|
inkcherry
|
3b2c730320
|
[AMD] Enable dual-stream MoE on ROCm (#24005)
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
|
2026-05-07 02:27:24 -07:00 |
|
|
inkcherry
|
1e34cd0ba5
|
PD streaming: batch notify + SSE fast path (#22658)
|
2026-04-22 02:21:02 -07:00 |
|
|
inkcherry
|
4fa3482180
|
[Bugfix] Add missing http_worker_ipc in session error path (#22766)
|
2026-04-19 12:47:09 -07:00 |
|
|
inkcherry
|
84aaa69795
|
[AMD] Use bfloat16 for correction_bias in AITER FP8 path to avoid runtime dtype conversion for dsv3 (#19843)
|
2026-03-06 00:57:12 -08:00 |
|