|
f478b2bb2d
|
Fix: abort handling for dispatched requests after client disconnect (#35255)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: cctry <cctry@fb.com>
|
2026-09-03 21:51:57 -07:00 |
|
|
Shijin ZhangandXinyuan Tong
|
09193bf36f
|
[Fix]: render tool_reference schema regardless of tool_result part order (#32522)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-07-31 13:57:52 +08:00 |
|
|
Shijin Zhang
|
8e54517f02
|
[Feat][GLM5.2] Add DSA Cache Layer Split under Prefill CP (#29421)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
|
2026-07-09 03:03:56 -07:00 |
|
|
Shijin Zhang
|
00e12cebb4
|
[Fix]: Defer DSA MLA CP KV gather for fp8 trtllm prefill in PD mode (#29161)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
|
2026-07-01 00:20:12 -07:00 |
|
|
Shijin Zhang
|
5b76f55d90
|
[Fix]: Inline H2D during CUDA graph capture to avoid stream isolation in Offloader (#29166)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
|
2026-06-30 17:49:58 -07:00 |
|