 Jimmy
|
959d1ab84b
|
fix(metrics): double times add_latency for DECODE_BOOTSTRAP (#12209)
|
2025-10-27 23:59:48 +08:00 |
|
|
JimmyandShangming Cai
|
f7ab955455
|
fix(glm45): disable reduce scatter (#11665)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-18 12:19:20 +08:00 |
|
|
Jimmy
|
3713eb6135
|
feat(reasoning): improve enable thinking from request (#10875)
|
2025-09-29 16:59:08 -07:00 |
|
|
Jimmy
|
4b5ef3002c
|
[fix][pd-disag]no need set next batch sampling info done in prefill (#10259)
|
2025-09-24 01:24:36 +08:00 |
|
|
Jimmy
|
56321e9fc2
|
[Router]fix: fix get_load missing api_key (#10385)
|
2025-09-21 15:28:38 -04:00 |
|
|
Jimmy
|
56b991b12d
|
[Feature]feat(get_ip): unify get_ip_xxx (#10081)
|
2025-09-18 22:35:26 -07:00 |
|
|
Jimmy
|
3795b6a43f
|
fix(server_args): Skip chunked_prefill_size validation when disaggregation mode is decode (#10358)
|
2025-09-15 12:13:35 +08:00 |
|
|
Jimmy
|
f40038fb09
|
[Vulnerability]feat(conn): set bootstrap server host (#9931)
|
2025-09-05 17:36:17 +08:00 |
|
|
Jimmy
|
0d9e89ec69
|
[PD]decode: add CLIP_MAX_NEW_TOKEN for pop_preallocated (#8866)
|
2025-08-11 13:08:11 -07:00 |
|