4 Commits
Author SHA1 Message Date
rainredandlzhang d6aeb9fa15 [Feature] Add a function to convert sampling_params to kwargs (#1170)
Co-authored-by: lzhang <zhanglei@modelbest.cn>
2024-08-21 14:28:35 -07:00
rainredandlzhang 616b59f384 [Feature] modify Runtime to support skip_tokenizer_init (#1088)
Co-authored-by: lzhang <zhanglei@modelbest.cn>
2024-08-14 00:28:04 -07:00
rainredandlzhang 95f5fbf1a7 Fix create_abort_task, GenerateReqInput does not have rids. (#1079)
Co-authored-by: lzhang <zhanglei@modelbest.cn>
2024-08-13 12:47:22 +00:00
gryffindor-rrandlzhang 9cf0a5bada Add skip_tokenizer_init args. (#959)
Co-authored-by: lzhang <zhanglei@modelbest.cn>
2024-08-09 12:14:13 -07:00