12 Commits
Author SHA1 Message Date
yichuan~ 5ff25cdf5b [Minor] add delete test and delete tmp file on ci server (#1227) 2024-08-26 22:04:52 -07:00
b997a18d74 [Feat]Add support for optional start len of logprobs (#1035)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2024-08-18 23:45:41 -07:00
yichuan~andYing Sheng 3a79613c28 support more optioin about usage in stream mode (#985)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
2024-08-08 09:41:57 +00:00
yichuan~ 5f6fa04a3f misc: simplify test (#964) 2024-08-07 01:23:27 -07:00
yichuan~ 795eab6dda Add support for Batch API test (#936) 2024-08-06 23:52:10 -07:00
yichuan~ ffb15744b5 Support multiple args options (#941) 2024-08-06 04:12:53 +10:00
yichuan~ fd7926e46e Fix prompt len in parallel sampling (#928) 2024-08-05 00:56:08 -07:00
yichuan~ d53dcf9c98 Support more OpenAI API test (#916) 2024-08-04 16:43:09 -07:00
yichuan~ ca600e8cd6 Add support for logprobs in OpenAI chat API (#852) 2024-08-01 00:08:21 -07:00
yichuan~ bb0501c0d9 Fix List input bug (#838) 2024-07-30 13:40:51 -07:00
yichuan~andhnyls2002 084fa54d37 Add support for OpenAI API : offline batch(file) processing (#699)
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
2024-07-29 13:07:18 -07:00
yichuan~ 49c5e0eca9 Add support for OpenAI API parallel sampling (#640) 2024-07-19 23:10:01 -07:00