Ying Sheng f6bfe3aaff Release 0.1.11 (#134)

2024-02-03 02:50:13 -08:00

..

backend

Improve docs & Add JSON decode example (#121)

2024-01-30 05:45:27 -08:00

lang

fix bug of race condition in copy()

2024-02-03 01:38:00 -08:00

srt

Add max_prefill_num_token into server arguments (#133)

2024-02-03 02:35:54 -08:00

test

format code

2024-01-30 16:36:10 +00:00

__init__.py

Release 0.1.11 (#134)

2024-02-03 02:50:13 -08:00

api.py

support speculative execution for openai API (#48)

2024-01-25 01:57:06 -08:00

global_config.py

release initial code

2024-01-08 04:37:50 +00:00

launch_server.py

release initial code

2024-01-08 04:37:50 +00:00

utils.py

Improve Chinese character streaming when the last char is half Chinese word. (#95)

2024-01-24 12:23:27 -08:00