Lianmin Zheng 09deb20dee Optimize the memory usage of logits processor (#420)

2024-05-11 16:56:42 -07:00

..

backend

SamplingParams add "spaces_between_special_tokens" argument (#392)

2024-04-30 16:17:12 -07:00

lang

Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380)

2024-05-11 16:37:49 -07:00

srt

Optimize the memory usage of logits processor (#420)

2024-05-11 16:56:42 -07:00

test

Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380)

2024-05-11 16:37:49 -07:00

__init__.py

Make public APIs more standard. (#416)

2024-05-09 15:39:22 +08:00

api.py

Make public APIs more standard. (#416)

2024-05-09 15:39:22 +08:00

global_config.py

SamplingParams add "spaces_between_special_tokens" argument (#392)

2024-04-30 16:17:12 -07:00

launch_server.py

release initial code

2024-01-08 04:37:50 +00:00

utils.py

Fix RuntimeEndpoint (#279)

2024-03-11 05:24:24 -07:00