Lianmin Zheng 09deb20dee Optimize the memory usage of logits processor (#420)

2024-05-11 16:56:42 -07:00

..

constrained

add .isort.cfg (#378)

2024-04-22 22:38:09 +08:00

layers

Optimize the memory usage of logits processor (#420)

2024-05-11 16:56:42 -07:00

managers

Optimize the memory usage of logits processor (#420)

2024-05-11 16:56:42 -07:00

models

Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380)

2024-05-11 16:37:49 -07:00

backend_config.py

Fix the chat template for llava-v1.6-34b & format code (#177)

2024-02-11 05:50:13 -08:00

conversation.py

Fix chatml template (#406)

2024-04-30 15:53:39 -07:00

hf_transformers_utils.py

Revert removing the unused imports (#385)

2024-04-23 22:36:33 +08:00

memory_pool.py

Minor: style improvement of radix_cache and memory_pool (#395)

2024-04-26 01:01:36 +08:00

mm_utils.py

Handle grayscale images in expand2square (#97)

2024-01-24 16:23:11 -08:00

model_config.py

[model] DBRX-instruct support (#337)

2024-03-28 10:05:19 -07:00

sampling_params.py

SamplingParams add "spaces_between_special_tokens" argument (#392)

2024-04-30 16:17:12 -07:00

server_args.py

Time cost utils (#355)

2024-04-09 23:27:31 +08:00

server.py

Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380)

2024-05-11 16:37:49 -07:00

utils.py

Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380)

2024-05-11 16:37:49 -07:00

weight_utils.py

Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380)

2024-05-11 16:37:49 -07:00