Ying Sheng 9ce89bc14b Update benchmark script (#571)

2024-06-28 00:44:22 -07:00

..

backend

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00

lang

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00

srt

Expose dtype argument (#569)

2024-06-27 23:30:39 -07:00

test

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00

__init__.py

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00

api.py

[Minor] Correct Optional type hints in api (#526)

2024-06-11 16:37:27 -07:00

bench_latency.py

Update benchmark script (#571)

2024-06-28 00:44:22 -07:00

global_config.py

Fix dependency & crash issues (#539)

2024-06-12 21:23:19 -07:00

launch_server_llavavid.py

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00

launch_server.py

Multi-node Tensor Parallelism (#550)

2024-06-17 20:41:24 -07:00

utils.py

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00