Lianmin Zheng eb1ae6ae0c Add sglang.bench_latency for offline benchmark (#564)

2024-06-25 03:38:04 -07:00

..

lang

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00

srt

Add sglang.bench_latency for offline benchmark (#564)

2024-06-25 03:38:04 -07:00

__init__.py

Fix issue #367 – System message not supported for Anthropic (anthropic.BadRequestError) (#368)

2024-04-16 11:18:24 -07:00

killall_sglang.sh

Fix logit processor bugs (#427)

2024-05-12 04:54:07 -07:00