Lianmin Zheng 5e62a6b706 Add bench_server_latency.py (#1452)

2024-09-18 00:56:06 -07:00

..

srt/sampling/penaltylib

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

few_shot_gsm8k.py

Add bench_server_latency.py (#1452)

2024-09-18 00:56:06 -07:00

long_prompt.txt

[Fix] Compatibility of window attention and cuda graph (#1090)

2024-08-14 10:37:01 -07:00

run_eval.py

Fix accuracy test (#1051)

2024-08-12 19:48:40 +10:00

runners.py

[Feature] Initial support for multi-LoRA serving (#1307)

2024-09-12 16:46:14 -07:00

simple_eval_common.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

Add longer accuracy test on CI (#1049)

2024-08-12 09:21:38 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

feat: use gelu_tanh_and_mul (#1193)

2024-08-24 01:58:16 -07:00

test_layernorm.py

feat: update GemmaRMSNorm (#1232)

2024-08-28 22:47:34 +10:00

test_programs.py

[Minor] Many cleanup (#1357)

2024-09-09 04:14:11 -07:00

test_utils.py

Remove deprecated configs (#1431)

2024-09-15 08:52:18 -07:00