Lianmin Zheng f6af3a6561 Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

..

srt/sampling/penaltylib

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

long_prompt.txt

[Fix] Compatibility of window attention and cuda graph (#1090)

2024-08-14 10:37:01 -07:00

run_eval.py

Fix accuracy test (#1051)

2024-08-12 19:48:40 +10:00

runners.py

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

simple_eval_common.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

Add longer accuracy test on CI (#1049)

2024-08-12 09:21:38 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

feat: use gelu_tanh_and_mul (#1193)

2024-08-24 01:58:16 -07:00

test_layernorm.py

feat: use FlashInfer rmsnorm and silu (#907)

2024-08-11 14:57:13 +10:00

test_programs.py

Support stop_token_ids in sglang API (#1092)

2024-08-15 00:31:39 +00:00

test_utils.py

Fix duplicated imports in hf_transformers_utils.py (#1141)

2024-08-17 18:03:00 -07:00