[CI] Install sgl-eval from PyPI through the test extra (#37504)

This commit is contained in:
Liangsheng Yin
2026-09-02 01:45:25 -07:00
committed by GitHub
parent fe3d4b9bbb
commit ebfd8c60e5
32 changed files with 52 additions and 80 deletions
@@ -849,7 +849,7 @@ Results on AIME 2025 (8×B200), evaluated with [sgl-eval](https://github.com/sgl
**Reproduction.** Install [sgl-eval](https://github.com/sgl-project/sgl-eval), launch the server with the tool-call and reasoning parsers, then run `sgl-eval run`. The AIME 2025 dataset ships with sgl-eval, and thinking is on by default for it:
```bash Command
pip install git+https://github.com/sgl-project/sgl-eval.git
pip install sgl-eval
sgl-eval run aime25 \
--base-url http://localhost:30000/v1 \
@@ -1455,7 +1455,7 @@ Median ITL (ms): 15.11
Reproduce against a running server (`--base-url` points at your endpoint):
```bash Command
pip install git+https://github.com/sgl-project/sgl-eval
pip install sgl-eval
# Sanity-check the endpoint
sgl-eval ping --base-url http://localhost:30000/v1
@@ -497,7 +497,7 @@ This section uses **industry-standard configurations** for comparable benchmark
- Prompt: `eval/aai/mcq-4choices` (4-choice multiple choice, matching [Artificial Analysis methodology](https://artificialanalysis.ai/methodology/intelligence-benchmarking)) -- sgl-eval's default for this benchmark
- Evaluation command:
```bash Command
pip install git+https://github.com/sgl-project/sgl-eval.git
pip install sgl-eval
sgl-eval run gpqa \
--base-url http://localhost:30000/v1 \
@@ -628,7 +628,7 @@ python tool_calls_eval.py tool-calls/samples.jsonl \
**Evaluation Command:**
```shell Command
pip install git+https://github.com/sgl-project/sgl-eval.git
pip install sgl-eval
# The dataset ships with sgl-eval; --n-repeats runs all 32 samples per problem.
sgl-eval run aime25 \