[CI] Install sgl-eval from PyPI through the test extra (#37504)
This commit is contained in:
@@ -1,13 +0,0 @@
|
||||
# Single source of truth for the sgl-eval commit every CI variant installs.
|
||||
# Meant to be sourced, not executed -- each variant then installs
|
||||
# "$SGL_EVAL_SPEC" with its own pip invocation, since those differ (uv pip on
|
||||
# CUDA/CPU, `docker exec ... pip` on AMD, `python3 -m pip` on NPU).
|
||||
#
|
||||
# sgl-eval is git-only and cannot be declared in python/pyproject.toml (see the
|
||||
# note there). Every eval that shells out to the `sgl-eval` CLI fails without
|
||||
# it, and a bump moves scoring for all of them at once -- so re-baseline
|
||||
# MODEL_SCORE_THRESHOLDS in
|
||||
# test/registered/eval/test_text_models_gsm8k_eval.py, and the mmlu thresholds
|
||||
# of run_eval's other callers, before changing this.
|
||||
SGL_EVAL_REF="a231b7a439b235090ff7baa30778fa2b514309ae"
|
||||
SGL_EVAL_SPEC="sgl-eval@git+https://github.com/sgl-project/sgl-eval.git@${SGL_EVAL_REF}"
|
||||
Reference in New Issue
Block a user