docs: cookbook benchmark accuracy labels come from the model config (no engine default) (#27842)

Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
zijiexia
2026-06-10 18:27:38 -07:00
committed by GitHub
co-authored by Claude Fable 5
parent 66989a7642
commit 43835b5ba5
5 changed files with 33 additions and 10 deletions
@@ -108,11 +108,20 @@ sgl-eval run gsm8k \\
// OPTIONAL — per-variant accuracy applied to EVERY cell of a variant (hardware-
// independent, e.g. GPQA/AIME). Per-cell `accuracy` overrides. Keys must match
// ACCURACY_LABELS + benchmarkCommands.accuracy. Delete if no numbers yet.
// the effective accuracy labels + benchmarkCommands.accuracy. Delete if no numbers yet.
defaultAccuracy: {
default: { gsm8k_pct: null },
},
// The eval set rendered in the benchmark card + "⚡ Reproduce" — the engine
// ships NO default; required whenever the benchmarks carry accuracy data
// (without it the accuracy rows silently don't render). [key, label, unit]
// tuples; keys must match benchmarks[].accuracy + defaultAccuracy +
// benchmarkCommands.accuracy. Delete only if there are no accuracy numbers.
accuracyLabels: [
["gsm8k_pct", "GSM8K", "%"],
],
// OPTIONAL — `# ...` hint lines prepended to multi-node commands, ONLY for hw
// whose fabric needs manual NIC env (e.g. gb200 NVL72/MNNVL). NOT every multi-N
// hw needs this — standard-IB DeepEP / Marlin multi-node don't. Delete if unused.