feat(cookbook): MTP --max-running-requests callout + skill sync (#28340)

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
zijiexia
2026-06-15 15:53:01 -07:00
committed by GitHub
co-authored by Claude Opus 4.8
parent 4c0457f440
commit 7221be2cec
5 changed files with 107 additions and 37 deletions
+31 -20
View File
@@ -42,15 +42,22 @@ your dispatch prompt, or ask for it.
(the recipe was measured with it, and fp8 KV halves KV memory —
stripping could OOM it). See dimension-mapping.md §2 caveats.
2. **Never invent versions or numbers.** Benchmark numbers only from the
legacy page's measured blocks. **Speed measurements migrate ONLY when the
legacy page pins an exact, reproducible build** (a release tag or a commit
hash) — drifting strings like "main branch" are no version anchor: drop the
speed numbers AND the entry's `sglang_version`, keep accuracy (far less
build-sensitive) and `benchmarkCommands` so ⚡Reproduce guides
re-measurement against a pinned release; confirm ambiguous strings (e.g.
"0.5.8+") with the maintainer. When kept, `sglang_version` is the legacy
page's string verbatim. Docker tags only the ones the legacy page pinned
(unmapped hw falls back to `:dev`).
legacy page's measured blocks, and a result migrates ONLY when its
`sglang_version` is a **reproducible anchor** — the bar is reproducibility,
not "must be a release":
- ✅ release tag/version (`v0.5.9` / `0.5.9`), commit hash, OR — for
**Day-0 support** (the enabling PR isn't merged and no release is cut
yet) — a specific **PR (`PR #27944`) or commit** you can `gh pr checkout`
/ `git checkout <sha>`. Commit is most precise; a PR pin is fine for day-0.
- ❌ a moving ref — `"main branch"`, `"main (2026-06-11)"`, open-ended
`"0.5.8+"` — is NOT reproducible: **drop the WHOLE result (speed AND
accuracy)**, not just speed. Keep `benchmarkCommands` so ⚡Reproduce still
guides re-measurement against a pinned build.
**Never inherit cross-model numbers** — measurements the legacy page
attributes to a *different model* (e.g. a K2.6 page carrying K2.5-measured
speed) are dropped regardless of version. When kept, `sglang_version` is the
legacy page's string verbatim. Docker tags only the ones the legacy page
pinned (unmapped hw falls back to `:dev`).
3. **Verified policy (strictest tier).** `verified: true` ONLY when (a) the
legacy page has concrete measured data for that exact 5-dim combo AND
(b) the cell's flags equal the deployment command used for that measurement
@@ -64,11 +71,14 @@ your dispatch prompt, or ask for it.
them in the PR body for the re-verification track.
4. **Engines are read-only.** `_deployment.jsx` / `_playground.jsx` must not
change in a migration PR. Model-specific features are config DATA consumed
by generic axis handlers (MegaMoE precedent), so they need NO engine
change — only a genuinely new control *shape* does, and then as a one-time
generic primitive (never a model-named handler) on a separate prior PR
(engine-axis.md). KV Cache DType / mamba-cache select trigger this once for
the whole round; afterwards both are config.
by generic axis handlers (MegaMoE precedent), so they need NO engine change.
A **titled single-select that strips a flag family** — KV Cache DType
(`--kv-cache-dtype`), mamba (`--mamba-scheduler-strategy`), … — is already
covered by the merged generic **`flagSelects`** axis: declare it in the
config (a list of `{ id, title, stripPrefixes, options }`; see the Qwen3.5
mamba example), **no engine PR**. Only a genuinely new control *shape* that
`flagSelects` can't express would need a one-time generic primitive (never a
model-named handler) on a separate prior PR (engine-axis.md).
5. **`github.cookbookModel` must be set** (`<hf-org>/<page-slug>`, e.g.
`qwen/qwen3.5`) and the block never pruned — without it Submit ↗ mislabels
as deepseek-v4. The issue template itself needs NO edits (free-form input).
@@ -117,12 +127,13 @@ Playground-only (DSv4 convention). **Every legacy control survives as an
interactive control** — a dimension or a Playground axis, never a tips-only
mention — and a model-specific control is **config data, not engine code**
(MegaMoE W4A4 is all DSv4 config on the existing `moe` axis). It's pure
config whenever it fits an existing axis's data schema. Only a genuinely new
*shape* (Nemotron3's "KV Cache DType" — a titled single-select stripping a
flag family no axis manages) needs the engine, and then as a ONE-TIME
generic config-parameterized primitive (never a model-named handler) on a
separate PRIOR engine PR, keeping the migration PR data-only (hard rule 4,
engine-axis.md). The strategy count follows the page's
config whenever it fits an existing axis's data schema. A **titled
single-select that strips a flag family** (Nemotron3's "KV Cache DType",
mamba `--mamba-scheduler-strategy`, …) fits the merged generic **`flagSelects`**
axis — so it too is config-only (declare a `flagSelects` list). Only a control
whose *shape* `flagSelects` still can't express would need a ONE-TIME generic
primitive (never a model-named handler) on a separate PRIOR engine PR, keeping
the migration PR data-only (hard rule 4, engine-axis.md). The strategy count follows the page's
operating points: **one recipe → a single `balanced`; two → `low-latency` +
`high-throughput`; three → the full trio (the ideal)**. The tiers apply per
(hw × variant × quant) combination — a single-recipe combination on a