minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Docs] Add NVFP4 quantization to GLM-5.2 cookbook (#29380)

Browse Source 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
zijiexia
2026-06-26 00:40:13 -07:00
committed by GitHub
co-authored by Claude Opus 4.8
parent 5996b54bd3
commit dd56a9f069
8 changed files with 112 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.claude/skills/cookbook-add-model/templates/config.jsx.tmpl
+6 -4
View File
@@ -140,10 +140,12 @@ sgl-eval run gsm8k \\
],
},
// Per-hw image for `docker run` framing. ASK the user which sglang build the recipes ran
// on; don't guess a supporting release. Default below is :dev (nightly) — replace the tag
// with the user's release if they give one. NVIDIA share one image; AMD uses ROCm tags.
// GB200/GB300/B300 may need a `-cu130` (CUDA 13) tag — confirm per release.
// Image for `docker run` framing, keyed by `hw` (or `hw|quant`, resolved first, when one
// quant on a shared GPU needs its own image — e.g. an FP4 dev build while FP8/BF16 use the
// release tag). ASK the user which sglang build the recipes ran on; don't guess a supporting
// release. Default below is :dev (nightly) — replace the tag with the user's release if they
// give one. NVIDIA share one image; AMD uses ROCm tags. GB200/GB300/B300 may need a
// `-cu130` (CUDA 13) tag — confirm per release.
dockerImages: {
h100: "lmsysorg/sglang:dev",
h200: "lmsysorg/sglang:dev",