minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Clean GLM-5.2 NVFP4 cookbook (#33935)

Browse Source 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
This commit is contained in:
Brayden Zhong
2026-08-07 11:51:34 +08:00
committed by GitHub
co-authored by Brayden Zhong
parent 453ea21dd3
commit 0c3a76fa0a
1 changed files with 0 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/src/snippets/configs/zai-org/glm-5.2.jsx
-4
View File
@@ -763,8 +763,6 @@ sgl-eval run aime25 \\
"--speculative-num-draft-tokens 6", "--speculative-num-draft-tokens 6",
"--chunked-prefill-size 8192", "--chunked-prefill-size 8192",
"--mem-fraction-static 0.85", "--mem-fraction-static 0.85",
"--kv-cache-dtype fp8_e4m3",
"--bf16-gemm-backend cutedsl",
"--max-running-requests 16", "--max-running-requests 16",
"--cuda-graph-max-bs 16", "--cuda-graph-max-bs 16",
"--max-prefill-tokens 8192", "--max-prefill-tokens 8192",
@@ -830,8 +828,6 @@ sgl-eval run aime25 \\
"--speculative-num-draft-tokens 6", "--speculative-num-draft-tokens 6",
"--chunked-prefill-size 8192", "--chunked-prefill-size 8192",
"--mem-fraction-static 0.85", "--mem-fraction-static 0.85",
"--kv-cache-dtype fp8_e4m3",
"--bf16-gemm-backend cutedsl",
"--max-running-requests 16", "--max-running-requests 16",
"--cuda-graph-max-bs 16", "--cuda-graph-max-bs 16",
"--max-prefill-tokens 8192", "--max-prefill-tokens 8192",