[docs] fix sglang serve --model-path in cookbooks (#23905)
This commit is contained in:
@@ -55,7 +55,7 @@ DeepSeek-V3.2 supports reasoning mode. Enable the reasoning parser during deploy
|
||||
|
||||
```shell Command
|
||||
sglang serve \
|
||||
--model deepseek-ai/DeepSeek-V3.2-Exp \
|
||||
--model-path deepseek-ai/DeepSeek-V3.2-Exp \
|
||||
--reasoning-parser deepseek-v3 \
|
||||
--tp 8 \
|
||||
--host 0.0.0.0 \
|
||||
@@ -139,7 +139,7 @@ For DeepSeek-V3.2-Exp:
|
||||
|
||||
```shell Command
|
||||
sglang serve \
|
||||
--model deepseek-ai/DeepSeek-V3.2-Exp \
|
||||
--model-path deepseek-ai/DeepSeek-V3.2-Exp \
|
||||
--tool-call-parser deepseekv31 \
|
||||
--reasoning-parser deepseek-v3 \
|
||||
--chat-template ./examples/chat_template/tool_chat_template_deepseekv32.jinja \
|
||||
|
||||
@@ -101,7 +101,7 @@ Deploy GLM-5 with the following command (FP8 on H200, all features enabled):
|
||||
|
||||
```shell Command
|
||||
sglang serve \
|
||||
--model zai-org/GLM-5-FP8 \
|
||||
--model-path zai-org/GLM-5-FP8 \
|
||||
--tp 8 \
|
||||
--tool-call-parser glm47 \
|
||||
--reasoning-parser glm45 \
|
||||
@@ -120,7 +120,7 @@ The following ROCm command is an additional option for AMD GPUs and does not rep
|
||||
|
||||
```shell Command
|
||||
sglang serve \
|
||||
--model zai-org/GLM-5 \
|
||||
--model-path zai-org/GLM-5 \
|
||||
--tp 8 \
|
||||
--trust-remote-code \
|
||||
--nsa-prefill-backend tilelang \
|
||||
|
||||
Reference in New Issue
Block a user