[Tiny]Small fixes in deepseek v32 doc (#14372)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
This commit is contained in:
co-authored by
Xinyuan Tong
parent
5bbd83a2c8
commit
7e78825d5a
@@ -76,13 +76,15 @@ python -m sglang.launch_server --model deepseek-ai/DeepSeek-V3.2-Exp --tp 8 --dp
|
|||||||
The usage of function calling and reasoning parser is the same as DeepSeek V3.1. Please refer to [Reasoning Parser](https://docs.sglang.io/advanced_features/separate_reasoning.html) and [Tool Parser](https://docs.sglang.io/advanced_features/tool_parser.html) documents.
|
The usage of function calling and reasoning parser is the same as DeepSeek V3.1. Please refer to [Reasoning Parser](https://docs.sglang.io/advanced_features/separate_reasoning.html) and [Tool Parser](https://docs.sglang.io/advanced_features/tool_parser.html) documents.
|
||||||
|
|
||||||
To launch `DeepSeek-V3.2-Exp` with function calling and reasoning parser:
|
To launch `DeepSeek-V3.2-Exp` with function calling and reasoning parser:
|
||||||
|
> Note: It is recommended to specify the chat-template, ensuring that you are within the sglang's root directory.
|
||||||
```bash
|
```bash
|
||||||
python3 -m sglang.launch_server \
|
python3 -m sglang.launch_server \
|
||||||
--model-path deepseek-ai/DeepSeek-V3.2 \
|
--model-path deepseek-ai/DeepSeek-V3.2-Exp \
|
||||||
--trust-remote-code \
|
--trust-remote-code \
|
||||||
--tp-size 8 --dp-size 8 --enable-dp-attention \
|
--tp-size 8 --dp-size 8 --enable-dp-attention \
|
||||||
--tool-call-parser deepseekv31 \
|
--tool-call-parser deepseekv31 \
|
||||||
--reasoning-parser deepseek-v3
|
--reasoning-parser deepseek-v3 \
|
||||||
|
--chat-template ./examples/chat_template/tool_chat_template_deepseekv32.jinja
|
||||||
```
|
```
|
||||||
|
|
||||||
To launch `DeepSeek-V3.2` with function calling and reasoning parser:
|
To launch `DeepSeek-V3.2` with function calling and reasoning parser:
|
||||||
|
|||||||
Reference in New Issue
Block a user