[minor] Remove incorrect note after supporting w4a16 moe for DeepSeek V4 (#24035)
This commit is contained in:
@@ -120,9 +120,6 @@ docker run --gpus all \
|
||||
|
||||
SGLang supports three main serving recipes for DeepSeek-V4 with different latency/throughput trade-offs (`low-latency`, `balanced`, `max-throughput`), plus specialized recipes for long-context (`cp`, prefill context-parallel) and prefill/decode disaggregation (`pd-disagg`). The interactive generator below emits the exact launch command for any `(hardware, variant, recipe)` combination.
|
||||
|
||||
<Note>
|
||||
For H200 GPU deployments, use the SGLang checkpoint under `sgl-project`, not the default DeepSeek checkpoint.
|
||||
</Note>
|
||||
|
||||
### 3.1 Basic Configuration
|
||||
|
||||
|
||||
Reference in New Issue
Block a user