[CP V1 Deprecation 5/5] Update prefill CP documentation (#36230)
This commit is contained in:
@@ -254,6 +254,10 @@ For the full setup (streaming, tool-use, count_tokens, persisting env in `~/.cla
|
||||
|
||||
### 3.5 Context Parallelism
|
||||
|
||||
<Warning>
|
||||
Zigzag prefill CP (`--cp-strategy zigzag`) is temporarily unavailable for GLM-5.2. For prefill CP on CUDA, use `interleave` with `--dp 1` as shown below.
|
||||
</Warning>
|
||||
|
||||
Prefill context parallelism can help with reduction of TTFT under long context. To enable prefill context parallelism for GLM 5.2, please append the following arguments:
|
||||
```bash
|
||||
--attn-cp-size 8 \
|
||||
|
||||
Reference in New Issue
Block a user