[CP V1 Deprecation 5/5] Update prefill CP documentation (#36230)

This commit is contained in:
Baizhou Zhang
2026-09-08 19:27:49 -07:00
committed by GitHub
parent 8ab9982851
commit e54ff1efb9
7 changed files with 30 additions and 73 deletions
@@ -254,6 +254,10 @@ For the full setup (streaming, tool-use, count_tokens, persisting env in `~/.cla
### 3.5 Context Parallelism
<Warning>
Zigzag prefill CP (`--cp-strategy zigzag`) is temporarily unavailable for GLM-5.2. For prefill CP on CUDA, use `interleave` with `--dp 1` as shown below.
</Warning>
Prefill context parallelism can help with reduction of TTFT under long context. To enable prefill context parallelism for GLM 5.2, please append the following arguments:
```bash
--attn-cp-size 8 \