minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[AMD] Update v4 amd cookbook 0830 (#37092)

Browse Source
This commit is contained in:
Thomas Wang
2026-08-29 23:55:28 -07:00
committed by GitHub
parent 512df615de
commit 7399c2b558
2 changed files with 34 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/cookbook/autoregressive/DeepSeek/DeepSeek-V4.mdx
+4 -4
View File
@@ -52,11 +52,11 @@ docker run --gpus all \
AMD uses the daily-updated `lmsysorg/sglang-rocm` images. You can find the latest images on [Docker Hub](https://hub.docker.com/r/lmsysorg/sglang-rocm/tags). We recommend the ROCm 7.2 version.
For example:
- **MI355X** → `lmsysorg/sglang-rocm:v0.5.18-rocm720-mi35x-20260828`
- **MI300X** → `lmsysorg/sglang-rocm:v0.5.18-rocm720-mi30x-20260828`
- **MI355X** → `lmsysorg/sglang-rocm:v0.5.18-rocm720-mi35x-20260829`
- **MI300X** → `lmsysorg/sglang-rocm:v0.5.18-rocm720-mi30x-20260829`
```bash Command
docker pull lmsysorg/sglang-rocm:v0.5.18-rocm720-{mi35x,mi30x}-20260828
docker pull lmsysorg/sglang-rocm:v0.5.18-rocm720-{mi35x,mi30x}-20260829
docker run \
--device=/dev/kfd --device=/dev/dri \
@@ -66,7 +66,7 @@ docker run \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<your-hf-token>" \
lmsysorg/sglang-rocm:v0.5.18-rocm720-{mi35x,mi30x}-20260828 \
lmsysorg/sglang-rocm:v0.5.18-rocm720-{mi35x,mi30x}-20260829 \
sglang serve <use args below>
```