[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

Co-authored-by: Mingyi <wisclmy0611@gmail.com>
This commit is contained in:
zijiexia
2026-04-21 00:15:17 -07:00
committed by GitHub
co-authored by Mingyi
parent f63def8510
commit 900aad5f72
179 changed files with 16014 additions and 8162 deletions
@@ -1,23 +1,21 @@
---
title: "Use Models From ModelScope"
---
To use a model from [ModelScope](https://www.modelscope.cn), set the environment variable `SGLANG_USE_MODELSCOPE`.
<CodeGroup>
```bash Set Environment Variable
export SGLANG_USE_MODELSCOPE=true
```
</CodeGroup>
We take [Qwen2-7B-Instruct](https://www.modelscope.cn/models/qwen/qwen2-7b-instruct) as an example.
## Launch the Server
<CodeGroup>
Launch the Server:
```bash Python
python -m sglang.launch_server --model-path qwen/Qwen2-7B-Instruct --port 30000
```
Or start it by docker:
```bash Docker
docker run --gpus all \
-p 30000:30000 \
@@ -27,6 +25,5 @@ docker run --gpus all \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server --model-path Qwen/Qwen2.5-7B-Instruct --host 0.0.0.0 --port 30000
```
</CodeGroup>
<Note>ModelScope uses a different cache directory than Hugging Face. You may need to set it manually to avoid running out of disk space.</Note>
Note that modelscope uses a different cache directory than huggingface. You may need to set it manually to avoid running out of disk space.