minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Point Ling-3.0-flash-VL cookbook install section at the model image (#38539)

Browse Source
This commit is contained in:
Xinyuan Tong
2026-09-08 10:51:33 -07:00
committed by GitHub
parent 30e7a3072d
commit afe90a8bc9
1 changed files with 11 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/cookbook/autoregressive/InclusionAI/Ling-3.0-flash-VL.mdx
+11 -2
View File
@@ -22,14 +22,23 @@ pip install uv
uv pip install --prerelease=allow sglang uv pip install --prerelease=allow sglang
``` ```
Then run the **Python** output of the command panel below in that environment. Then run the **Python** output of the command panel below in that environment. Ling-3.0-flash-VL support requires sglang with sgl-project/sglang#38526 (or newer); until it merges, install directly from the PR head:
```bash Command
pip install --upgrade pip
pip install uv
uv pip install "sglang @ git+https://github.com/sgl-project/sglang.git@refs/pull/38526/head#subdirectory=python"
uv pip install torchcodec==0.16.0 # optional, preferred video-decode backend
```
Video input needs `decord` or `torchcodec` in the environment; audio is not supported. Downloading the checkpoint requires `HF_TOKEN`.
</Tab> </Tab>
<Tab title="Docker"> <Tab title="Docker">
```bash Command ```bash Command
docker pull lmsysorg/sglang:dev docker pull lmsysorg/sglang:dev-Ling-3.0-flash-VL
``` ```
For how to launch the image, see [Install → Method 3: Using Docker](../../../docs/get-started/install#method-3-using-docker). Substitute the inner `sglang serve ...` with what the command generator below produces. For how to launch the image, see [Install → Method 3: Using Docker](../../../docs/get-started/install#method-3-using-docker). Substitute the inner `sglang serve ...` with what the command generator below produces.