minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Diffusion][NPU] Disaggregation diffusion stages support for NPU (#25895)

Browse Source 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
This commit is contained in:
Makcum888e
2026-05-25 13:51:25 +03:00
committed by GitHub
co-authored by ronnie_zheng
parent 3e67398a96
commit 0801cc05ed
5 changed files with 84 additions and 38 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs_new/docs/hardware-platforms/ascend-npus/diffusion/disaggregation.mdx
+33
View File
@@ -0,0 +1,33 @@
---
title: "Disaggregation of Diffusion Pipeline on Ascend NPU"
---
## Quick Start
Please follow the [NPU installation guide](../ascend_npu.mdx) first.
Then install Mooncake from sources.
```bash
git clone https://github.com/kvcache-ai/Mooncake.git
cd Mooncake
git checkout v0.3.10.post2
bash dependencies.sh
mkdir build
cd build
export GLOG_logtostderr=1
cmake -DUSE_ASCEND_DIRECT=ON ..
make -j
make install
cd ../mooncake-wheel/
pip install .
```
Before run servers ensure that *.so files of mooncake in LD_LIBRARY_PATH
```bash
export LD_LIBRARY_PATH=/usr/local/python3.11.14/lib/python3.11/site-packages/mooncake:$LD_LIBRARY_PATH
```
## Examples
For usage examples please follow the [main disaggregation guide](../../../sglang-diffusion/disaggregation.mdx)