minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[diffusion] chore: use native ernie prompt enhancer (#34951)

Browse Source
This commit is contained in:
Mick
2026-08-16 09:59:51 +08:00
committed by GitHub
parent 19e3bd6391
commit d106e8b23a
6 changed files with 336 additions and 45 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/cookbook/diffusion/Ernie-Image/Ernie-Image.mdx
+1 -1
View File
@@ -77,5 +77,5 @@ with open("ernie_image.png", "wb") as f:
- ERNIE-Image is a text-to-image pipeline; do not pass `--image-path`.
- `--performance-mode auto` keeps conservative defaults while preserving explicit user flags.
- If the checkpoint includes a PE component, SGLang loads it automatically from `model_index.json`.
- If the checkpoint includes a PE component, SGLang loads it automatically with the native Ministral3 runtime. Use `--layerwise-offload-components pe` when the local PE decoder needs to trade latency for lower GPU memory usage.
- Treat FSDP, SP/Ulysses/Ring, and TP as explicit benchmark knobs. Measure the target resolution, step count, and GPU type before making them production defaults.