From ba8e60135893018838394d7d344e53e15f7533b3 Mon Sep 17 00:00:00 2001 From: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com> Date: Thu, 20 Aug 2026 16:39:39 -0700 Subject: [PATCH] [docs] fix note formatting in sglang-d documentation (#35761) --- docs/docs/sglang-diffusion/api/openai_api.mdx | 16 +++++++++------- .../sglang-diffusion/deployment_cookbook.mdx | 5 +++-- 2 files changed, 12 insertions(+), 9 deletions(-) diff --git a/docs/docs/sglang-diffusion/api/openai_api.mdx b/docs/docs/sglang-diffusion/api/openai_api.mdx index 069b4bfbd..0638d2b26 100644 --- a/docs/docs/sglang-diffusion/api/openai_api.mdx +++ b/docs/docs/sglang-diffusion/api/openai_api.mdx @@ -369,19 +369,21 @@ curl -X POST http://localhost:30010/v1/set_lora \ }' ``` -> [!NOTE] -> When using multiple LoRAs: -> - All list parameters (`lora_nickname`, `lora_path`, `target`, `strength`) must have the same length -> - If `target` or `strength` is a single value, it will be applied to all LoRAs -> - Multiple LoRAs applied to the same target are applied in order + +When using multiple LoRAs: +- All list parameters (`lora_nickname`, `lora_path`, `target`, `strength`) must have the same length +- If `target` or `strength` is a single value, it will be applied to all LoRAs +- Multiple LoRAs applied to the same target are applied in order + **Merge LoRA Weights** Manually merges the currently set LoRA weights into the base model. -> [!NOTE] -> With FSDP-sharded weights, manual merge may require a full-gather and can OOM. Use `set_lora` with `merge_mode="auto"` or `"dynamic"` for the lower-peak path. + +With FSDP-sharded weights, manual merge may require a full-gather and can OOM. Use `set_lora` with `merge_mode="auto"` or `"dynamic"` for the lower-peak path. + **Endpoint:** `POST /v1/merge_lora_weights` diff --git a/docs/docs/sglang-diffusion/deployment_cookbook.mdx b/docs/docs/sglang-diffusion/deployment_cookbook.mdx index 624ea1c08..c917bfb5c 100644 --- a/docs/docs/sglang-diffusion/deployment_cookbook.mdx +++ b/docs/docs/sglang-diffusion/deployment_cookbook.mdx @@ -146,8 +146,9 @@ When `torch.compile` is enabled, `--offload-during-compile` stays on by default. Breakable CUDA graph is a separate manual opt-in for supported image pipelines. If you enable `--enable-breakable-cuda-graph`, declare every served resolution in `--warmup-resolutions` so warmup captures matching graph signatures. -> [!NOTE] -> The preset is intentionally coarse. A future continuous value such as `0.0` to `1.0` could express the speed-memory tradeoff more precisely, but it would need model-specific memory models and clearer user expectations. Until then, use the preset plus explicit flags for overrides. + +The preset is intentionally coarse. A future continuous value such as `0.0` to `1.0` could express the speed-memory tradeoff more precisely, but it would need model-specific memory models and clearer user expectations. Until then, use the preset plus explicit flags for overrides. + Examples: