minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity

[diffusion] feat: resolve hub component subfolders (#35939)

Browse Source
This commit is contained in:
Mick
2026-08-22 12:01:44 +08:00
committed by GitHub
parent ac179eec11
commit 5290327025
3 changed files with 44 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/docs/sglang-diffusion/api/cli.mdx
+6 -2
View File
@@ -143,10 +143,14 @@ For a native text encoder:
The same contract applies to every weighted component: path routing is generic,
while quantized materialization is capability-based. Native auxiliary loaders
that only understand unquantized state dicts reject quantization metadata before
model construction. See [Quantized Component Repositories](../quantization#quantized-component-repositories)
whose current materializer expects plain state dicts reject unsupported
quantization metadata before model construction. See
[Quantized Component Repositories](../quantization#quantized-component-repositories)
for the current component matrix.
Component overrides accept a local component directory, a standalone Hub
repository, or a Hub component subfolder written as `owner/repo/subfolder`.
For supported realtime causal video models, `--kv-cache-quant {off|int4|int2}`
compresses completed KV-cache chunks independently of transformer weight
quantization. It is lossy and disabled by default.