minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892)

Browse Source
This commit is contained in:
shuwenn
2026-01-26 19:33:19 -08:00
committed by GitHub
parent 1b56a886bb
commit fd3b179ffd
10 changed files with 1488 additions and 124 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/advanced_features/hicache_best_practices.md
+4
View File
@@ -19,6 +19,10 @@ SGLang HiCache extends the traditional RadixAttention with a three-tier hierarch
--hicache-storage-backend # Optional storage backend (e.g., hf3fs, mooncake, etc.)
```
Notes:
- Besides configuring `--hicache-storage-backend` at startup, SGLang also supports **runtime attach/detach** of the HiCache storage backend (no restart required) via HTTP admin endpoints. See [Runtime Attach/Detach HiCache Storage Backend](hicache_storage_runtime_attach_detach.md).
## Key Configurations with Storage Backends Enabled
### Memory Layout Optimization