minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

refactor: extract FanOutCommunicator and use declarative spec table (#22967)

Browse Source
This commit is contained in:
Liangsheng Yin
2026-04-16 15:37:19 -07:00
committed by GitHub
parent 52f0b86f5d
commit db7a751d48
6 changed files with 161 additions and 299 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/advanced_features/hicache_storage_runtime_attach_detach.md
+2 -2
View File
@@ -19,8 +19,8 @@ The control path is:
1. **HTTP Server** (`python/sglang/srt/entrypoints/http_server.py`)
- Exposes `PUT /hicache/storage-backend`, `DELETE /hicache/storage-backend`, `GET /hicache/storage-backend`
2. **TokenizerManager** (`python/sglang/srt/managers/tokenizer_communicator_mixin.py`)
- Sends the request to the Scheduler via `_Communicator`
2. **TokenizerManager** (`python/sglang/srt/managers/tokenizer_control_mixin.py`)
- Sends the request to the Scheduler via `FanOutCommunicator`
3. **Scheduler** (`python/sglang/srt/managers/scheduler.py`)
- Performs a **strict idle check**
- Calls `tree_cache.attach_storage_backend(...)` / `detach_storage_backend(...)`