minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Enhance SMG guide with RL rollout systems benefits (#18588)

Browse Source
This commit is contained in:
赵晨阳
2026-02-10 20:20:45 -08:00
committed by GitHub
parent 3167bcc01c
commit a2c38f7796
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/advanced_features/dp_dpa_smg_guide.md
+3
View File
@@ -197,6 +197,9 @@ The cache-aware routing policy in SMG significantly improves performance for wor
- Workloads with shared prefixes (high cache reuse potential) - Workloads with shared prefixes (high cache reuse potential)
- You need high availability and reliability features - You need high availability and reliability features
- You require detailed observability and metrics - You require detailed observability and metrics
- You want to have highly efficient RL rollout systems
Note that for RL rollout systems, **there are four crucial reasons that SMG-Based DP is far better than naive DP routing**. Details can be found at [Load Balancing Router in RL](./sglang_for_rl.md#load-balancing-router).
### Quick Start For SMG ### Quick Start For SMG