minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity

[Router] Count open HTTP exchanges until their response body finishes (#39014)

Browse Source 
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
This commit is contained in:
Kangyan-Zhou
2026-09-16 00:04:38 -07:00
committed by GitHub
co-authored by Kangyan Zhou Claude Opus 5
parent faaff1eca8
commit d634320e48
8 changed files with 335 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
experimental/sgl-router/Cargo.toml
+3
View File
@@ -50,6 +50,9 @@ tokio = { version = "1.42", features = ["full"] }
# so inbound h2c no longer rides on a gRPC dependency it has nothing to do with,
# and it enables HTTP/2 extended CONNECT for h2 websockets.
axum = { version = "0.8", features = ["macros", "tracing", "http2"] }
# Named directly (not just via axum) to implement a response-body wrapper:
# `Frame`/`SizeHint` are not re-exported through `axum::body`.
http-body = "1"
tower = { version = "0.5", features = ["full"] }
tower-http = { version = "0.6", features = ["trace", "compression-gzip", "cors", "timeout", "request-id"] }
reqwest = { version = "0.12", features = ["stream", "json", "rustls-tls", "http2"], default-features = false }