Commit Graph
11 Commits
Author SHA1 Message Date
Артем Савкин d1357bf87b [NPU] Diffusion CI fixes (#43210) 2026-10-12 14:53:51 +03:00
Rain Jiang c52dcc5a01 The sgalng api specs (#41585) 2026-10-07 01:55:01 -07:00
jain-riaandishandhanani fd62ee84f7 feat(grpc): expose follower metadata and node-local KV sources (#39659)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-10-06 16:39:01 -07:00
jain-ria 21ed9fbf44 [Rust] Extract shared runtime.v1 protobuf bindings (#41726)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
2026-09-30 10:13:08 -07:00
7fef014d51 feat(kv-hints): add kv hint envelope to request transport (#38891)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
2026-09-23 10:31:13 -07:00
William Arnoldandishandhanani 0214954f26 [gRPC] Stream engine state changes (#39915)
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-09-17 19:17:25 -07:00
William Arnoldandishandhanani f45aad44bd [gRPC] Expose native pause status (#37488)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-09-16 15:16:52 -07:00
a0b04dbe4c feat(grpc): add generation request semantics (#32588)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-04 18:53:45 -07:00
Connor CarpenterandIshan Dhanani cc7d6659fd feat(grpc): support disaggregated generation requests (#30440)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
2026-07-08 14:53:56 -07:00
ishandhanani aaa31eb0a1 feat: first-class session identity in SGLang (#29436) 2026-06-28 07:16:38 -07:00
Alex Nails 10e17cc55e [gRPC] Native gRPC server: proto + Rust crate scaffold + server args (#22736) 2026-04-20 12:39:35 +08:00