Add examples for server token-in-token-out (#4103)

Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
This commit is contained in:
Qiaolin Yu
2025-03-05 13:16:31 -08:00
committed by GitHub
co-authored by zhaochenyang20
parent e70fa279bc
commit 357671e216
6 changed files with 154 additions and 3 deletions
+1 -1
View File
@@ -44,6 +44,6 @@ curl -X POST http://localhost:8000/generate_stream -H "Content-Type: applicatio
This will send both non-streaming and streaming requests to the server.
### [Token-In-Token-Out for RLHF](./token_in_token_out)
### [Token-In-Token-Out for RLHF](../token_in_token_out)
In this example, we launch an SGLang engine, feed tokens as input and generate tokens as output.