- /v1/responses 双向翻译(含流式 response.* 事件、tools、usage 全字段) - /v1/chat/completions 字节级透传 - STOP_SCOPE=content 内容侧 stop(保思维链 + matched_stop 回填) - b300 docker 构建 + 孔明 kaniko 构建 + 两版 cw manifest
12 lines
568 B
XML
12 lines
568 B
XML
<pre lang="text" caption="网关链路拓扑"><code>客户端(/v1/chat/completions · /v1/messages · /v1/responses)
|
||
│
|
||
▼
|
||
new-api 网关 :31000 ── 参数覆盖链(thinking / reasoning_effort / temperature / top_p / max_tokens)
|
||
│ 渠道上游
|
||
▼
|
||
responses-shim :8080(孔明 cw ds41-resp-shim;responses ⇄ chat 翻译,chat 字节透传)
|
||
│ UPSTREAM_BASE=http://ds41-3p1d:50002
|
||
▼
|
||
sgl-router ds41-3p1d:50002 ──┬── P ×3(prefill,cp4 + dspark)
|
||
└── D(decode,dp2)</code></pre>
|