Eric Zhang and Claude Opus 5
c69d59395b
[inkling] Render tool-result media instead of coercing content to str ( #33898 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-08 14:39:19 +08:00
Cheng Wan
99cfc90658
config: retire ServerArgs.override in favour of derive()
...
`ServerArgs.override(source, **fields)` was the last way to change a resolved
`ServerArgs` in place. Every remaining call-site was one of two things, and
neither wanted an in-place write:
- **A config for someone else.** A draft worker's context length, an encode
worker's device, the compile script's watchdog, the client's port pick, a test
fixture's backends. These already deepcopied first — the write was on the copy.
- **A launcher-stage resolution.** `resolve_auto_parsers` detected the chat
template's parsers and wrote them back, to be inherited by the schedulers it
spawns.
Both are "one config becomes another", so `derive(source, **fields)` returns the
variant and leaves the receiver — and any bags projected from it — untouched. It
deliberately is not `dataclasses.replace`: resolution does not re-run, because
the values being set are decided after it, from inputs it never had. Provenance
and the resolvable-field stash work as before, on the copy.
`resolve_auto_parsers` now computes the parsers and returns the config to launch
with; the detection helpers stop taking a config to mutate. `HiMambaRadixCache`
re-applied a HiCache layout normalization `__post_init__` already performs (the
same duplicate removed from `UnifiedRadixCache` in ebb1c88d23 ) and just goes.
With no in-place mutation left, `ServerArgs.__setattr__` raising after
resolution *is* the guarantee, so the textual writer ratchet retires and
`test_server_args_derive.py` pins the contract instead: the receiver survives
deriving, the published instance still refuses assignment, and deriving does not
publish. `SGLANG_STRICT_CONFIG_MUTATION` was already unused — the guard has been
unconditional since the mutation sweep — and goes with it.
The detection tests drop their `SimpleNamespace` stand-in for a real
`ServerArgs`; the test kit and the MLA chunk-metadata fixture publish a derived
variant instead of writing the runner's published config.
2026-08-05 19:30:53 -07:00
e2cf21b9e5
[Kimi K3] Add reasoning, tool-call, and OpenAI serving support ( #33025 )
...
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com >
Co-authored-by: A-transformer <cl5743590921@gmail.com >
2026-08-01 14:57:23 -07:00
Xinyuan Tong
68d442945f
Flush dropped reasoning at stream end when stream_reasoning=False ( #32225 )
2026-07-31 08:25:54 +08:00
Ke Bao
07a087bf45
Fix Inkling tool-call parsing recovery, content handling, and streaming ( #32861 )
2026-07-30 14:11:09 +08:00
Willow Lopez and Jiminator
ffd4705baa
fix(reasoning): honor Poolside template thinking defaults ( #32540 )
...
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com >
2026-07-29 21:02:19 +00:00
1d350aaad3
fix(reasoning): let --enable-strict-thinking works for DeepSeek-V4 ( #32400 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
2026-07-27 18:15:47 +08:00
Ke Bao
5ab3d90b81
Fix dropped Inkling reasoning at stream end ( #31787 )
2026-07-20 23:23:15 +08:00
02236fa38c
Add Inkling model support ( #31681 )
...
Co-authored-by: Chunan Zeng <zcnrex@gmail.com >
Co-authored-by: Ke Bao <ispobaoke@gmail.com >
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com >
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com >
Co-authored-by: Qiaolin Yu <qiaolin.yu@radixark.ai >
Co-authored-by: Zhichen Zeng <zczeng@uw.edu >
Co-authored-by: Aurick Qiao <aurick@thinkingmachines.ai >
Co-authored-by: Joseph <jk@thinkingmachines.ai >
2026-07-19 22:57:37 -07:00
Brayden Zhong
0ee236ebdf
more fixes for Nemotron 3 parser for tool call and force nonempty content ( #30533 )
2026-07-14 06:50:27 +08:00
0663ebc783
[minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra ( #28715 )
...
Co-authored-by: Xinyuan Tong <xinyuan-tong@users.noreply.github.com >
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com >
2026-07-11 11:11:06 +08:00
Liangsheng Yin
23390589f7
[misc] Remove unit test cases that fail the admission criteria (round 3) ( #30713 )
2026-07-09 19:42:51 -07:00
Liangsheng Yin
a36c873147
[misc] Remove unit test cases that fail the admission criteria (round 2) ( #30703 )
2026-07-09 16:35:59 -07:00
Liangsheng Yin
c53559ba10
[misc] Remove unit test cases that fail the admission criteria ( #30690 )
2026-07-09 15:31:28 -07:00
Cheng Wan
1f15308dca
[refactor] Retire the legacy config accessor and the remaining process singletons ( #30493 )
2026-07-09 02:10:47 -07:00
Xinyuan Tong
074bb928f0
Move template manager files under parser; update CODEOWNERS ( #26052 )
2026-07-08 16:47:36 -07:00
jundu
e04ed05193
[CI] reduce CPU CI scope with base-c suite ( #28623 )
2026-06-24 16:18:06 +08:00
85712fa5b0
Fix Responses API request handling ( #25881 )
...
Co-authored-by: Kai-Hsun Chen <kaihsun@apache.org >
Co-authored-by: Kristin Cowalcijk <kristincowalcijk@gmail.com >
Co-authored-by: aerosta <63026763+aerosta@users.noreply.github.com >
Co-authored-by: glaziermag <glaziermag@users.noreply.github.com >
Co-authored-by: Blake Ledden <blake.ledden@gmail.com >
Co-authored-by: PanJason <pyyjason@gmail.com >
Co-authored-by: Leoyzen <leoyzen@gmail.com >
Co-authored-by: kennyu <966806+kennyu@users.noreply.github.com >
2026-06-12 14:47:55 -07:00
MingxuZh
21ba329dac
[Xeon] CPU CI enhancement for Intel Xeon platforms ( #24649 )
2026-05-28 10:49:04 +08:00
Yuzhen Zhou
dac78768f0
[RL][TITO] Preserve whitespace in reasoning parser outputs ( #24251 )
2026-05-20 19:45:09 +00:00
Liangsheng Yin
b7d62bd724
[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI ( #25420 )
2026-05-15 18:26:55 -07:00
Jimmy Shong
096ad02b06
[Model] Laguna-XS.2 Model Support ( #24204 )
2026-05-09 05:43:13 +08:00
sglang-bot and sglang-bot
da175b964d
chore: update CI test est_time values ( #23785 )
...
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com >
2026-04-26 20:17:50 -07:00
6d03861476
support Hy3 preview ( #23533 )
...
Co-authored-by: pengmeng <pengmeng@tencent.com >
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com >
Co-authored-by: chengvjiang <chengvjiang@tencent.com >
Co-authored-by: russellfeng <russellfeng@tencent.com >
2026-04-24 12:03:24 -07:00
265696b176
chore: update CI test est_time values ( #22565 )
...
Co-authored-by: Cheng Wan <chwan@rice.edu >
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com >
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
2026-04-10 18:15:02 -07:00
2813cb6d9a
[New Model] Gemma 4 ( #21952 )
...
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
Co-authored-by: Pengyu Chen <pychen96@gmail.com >
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Andy Luo <andy.luo@amd.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: adarshxs <adarsh.shirawalmath@gmail.com >
2026-04-06 20:24:44 -07:00
Liangsheng Yin
bd6a585605
Consolidate reasoning tests into test/registered/reasoning/ ( #22139 )
2026-04-05 01:09:11 -07:00
Ke Bao
47f4fd275a
[CI] Fix test suite names and add suite validation ( #21937 )
2026-04-03 23:47:17 +08:00
Zijun Gao
4dbe42527e
[Test] Add unit tests for srt/parser ( #20947 )
2026-03-24 00:26:46 +08:00
Lianmin Zheng
814202704b
ci: unify PR test suite naming ( #21187 )
2026-03-23 00:18:45 -07:00
roikoren755
5ef5806160
[Nemotron] Small reasoning parser fix ( #20284 )
2026-03-16 13:29:40 -07:00
Ke Bao
c3483e8e97
[CI] Move existing unit tests into unit directory ( #20631 )
2026-03-15 23:25:18 +08:00