Cheng Wan
99cfc90658
config: retire ServerArgs.override in favour of derive()
...
`ServerArgs.override(source, **fields)` was the last way to change a resolved
`ServerArgs` in place. Every remaining call-site was one of two things, and
neither wanted an in-place write:
- **A config for someone else.** A draft worker's context length, an encode
worker's device, the compile script's watchdog, the client's port pick, a test
fixture's backends. These already deepcopied first — the write was on the copy.
- **A launcher-stage resolution.** `resolve_auto_parsers` detected the chat
template's parsers and wrote them back, to be inherited by the schedulers it
spawns.
Both are "one config becomes another", so `derive(source, **fields)` returns the
variant and leaves the receiver — and any bags projected from it — untouched. It
deliberately is not `dataclasses.replace`: resolution does not re-run, because
the values being set are decided after it, from inputs it never had. Provenance
and the resolvable-field stash work as before, on the copy.
`resolve_auto_parsers` now computes the parsers and returns the config to launch
with; the detection helpers stop taking a config to mutate. `HiMambaRadixCache`
re-applied a HiCache layout normalization `__post_init__` already performs (the
same duplicate removed from `UnifiedRadixCache` in ebb1c88d23
2026-08-05 19:30:53 -07:00
e2cf21b9e5
[Kimi K3] Add reasoning, tool-call, and OpenAI serving support ( #33025 )
...
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com >
Co-authored-by: A-transformer <cl5743590921@gmail.com >
2026-08-01 14:57:23 -07:00
Xinyuan Tong
68d442945f
Flush dropped reasoning at stream end when stream_reasoning=False ( #32225 )
2026-07-31 08:25:54 +08:00
Ke Bao
07a087bf45
Fix Inkling tool-call parsing recovery, content handling, and streaming ( #32861 )
2026-07-30 14:11:09 +08:00
Willow Lopez and Jiminator
ffd4705baa
fix(reasoning): honor Poolside template thinking defaults ( #32540 )
...
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com >
2026-07-29 21:02:19 +00:00
1d350aaad3
fix(reasoning): let --enable-strict-thinking works for DeepSeek-V4 ( #32400 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
2026-07-27 18:15:47 +08:00
Ke Bao
5ab3d90b81
Fix dropped Inkling reasoning at stream end ( #31787 )
2026-07-20 23:23:15 +08:00
02236fa38c
Add Inkling model support ( #31681 )
...
Co-authored-by: Chunan Zeng <zcnrex@gmail.com >
Co-authored-by: Ke Bao <ispobaoke@gmail.com >
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com >
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com >
Co-authored-by: Qiaolin Yu <qiaolin.yu@radixark.ai >
Co-authored-by: Zhichen Zeng <zczeng@uw.edu >
Co-authored-by: Aurick Qiao <aurick@thinkingmachines.ai >
Co-authored-by: Joseph <jk@thinkingmachines.ai >
2026-07-19 22:57:37 -07:00
Brayden Zhong
0ee236ebdf
more fixes for Nemotron 3 parser for tool call and force nonempty content ( #30533 )
2026-07-14 06:50:27 +08:00
0663ebc783
[minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra ( #28715 )
...
Co-authored-by: Xinyuan Tong <xinyuan-tong@users.noreply.github.com >
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com >
2026-07-11 11:11:06 +08:00
Liangsheng Yin
c53559ba10
[misc] Remove unit test cases that fail the admission criteria ( #30690 )
2026-07-09 15:31:28 -07:00
Cheng Wan
1f15308dca
[refactor] Retire the legacy config accessor and the remaining process singletons ( #30493 )
2026-07-09 02:10:47 -07:00
Xinyuan Tong
074bb928f0
Move template manager files under parser; update CODEOWNERS ( #26052 )
2026-07-08 16:47:36 -07:00
Xinyuan Tong
854b46be99
feat(parser): resolve special-token suffix at runtime for compatibility ( #29920 )
2026-07-05 00:13:46 +08:00
Aditya Kamat and Mick
1589603114
model: support baidu unlimited-ocr ( #29186 )
...
Co-authored-by: Mick <mickjagger19@icloud.com >
2026-06-27 23:36:19 +08:00
85712fa5b0
Fix Responses API request handling ( #25881 )
...
Co-authored-by: Kai-Hsun Chen <kaihsun@apache.org >
Co-authored-by: Kristin Cowalcijk <kristincowalcijk@gmail.com >
Co-authored-by: aerosta <63026763+aerosta@users.noreply.github.com >
Co-authored-by: glaziermag <glaziermag@users.noreply.github.com >
Co-authored-by: Blake Ledden <blake.ledden@gmail.com >
Co-authored-by: PanJason <pyyjason@gmail.com >
Co-authored-by: Leoyzen <leoyzen@gmail.com >
Co-authored-by: kennyu <966806+kennyu@users.noreply.github.com >
2026-06-12 14:47:55 -07:00
EduardDurech
e9dbbd19e9
[model] Apertus Tool/Function and Reasoning parser ( #25100 )
2026-06-06 00:04:31 -07:00
zijiexia and Yihao Wang
1ebc7438ac
model: support Command A plus ( #26106 )
...
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com >
2026-06-03 11:23:04 +08:00
Yuzhen Zhou
dac78768f0
[RL][TITO] Preserve whitespace in reasoning parser outputs ( #24251 )
2026-05-20 19:45:09 +00:00
Yihao Wang
b35fd5f104
[fix] skip legacy minicpmv conv template for MiniCPM-V 4.6 ( #24998 )
2026-05-12 15:27:28 +08:00
Jimmy Shong
096ad02b06
[Model] Laguna-XS.2 Model Support ( #24204 )
2026-05-09 05:43:13 +08:00
+6
35870d55ac
Deepseek V4 ( #23882 )
...
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com >
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
Co-authored-by: fzyzcjy <ch271828n@outlook.com >
Co-authored-by: ispobock <ispobaoke@gmail.com >
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu >
Co-authored-by: yueming-yuan <yym022502@gmail.com >
Co-authored-by: DarkSharpness <2040703891@qq.com >
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com >
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com >
Co-authored-by: yhyang201 <yhyang201@gmail.com >
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com >
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com >
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com >
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com >
2026-05-07 18:32:21 -07:00
Xinyuan Tong
5b589ed2e7
feat(constrained): two-phase reasoning grammar + --enable-strict-thinking ( #23953 )
2026-05-07 14:21:51 -07:00
Xinyuan Tong
d8f9d32a05
feat(reasoning): auto-detect reasoning/tool-call parser from chat template ( #23952 )
2026-05-07 14:19:16 -07:00
651af06a0b
[Feature] Xiaomi MiMo-V2.5 day0 support ( #23811 )
...
Co-authored-by: 张袁 <zhangyuan36@xiaomi.com >
Co-authored-by: 刘安岐 <liuanqi6@xiaomi.com >
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
Co-authored-by: Shangming Cai <csmthu@gmail.com >
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com >
2026-05-01 00:02:26 +08:00
6d03861476
support Hy3 preview ( #23533 )
...
Co-authored-by: pengmeng <pengmeng@tencent.com >
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com >
Co-authored-by: chengvjiang <chengvjiang@tencent.com >
Co-authored-by: russellfeng <russellfeng@tencent.com >
2026-04-24 12:03:24 -07:00
Shaojun Zhou
59724e90a9
model: support Moss-VL ( #23454 )
2026-04-24 11:14:29 +08:00
Yuxuan Zhang and Xinyuan Tong
28cfd3d272
Support defer_loading field at function level for Chat Completions API ( #22702 )
...
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com >
2026-04-22 10:09:54 -07:00
2813cb6d9a
[New Model] Gemma 4 ( #21952 )
...
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
Co-authored-by: Pengyu Chen <pychen96@gmail.com >
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Andy Luo <andy.luo@amd.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: adarshxs <adarsh.shirawalmath@gmail.com >
2026-04-06 20:24:44 -07:00
shuwenn
6098c51bc2
fix(MiMo-V2-Flash): add mimo reasoning parser ( #21414 )
2026-04-02 00:47:27 +08:00
6b8a6545b2
Add Mistral Small 4 (Pixtral) support ( #20708 )
...
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
Co-authored-by: Alex Nails <alexnails@radixark.ai >
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com >
Co-authored-by: dbari <dbari@users.noreply.github.com >
2026-03-18 14:15:32 -07:00
roikoren755
5ef5806160
[Nemotron] Small reasoning parser fix ( #20284 )
2026-03-16 13:29:40 -07:00
danielafrimi
ff6048fb9c
rename nemotron reasoning parser ( #19865 )
...
Signed-off-by: dafrimi <dafrimi@nvidia.com >
2026-03-05 11:27:07 -08:00
Xinyuan Tong
dbf1247fe0
Add KimiK2Detector with tool interruption support ( #19696 )
...
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
2026-03-03 14:04:49 +08:00
Leoyzen and Sisyphus
da2a0240f7
Add GLM45 tool interruption support ( #17714 )
...
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai >
2026-03-02 19:34:12 +08:00
1a83b2c15d
fix: fix the bug blocking completion template application ( #17010 )
...
Co-authored-by: xdtbynd <supercluster@vip.qq.com >
Co-authored-by: cy <chenyang08056032@163.com >
Co-authored-by: sglang-npu-bot <sglangnpu@163.com >
2026-02-24 18:50:08 +08:00
581bf53e03
Whisper model support & /v1/audio/transcriptions endpoint & benchmark ( #16983 )
...
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
Co-authored-by: MahmoudAshraf97 <hassouna97.ma@gmail.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-23 17:28:37 -08:00
SoluMilken
07a24f1a38
update pre-commit config ( #18860 )
2026-02-16 00:18:31 +08:00
ybyang
c8aa2a6534
Fix dsv32 encode_messages ( #18126 )
2026-02-14 16:44:13 +08:00
Yuhao Yang and ltd0924
980d2936cd
model: support Step-3.5-Flash ( #18084 )
...
Co-authored-by: ltd0924 <ltd0924@sina.com >
2026-02-03 00:40:07 +08:00
Xinyuan Tong
3c34d2c3eb
[FIX] kimi_k2 reasoning parser ( #17901 )
...
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
2026-01-28 19:47:09 -08:00
laixin and Xinyuan Tong
6c9b054ab7
[Bug Fix] Fix reasoning parser when continue_final_message=true ( #17065 )
...
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com >
2026-01-27 14:04:44 +08:00
Yuhao Yang and Mick
479ab7a4e7
model: support Kimi-K2.5 ( #17789 )
...
Co-authored-by: Mick <mickjagger19@icloud.com >
2026-01-27 10:57:00 +08:00
yuhao and Mick
d2ea44f775
VLM: enhance VL embedding model with video input support and revise warm-up strategy ( #16635 )
...
Co-authored-by: Mick <mickjagger19@icloud.com >
2026-01-08 22:12:01 +08:00
Yuan Luo and luoyuan.luo
5f3eb377e0
[VLM] Support request level max_dynamic_patch for OpenAI request ( #16268 )
...
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com >
2026-01-04 13:04:43 +08:00
许霖
726fe3e72e
fix: prevent points regex from matching checkpoints/endpoints ( #15120 )
2025-12-17 12:38:18 -08:00
5e96beb3e5
Adding tool calling and reasoning parser support for Intern-S1 ( #14866 )
...
Co-authored-by: KennyYao2001 <kennyy@andrew.cmu.edu >
Co-authored-by: Cursor AI <cursor@example.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Changyi Yang <112288487+ChangyiYang@users.noreply.github.com >
2025-12-16 00:01:58 -08:00
danielafrimi
8102e36b5d
Add NanoV3 reasoning parser support ( #15113 )
2025-12-14 12:09:44 -08:00
yudian0504 and luoyuan.luo
9496f12d00
[Model] Add PaddleOCR-VL Model Support ( #12953 )
...
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com >
2025-12-09 10:16:02 -08:00
bigmoyan
508d2f7aa2
add Kimi k2 reasoning parser ( #12702 )
...
Signed-off-by: wangzhengtao <wangzhengtao@msh.team >
2025-11-06 00:37:54 +08:00
Cheng Wan