Commit Graph
3382 Commits
Author SHA1 Message Date
Brayden Zhong 0ee236ebdf more fixes for Nemotron 3 parser for tool call and force nonempty content (#30533) 2026-07-14 06:50:27 +08:00
Liangsheng Yin e2728ac504 [Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998) 2026-07-13 15:30:31 -05:00
Liangsheng Yin c0f1f7e062 [Spec] Rename num_tokens_per_bs to num_tokens_per_req (#30977) 2026-07-13 13:47:53 -05:00
11a82af5f8 [Platform] Route pin memory availability through current_platform (#28113)
Co-authored-by: N3u0ns <N3u0ns@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-07-13 11:37:59 -07:00
Xinyuan Tong afaa17a7f2 [Feature] Add --default-chat-template-kwargs server arg (#29579) 2026-07-13 11:34:39 -07:00
ziruiliu 978bce2063 [HiCache & HybridModel] nixl hicache backend support hybrid models (#29191)
Signed-off-by: Zirui Liu <ziliu@ddn.com>
2026-07-13 09:09:37 -07:00
9fec359a60 [Fix] Load HunyuanV3 NextN final_layernorm into the draft head's output norm (#30331)
Co-authored-by: Auroter <auroter@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-13 20:37:36 +08:00
Yichao Cheng a74bee2261 [PD] Handle NIXL abort notifications (#30352) 2026-07-13 05:05:25 -07:00
xutizhou eb31b5310c Support Waterfill with MegaMoE backend (#27350) 2026-07-13 03:56:46 -07:00
Xiaoyu ZhangandClaude Fable 5 874fc07d9b [Kernel] Migrate scattered quantization kernels to sglang.kernels (RFC #29630, Phase 2.5, 1/7) (#30784)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-13 16:17:01 +08:00
shuwenn 9dd57ef8c4 [mem_cache][7/N] refactor: move MLATokenToKVPoolHost to pool_host.mla (#30616) 2026-07-13 14:23:38 +08:00
Mohammad Miadh Angkad cbcbef6811 [Bugfix] Fix Nemotron ForwardFlags across custom op boundary (#30968) 2026-07-12 22:10:23 -07:00
Mick 7da30f4e55 feat: enable piecewise prefill graph for Kimi K2.5/K2.7 (#30889) 2026-07-13 08:37:30 +08:00
Lianmin Zheng b94ac87e0c Enable breakable prefill CUDA graph for DP attention (#30898) 2026-07-12 17:10:04 -07:00
cctry c616d5a55e [PD] Improve optimistic prefill (#30951) 2026-07-12 15:31:53 -07:00
6cc9352dfe [Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-07-12 17:25:26 -05:00
Liangsheng Yin 7a82178277 [Fix] Disable FlashInfer allreduce fusion in Nemotron-3-Nano lm-eval test (#30945) 2026-07-12 15:39:59 -05:00
Liangsheng Yin 5ba3c5147e [Spec] Add kill-switch env for draft-extend CUDA graph capture (#30944) 2026-07-12 14:54:36 -05:00
Mohammad Miadh Angkad 96a04cb13f Fix DeepEP CI test registration (#30873) 2026-07-12 05:54:50 -07:00
Lianmin ZhengandYongji Wu 81d273f73b Handle coredump dirs and cache hit updates (#30897)
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
2026-07-12 00:37:43 -07:00
Mick bce3fc987d perf: reuse MoonViT FA3 max-seqlen metadata (#30878) 2026-07-12 14:05:21 +08:00
pllimax 592c04381d Update test repository case scripts to the main community (#29939) 2026-07-12 11:36:30 +08:00
Mick a358abd651 chore: update vlm moe config and tune scripts (#30866) 2026-07-12 08:35:59 +08:00
Mick af66370d81 bench: support random image resolutions (#30879) 2026-07-12 08:28:56 +08:00
Liangsheng Yin 4884f6fbee [Fix] Unify ForwardBatch extend lens cpu fields to their declared list type (#30896) 2026-07-11 17:30:53 -05:00
ed554aac17 Fix: add grammar sync in PP for structured output (#30747)
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: ziang663 <119752791+ziang663@users.noreply.github.com>
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
2026-07-12 02:54:50 +08:00
Jae B. a91c2e6596 [Apple Silicon] [CI] Move the MLX lane to the check-changes + pr-gate composite (#30121) 2026-07-10 22:00:15 -07:00
Baizhou Zhang 07165d5daa Add DCP to runtime parallel context (#30478) 2026-07-10 21:23:41 -07:00
0663ebc783 [minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra (#28715)
Co-authored-by: Xinyuan Tong <xinyuan-tong@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-07-11 11:11:06 +08:00
Chenchen HongandXiaoyu Zhang e3ceccf781 [dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-07-11 11:05:05 +08:00
Cheng Wan fc2ef35308 [refactor] Move MLP collective flags onto ForwardFlags (#30802) 2026-07-10 17:43:39 -07:00
Yihao Wang 7de33ce806 fix: fix mm processor double bos (#26505) 2026-07-11 07:53:08 +08:00
Lianmin ZhengandAbhishek Parmar 4fcc994be1 Support priority request header override (#30811)
Co-authored-by: Abhishek Parmar <abhishek@orng.net>
2026-07-10 14:36:43 -07:00
Mohammad Miadh Angkad 7b99900980 Fix hybrid attention graph hook test fixture (#30790) 2026-07-10 23:37:04 +05:30
Lianmin Zheng 7998fecfd1 [kv canary] Support UnifiedRadixCache in kv-canary and bracket nested model.forward (#30574) 2026-07-10 10:58:55 -07:00
Lianmin ZhengandYonghao Zhuang 3dc93a12ca Improve EPLB dispatch handling and diagnostics (#30646)
Co-authored-by: Yonghao Zhuang <yhzhuang@meta.com>
2026-07-10 10:40:19 -07:00
Zhangheng 0299393758 [UnifiedTree]: Sync mamba int8 checkpoint (#30626) 2026-07-10 23:46:38 +08:00
Xiaoyu ZhangandClaude Opus 4.8 6ed9843b57 [Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-10 21:41:08 +08:00
Xiaoyu Zhang e9493a015c Fix diffusion BCG lifetime and add Z-Image-Turbo CI (#30584) 2026-07-10 21:19:59 +08:00
Xinyuan Tong 6174f1cad8 [test] Set init-static attrs in mm_process_config mock fixtures (#30766) 2026-07-10 03:00:00 -07:00
BingjiaWang fd19a76237 [BUG] fix strip streaming empty-string suffix from DSV4 tool arguments (#29883) 2026-07-10 02:05:26 -07:00
Junjie CaoandZhangheng 1d8e3c248b Fix DSV4 HiSparse SWA tail allocation forwarding (#30408)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-07-10 15:27:02 +08:00
Xinyuan Tong b76dd0be69 Fix Mistral GSM8K chat eval (#27757) 2026-07-09 21:08:48 -07:00
Liangsheng Yin 23390589f7 [misc] Remove unit test cases that fail the admission criteria (round 3) (#30713) 2026-07-09 19:42:51 -07:00
Liangsheng Yin ccd2028def [style] Extract init-static values in tokenizer + multimodal path (#30709) 2026-07-09 19:36:34 -07:00
Liangsheng Yin b5e75b9423 [style] Extract init-static values in scheduler hot path (#30707) 2026-07-09 19:33:02 -07:00
Ma Mingfei 073b36853f [CPU] update fla.cpp to support when num_head_v is not multiples of 16 (#30604) 2026-07-10 09:21:07 +08:00
Mick 5ce5e1ee3e [Diffusion] Revert CPU AMX optimizations (#30716) 2026-07-10 09:09:38 +08:00
fzyzcjy 1e75ba236e Avoid implicit field-based side channel in Scheduler planning (#29408) 2026-07-10 08:55:51 +08:00
fzyzcjy 5be9c9f7c6 Localize cur_batch field in Scheduler to avoid field-based state access (#29407) 2026-07-10 08:55:06 +08:00