Commit Graph
3370 Commits
Author SHA1 Message Date
Mick 7da30f4e55 feat: enable piecewise prefill graph for Kimi K2.5/K2.7 (#30889) 2026-07-13 08:37:30 +08:00
Lianmin Zheng b94ac87e0c Enable breakable prefill CUDA graph for DP attention (#30898) 2026-07-12 17:10:04 -07:00
cctry c616d5a55e [PD] Improve optimistic prefill (#30951) 2026-07-12 15:31:53 -07:00
6cc9352dfe [Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-07-12 17:25:26 -05:00
Liangsheng Yin 7a82178277 [Fix] Disable FlashInfer allreduce fusion in Nemotron-3-Nano lm-eval test (#30945) 2026-07-12 15:39:59 -05:00
Liangsheng Yin 5ba3c5147e [Spec] Add kill-switch env for draft-extend CUDA graph capture (#30944) 2026-07-12 14:54:36 -05:00
Mohammad Miadh Angkad 96a04cb13f Fix DeepEP CI test registration (#30873) 2026-07-12 05:54:50 -07:00
Lianmin ZhengandYongji Wu 81d273f73b Handle coredump dirs and cache hit updates (#30897)
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
2026-07-12 00:37:43 -07:00
Mick bce3fc987d perf: reuse MoonViT FA3 max-seqlen metadata (#30878) 2026-07-12 14:05:21 +08:00
pllimax 592c04381d Update test repository case scripts to the main community (#29939) 2026-07-12 11:36:30 +08:00
Mick a358abd651 chore: update vlm moe config and tune scripts (#30866) 2026-07-12 08:35:59 +08:00
Mick af66370d81 bench: support random image resolutions (#30879) 2026-07-12 08:28:56 +08:00
Liangsheng Yin 4884f6fbee [Fix] Unify ForwardBatch extend lens cpu fields to their declared list type (#30896) 2026-07-11 17:30:53 -05:00
ed554aac17 Fix: add grammar sync in PP for structured output (#30747)
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: ziang663 <119752791+ziang663@users.noreply.github.com>
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
2026-07-12 02:54:50 +08:00
Jae B. a91c2e6596 [Apple Silicon] [CI] Move the MLX lane to the check-changes + pr-gate composite (#30121) 2026-07-10 22:00:15 -07:00
Baizhou Zhang 07165d5daa Add DCP to runtime parallel context (#30478) 2026-07-10 21:23:41 -07:00
0663ebc783 [minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra (#28715)
Co-authored-by: Xinyuan Tong <xinyuan-tong@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-07-11 11:11:06 +08:00
Chenchen HongandXiaoyu Zhang e3ceccf781 [dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-07-11 11:05:05 +08:00
Cheng Wan fc2ef35308 [refactor] Move MLP collective flags onto ForwardFlags (#30802) 2026-07-10 17:43:39 -07:00
Yihao Wang 7de33ce806 fix: fix mm processor double bos (#26505) 2026-07-11 07:53:08 +08:00
Lianmin ZhengandAbhishek Parmar 4fcc994be1 Support priority request header override (#30811)
Co-authored-by: Abhishek Parmar <abhishek@orng.net>
2026-07-10 14:36:43 -07:00
Mohammad Miadh Angkad 7b99900980 Fix hybrid attention graph hook test fixture (#30790) 2026-07-10 23:37:04 +05:30
Lianmin Zheng 7998fecfd1 [kv canary] Support UnifiedRadixCache in kv-canary and bracket nested model.forward (#30574) 2026-07-10 10:58:55 -07:00
Lianmin ZhengandYonghao Zhuang 3dc93a12ca Improve EPLB dispatch handling and diagnostics (#30646)
Co-authored-by: Yonghao Zhuang <yhzhuang@meta.com>
2026-07-10 10:40:19 -07:00
Zhangheng 0299393758 [UnifiedTree]: Sync mamba int8 checkpoint (#30626) 2026-07-10 23:46:38 +08:00
Xiaoyu ZhangandClaude Opus 4.8 6ed9843b57 [Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-10 21:41:08 +08:00
Xiaoyu Zhang e9493a015c Fix diffusion BCG lifetime and add Z-Image-Turbo CI (#30584) 2026-07-10 21:19:59 +08:00
Xinyuan Tong 6174f1cad8 [test] Set init-static attrs in mm_process_config mock fixtures (#30766) 2026-07-10 03:00:00 -07:00
BingjiaWang fd19a76237 [BUG] fix strip streaming empty-string suffix from DSV4 tool arguments (#29883) 2026-07-10 02:05:26 -07:00
Junjie CaoandZhangheng 1d8e3c248b Fix DSV4 HiSparse SWA tail allocation forwarding (#30408)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-07-10 15:27:02 +08:00
Xinyuan Tong b76dd0be69 Fix Mistral GSM8K chat eval (#27757) 2026-07-09 21:08:48 -07:00
Liangsheng Yin 23390589f7 [misc] Remove unit test cases that fail the admission criteria (round 3) (#30713) 2026-07-09 19:42:51 -07:00
Liangsheng Yin ccd2028def [style] Extract init-static values in tokenizer + multimodal path (#30709) 2026-07-09 19:36:34 -07:00
Liangsheng Yin b5e75b9423 [style] Extract init-static values in scheduler hot path (#30707) 2026-07-09 19:33:02 -07:00
Ma Mingfei 073b36853f [CPU] update fla.cpp to support when num_head_v is not multiples of 16 (#30604) 2026-07-10 09:21:07 +08:00
Mick 5ce5e1ee3e [Diffusion] Revert CPU AMX optimizations (#30716) 2026-07-10 09:09:38 +08:00
fzyzcjy 1e75ba236e Avoid implicit field-based side channel in Scheduler planning (#29408) 2026-07-10 08:55:51 +08:00
fzyzcjy 5be9c9f7c6 Localize cur_batch field in Scheduler to avoid field-based state access (#29407) 2026-07-10 08:55:06 +08:00
2e66707399 Fix pipeline-parallel abort missing in-flight requests in non-current microbatch slots (#29405)
Co-authored-by: burling <3637497+burling@users.noreply.github.com>
Co-authored-by: zhaotyer <89376832+zhaotyer@users.noreply.github.com>
2026-07-10 08:53:18 +08:00
2c6cd1ef41 [Dep] Upgrade flashinfer to 0.6.14 (#29910)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-07-09 17:52:33 -07:00
Lianmin Zhengandtanujtiwari1998 cfc66e05c5 [tokenizer] Support pluggable tokenizer worker class in multi-tokenizer mode (#30630)
Co-authored-by: tanujtiwari1998 <168470992+tanujtiwari1998@users.noreply.github.com>
2026-07-09 17:31:54 -07:00
Liangsheng Yin a36c873147 [misc] Remove unit test cases that fail the admission criteria (round 2) (#30703) 2026-07-09 16:35:59 -07:00
Liangsheng Yin c53559ba10 [misc] Remove unit test cases that fail the admission criteria (#30690) 2026-07-09 15:31:28 -07:00
Spandan Tiwari 40a522203c [Quantization][Bugfix]: Join multi-arg RuntimeError in Quark _check_scheme_supported (#25694) 2026-07-09 15:07:14 -07:00
Spandan Tiwari 48d98b7c68 [Quantization][bugfix] Correct E8M0 NaN-sentinel detection in e8m0_to_f32 (#25519) 2026-07-09 15:02:53 -07:00
Xinyuan Tong 7132af28de Fix garbage output for bare-tekken Mistral checkpoints (e.g. Leanstral) (#30396) 2026-07-10 00:08:38 +05:30
Mohammad Miadh Angkad b0ecbceed9 [Bugfix] Migrate retired parallel accessors (#30653) 2026-07-09 11:22:34 -07:00
26ba3458d3 [AMD] Fix int32 offset overflow in Triton decode-attention kernels (#28788)
Co-authored-by: Chun Fang <chun.fang@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
2026-07-09 11:20:04 -07:00
YAMY 2e4d6368c3 [GDN] Auto-select FlashInfer GDN prefill on validated SM100 configs (#29734) 2026-07-10 00:26:00 +08:00
cctryandcctry 1959335997 refactor(load-snapshot): build LoadSnapshot directly, drop legacy get_loads IPC (#30525)
Co-authored-by: cctry <cctry@fb.com>
2026-07-09 05:58:10 -07:00