|
6cc9352dfe
|
[Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-07-12 17:25:26 -05:00 |
|
|
Liangsheng Yin
|
5ba3c5147e
|
[Spec] Add kill-switch env for draft-extend CUDA graph capture (#30944)
|
2026-07-12 14:54:36 -05:00 |
|
|
Lianmin ZhengandJialin Ouyang
|
539253e1d5
|
Gate Rust extension builds (#30927)
Co-authored-by: Jialin Ouyang <jialino@meta.com>
|
2026-07-12 05:44:58 -07:00 |
|
|
Yonghao Zhuang
|
80856aba85
|
Make the mxfp8 MoE runner backend list extensible (#30828)
|
2026-07-12 01:28:10 -07:00 |
|
|
Lianmin ZhengandYongji Wu
|
81d273f73b
|
Handle coredump dirs and cache hit updates (#30897)
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-07-12 00:37:43 -07:00 |
|
|
Mick
|
f1c247edf9
|
profile: add vlm prefill profiler ranges (#30871)
|
2026-07-12 14:07:10 +08:00 |
|
|
Mick
|
bce3fc987d
|
perf: reuse MoonViT FA3 max-seqlen metadata (#30878)
|
2026-07-12 14:05:21 +08:00 |
|
|
Mick
|
a358abd651
|
chore: update vlm moe config and tune scripts (#30866)
|
2026-07-12 08:35:59 +08:00 |
|
|
Mohammad Miadh Angkad
|
14bef7cd11
|
fix: lazy load TileLang MHC kernels (#30580)
|
2026-07-12 08:32:27 +08:00 |
|
|
Mick
|
af66370d81
|
bench: support random image resolutions (#30879)
|
2026-07-12 08:28:56 +08:00 |
|
|
Liangsheng Yin
|
4884f6fbee
|
[Fix] Unify ForwardBatch extend lens cpu fields to their declared list type (#30896)
|
2026-07-11 17:30:53 -05:00 |
|
|
Liangsheng Yin
|
d8ef76682e
|
[Spec] Extract shared draft worker construction and generalize draft sampler capture (#30857)
|
2026-07-11 14:34:09 -05:00 |
|
|
Liangsheng Yin
|
348e6fd29b
|
[Fix] Guard kernel OOB accesses and harden runtime edge cases (#30847)
|
2026-07-11 14:22:13 -05:00 |
|
|
|
ed554aac17
|
Fix: add grammar sync in PP for structured output (#30747)
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: ziang663 <119752791+ziang663@users.noreply.github.com>
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
|
2026-07-12 02:54:50 +08:00 |
|
|
Ming YangandClaude
|
9b4bb415dd
|
[cuda-graph] Size breakable-graph shared buffer from warmup output; slice by produced row count (#30834)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-11 10:41:44 -07:00 |
|
|
iridiumine
|
268b8e127f
|
[NPU][bugfix] Fix NPU KernelLaunch Failure in rotate_input_ids_triton with Empty Batch (#30589)
|
2026-07-11 17:32:42 +08:00 |
|
|
Liangsheng Yin
|
7bac9c8cdb
|
[Spec] Enable draft extend cuda graph for DeepSeek-V4 attention backend (#30853)
|
2026-07-11 04:29:49 -05:00 |
|
|
Xiaoyu Zhang
|
65abb23842
|
Add diffusion BCG prompt conditioning guard (#30782)
|
2026-07-11 13:14:31 +08:00 |
|
|
Jae B.
|
a91c2e6596
|
[Apple Silicon] [CI] Move the MLX lane to the check-changes + pr-gate composite (#30121)
|
2026-07-10 22:00:15 -07:00 |
|
|
Lucia Fang
|
51c5ddbe65
|
[eplb] chunk expert-weight P2P on CUDA to prevent NCCL rebalance hang (#30829)
|
2026-07-10 21:45:17 -07:00 |
|
|
Baizhou Zhang
|
07165d5daa
|
Add DCP to runtime parallel context (#30478)
|
2026-07-10 21:23:41 -07:00 |
|
|
Lawrence WuandQiaolin Yu
|
bbcfcaeefe
|
fix(pd): do not abort when req.disagg_prefill_dp_rank is used (#27546)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-07-10 21:08:02 -07:00 |
|
|
Alison Shao
|
90688366d9
|
test(disagg): set MC_GID_INDEX on RoCE hosts so mooncake KV transfer works (#30737)
|
2026-07-11 11:29:22 +08:00 |
|
|
|
0663ebc783
|
[minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra (#28715)
Co-authored-by: Xinyuan Tong <xinyuan-tong@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-07-11 11:11:06 +08:00 |
|
|
Chenchen HongandXiaoyu Zhang
|
e3ceccf781
|
[dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-11 11:05:05 +08:00 |
|
|
Cheng Wan
|
fc2ef35308
|
[refactor] Move MLP collective flags onto ForwardFlags (#30802)
|
2026-07-10 17:43:39 -07:00 |
|
|
Yihao Wang
|
7de33ce806
|
fix: fix mm processor double bos (#26505)
|
2026-07-11 07:53:08 +08:00 |
|
|
Mick
|
649ce5dd3d
|
model: support Pi0.5 (#30633)
|
2026-07-11 07:50:58 +08:00 |
|
|
Lianmin ZhengandAbhishek Parmar
|
4fcc994be1
|
Support priority request header override (#30811)
Co-authored-by: Abhishek Parmar <abhishek@orng.net>
|
2026-07-10 14:36:43 -07:00 |
|
|
Baizhou Zhang
|
3f1694f5e0
|
Update sgl-deep-gemm to 0.1.4.post1 (#30697)
|
2026-07-10 13:30:43 -07:00 |
|
|
Lianmin Zheng
|
7998fecfd1
|
[kv canary] Support UnifiedRadixCache in kv-canary and bracket nested model.forward (#30574)
|
2026-07-10 10:58:55 -07:00 |
|
|
Lianmin ZhengandYonghao Zhuang
|
3dc93a12ca
|
Improve EPLB dispatch handling and diagnostics (#30646)
Co-authored-by: Yonghao Zhuang <yhzhuang@meta.com>
|
2026-07-10 10:40:19 -07:00 |
|
|
Zhangheng
|
0299393758
|
[UnifiedTree]: Sync mamba int8 checkpoint (#30626)
|
2026-07-10 23:46:38 +08:00 |
|
|
Mick
|
559854fe6a
|
[diffusion] docs: sync cookbook and log hygiene (#30791)
|
2026-07-10 22:55:14 +08:00 |
|
|
Zhangheng
|
2286e25a21
|
[UnifiedTree]: Sync Replay SSM (#30636)
|
2026-07-10 21:54:59 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
6ed9843b57
|
[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-10 21:41:08 +08:00 |
|
|
Xiaoyu Zhang
|
e9493a015c
|
Fix diffusion BCG lifetime and add Z-Image-Turbo CI (#30584)
|
2026-07-10 21:19:59 +08:00 |
|
|
|
94de28764c
|
Fix TiktokenTokenizer missing num_special_tokens_to_add (#30643)
Co-authored-by: Sushil Dubey <sushildubey171@users.noreply.github.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-07-10 12:37:30 +00:00 |
|
|
BingjiaWang
|
fd19a76237
|
[BUG] fix strip streaming empty-string suffix from DSV4 tool arguments (#29883)
|
2026-07-10 02:05:26 -07:00 |
|
|
Mohammad Miadh Angkad
|
ecb7fb3989
|
Fix CuTe DSL DSA paged MQA export (#30627)
|
2026-07-10 01:32:58 -07:00 |
|
|
Liangsheng Yin
|
fef5eda4fb
|
[Refactor] Split DeepSeek-V4 MQALayer into a reusable attention base (#30711)
|
2026-07-10 01:14:03 -07:00 |
|
|
Mick
|
4a8e1b07a2
|
[diffusion] refactor: reorganize runtime utility and server_args modules (#30447)
|
2026-07-10 15:53:00 +08:00 |
|
|
Junjie CaoandZhangheng
|
1d8e3c248b
|
Fix DSV4 HiSparse SWA tail allocation forwarding (#30408)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-07-10 15:27:02 +08:00 |
|
|
Xinyuan Tong
|
b76dd0be69
|
Fix Mistral GSM8K chat eval (#27757)
|
2026-07-09 21:08:48 -07:00 |
|
|
zhaozx-cn
|
7966f6be86
|
[NPU] fix npu import cutlass error (#30454)
|
2026-07-10 10:55:31 +08:00 |
|
|
|
edd91cbdd5
|
[diffusion] feat: support action output for cosmos3 (#27168)
Co-authored-by: Kedi Wu <kediw@nvidia.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-07-10 10:48:04 +08:00 |
|
|
weireweireandweireweire
|
5e3dc5dd5f
|
Fix immediate profiler step range boundary (#30215)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-07-09 19:47:23 -07:00 |
|
|
Liangsheng Yin
|
7b9b2e4798
|
[style] Extract init-static values in memory-cache path (#30710)
|
2026-07-09 19:38:15 -07:00 |
|
|
Liangsheng Yin
|
ccd2028def
|
[style] Extract init-static values in tokenizer + multimodal path (#30709)
|
2026-07-09 19:36:34 -07:00 |
|
|
Liangsheng Yin
|
dda61b476e
|
[style] Extract init-static values in forward path (#30708)
|
2026-07-09 19:35:00 -07:00 |
|