|
9fec359a60
|
[Fix] Load HunyuanV3 NextN final_layernorm into the draft head's output norm (#30331)
Co-authored-by: Auroter <auroter@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 20:37:36 +08:00 |
|
|
Yichao Cheng
|
a74bee2261
|
[PD] Handle NIXL abort notifications (#30352)
|
2026-07-13 05:05:25 -07:00 |
|
|
xutizhou
|
eb31b5310c
|
Support Waterfill with MegaMoE backend (#27350)
|
2026-07-13 03:56:46 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
874fc07d9b
|
[Kernel] Migrate scattered quantization kernels to sglang.kernels (RFC #29630, Phase 2.5, 1/7) (#30784)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 16:17:01 +08:00 |
|
|
|
08d6d297e5
|
[Bugfix][NPU] Fix Hunyuan3 model where MoE's routing_scaling_ratio is missing on NPU (#29909)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-13 09:48:41 +03:00 |
|
|
Baizhou Zhang
|
82e7cdcff9
|
[Misc] Remove a few dead code paths in DSA (#30973)
|
2026-07-12 23:25:03 -07:00 |
|
|
shuwenn
|
9dd57ef8c4
|
[mem_cache][7/N] refactor: move MLATokenToKVPoolHost to pool_host.mla (#30616)
|
2026-07-13 14:23:38 +08:00 |
|
|
Mohammad Miadh Angkad
|
cbcbef6811
|
[Bugfix] Fix Nemotron ForwardFlags across custom op boundary (#30968)
|
2026-07-12 22:10:23 -07:00 |
|
|
yz-wqf
|
4cec9ef9d7
|
[Fix] Forward on_after_cuda_graph_warmup through HybridLinearAttnBackend (#30846)
|
2026-07-13 09:40:52 +08:00 |
|
|
Lianmin ZhengandLu Fang
|
22c08a9bee
|
Preserve RMSNorm shape in batch-invariant mode (#30956)
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
|
2026-07-12 17:51:53 -07:00 |
|
|
Mick
|
7da30f4e55
|
feat: enable piecewise prefill graph for Kimi K2.5/K2.7 (#30889)
|
2026-07-13 08:37:30 +08:00 |
|
|
Lianmin Zheng
|
b94ac87e0c
|
Enable breakable prefill CUDA graph for DP attention (#30898)
|
2026-07-12 17:10:04 -07:00 |
|
|
cctry
|
c616d5a55e
|
[PD] Improve optimistic prefill (#30951)
|
2026-07-12 15:31:53 -07:00 |
|
|
|
6cc9352dfe
|
[Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-07-12 17:25:26 -05:00 |
|
|
Liangsheng Yin
|
5ba3c5147e
|
[Spec] Add kill-switch env for draft-extend CUDA graph capture (#30944)
|
2026-07-12 14:54:36 -05:00 |
|
|
Lianmin ZhengandJialin Ouyang
|
539253e1d5
|
Gate Rust extension builds (#30927)
Co-authored-by: Jialin Ouyang <jialino@meta.com>
|
2026-07-12 05:44:58 -07:00 |
|
|
Yonghao Zhuang
|
80856aba85
|
Make the mxfp8 MoE runner backend list extensible (#30828)
|
2026-07-12 01:28:10 -07:00 |
|
|
Lianmin ZhengandYongji Wu
|
81d273f73b
|
Handle coredump dirs and cache hit updates (#30897)
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-07-12 00:37:43 -07:00 |
|
|
Mick
|
f1c247edf9
|
profile: add vlm prefill profiler ranges (#30871)
|
2026-07-12 14:07:10 +08:00 |
|
|
Mick
|
bce3fc987d
|
perf: reuse MoonViT FA3 max-seqlen metadata (#30878)
|
2026-07-12 14:05:21 +08:00 |
|
|
Mick
|
a358abd651
|
chore: update vlm moe config and tune scripts (#30866)
|
2026-07-12 08:35:59 +08:00 |
|
|
Mohammad Miadh Angkad
|
14bef7cd11
|
fix: lazy load TileLang MHC kernels (#30580)
|
2026-07-12 08:32:27 +08:00 |
|
|
Mick
|
af66370d81
|
bench: support random image resolutions (#30879)
|
2026-07-12 08:28:56 +08:00 |
|
|
Liangsheng Yin
|
4884f6fbee
|
[Fix] Unify ForwardBatch extend lens cpu fields to their declared list type (#30896)
|
2026-07-11 17:30:53 -05:00 |
|
|
Liangsheng Yin
|
d8ef76682e
|
[Spec] Extract shared draft worker construction and generalize draft sampler capture (#30857)
|
2026-07-11 14:34:09 -05:00 |
|
|
Liangsheng Yin
|
348e6fd29b
|
[Fix] Guard kernel OOB accesses and harden runtime edge cases (#30847)
|
2026-07-11 14:22:13 -05:00 |
|
|
|
ed554aac17
|
Fix: add grammar sync in PP for structured output (#30747)
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: ziang663 <119752791+ziang663@users.noreply.github.com>
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
|
2026-07-12 02:54:50 +08:00 |
|
|
Ming YangandClaude
|
9b4bb415dd
|
[cuda-graph] Size breakable-graph shared buffer from warmup output; slice by produced row count (#30834)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-11 10:41:44 -07:00 |
|
|
iridiumine
|
268b8e127f
|
[NPU][bugfix] Fix NPU KernelLaunch Failure in rotate_input_ids_triton with Empty Batch (#30589)
|
2026-07-11 17:32:42 +08:00 |
|
|
Liangsheng Yin
|
7bac9c8cdb
|
[Spec] Enable draft extend cuda graph for DeepSeek-V4 attention backend (#30853)
|
2026-07-11 04:29:49 -05:00 |
|
|
Xiaoyu Zhang
|
65abb23842
|
Add diffusion BCG prompt conditioning guard (#30782)
|
2026-07-11 13:14:31 +08:00 |
|
|
Jae B.
|
a91c2e6596
|
[Apple Silicon] [CI] Move the MLX lane to the check-changes + pr-gate composite (#30121)
|
2026-07-10 22:00:15 -07:00 |
|
|
Lucia Fang
|
51c5ddbe65
|
[eplb] chunk expert-weight P2P on CUDA to prevent NCCL rebalance hang (#30829)
|
2026-07-10 21:45:17 -07:00 |
|
|
Baizhou Zhang
|
07165d5daa
|
Add DCP to runtime parallel context (#30478)
|
2026-07-10 21:23:41 -07:00 |
|
|
Lawrence WuandQiaolin Yu
|
bbcfcaeefe
|
fix(pd): do not abort when req.disagg_prefill_dp_rank is used (#27546)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-07-10 21:08:02 -07:00 |
|
|
Alison Shao
|
90688366d9
|
test(disagg): set MC_GID_INDEX on RoCE hosts so mooncake KV transfer works (#30737)
|
2026-07-11 11:29:22 +08:00 |
|
|
|
0663ebc783
|
[minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra (#28715)
Co-authored-by: Xinyuan Tong <xinyuan-tong@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-07-11 11:11:06 +08:00 |
|
|
Chenchen HongandXiaoyu Zhang
|
e3ceccf781
|
[dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-11 11:05:05 +08:00 |
|
|
Cheng Wan
|
fc2ef35308
|
[refactor] Move MLP collective flags onto ForwardFlags (#30802)
|
2026-07-10 17:43:39 -07:00 |
|
|
Yihao Wang
|
7de33ce806
|
fix: fix mm processor double bos (#26505)
|
2026-07-11 07:53:08 +08:00 |
|
|
Mick
|
649ce5dd3d
|
model: support Pi0.5 (#30633)
|
2026-07-11 07:50:58 +08:00 |
|
|
Lianmin ZhengandAbhishek Parmar
|
4fcc994be1
|
Support priority request header override (#30811)
Co-authored-by: Abhishek Parmar <abhishek@orng.net>
|
2026-07-10 14:36:43 -07:00 |
|
|
Baizhou Zhang
|
3f1694f5e0
|
Update sgl-deep-gemm to 0.1.4.post1 (#30697)
|
2026-07-10 13:30:43 -07:00 |
|
|
Lianmin Zheng
|
7998fecfd1
|
[kv canary] Support UnifiedRadixCache in kv-canary and bracket nested model.forward (#30574)
|
2026-07-10 10:58:55 -07:00 |
|
|
Lianmin ZhengandYonghao Zhuang
|
3dc93a12ca
|
Improve EPLB dispatch handling and diagnostics (#30646)
Co-authored-by: Yonghao Zhuang <yhzhuang@meta.com>
|
2026-07-10 10:40:19 -07:00 |
|
|
Zhangheng
|
0299393758
|
[UnifiedTree]: Sync mamba int8 checkpoint (#30626)
|
2026-07-10 23:46:38 +08:00 |
|
|
Mick
|
559854fe6a
|
[diffusion] docs: sync cookbook and log hygiene (#30791)
|
2026-07-10 22:55:14 +08:00 |
|
|
Zhangheng
|
2286e25a21
|
[UnifiedTree]: Sync Replay SSM (#30636)
|
2026-07-10 21:54:59 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
6ed9843b57
|
[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-10 21:41:08 +08:00 |
|
|
Xiaoyu Zhang
|
e9493a015c
|
Fix diffusion BCG lifetime and add Z-Image-Turbo CI (#30584)
|
2026-07-10 21:19:59 +08:00 |
|