|
ed554aac17
|
Fix: add grammar sync in PP for structured output (#30747)
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: ziang663 <119752791+ziang663@users.noreply.github.com>
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
|
2026-07-12 02:54:50 +08:00 |
|
|
Ming YangandClaude
|
9b4bb415dd
|
[cuda-graph] Size breakable-graph shared buffer from warmup output; slice by produced row count (#30834)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-11 10:41:44 -07:00 |
|
|
iridiumine
|
268b8e127f
|
[NPU][bugfix] Fix NPU KernelLaunch Failure in rotate_input_ids_triton with Empty Batch (#30589)
|
2026-07-11 17:32:42 +08:00 |
|
|
Liangsheng Yin
|
7bac9c8cdb
|
[Spec] Enable draft extend cuda graph for DeepSeek-V4 attention backend (#30853)
|
2026-07-11 04:29:49 -05:00 |
|
|
Xiaoyu Zhang
|
65abb23842
|
Add diffusion BCG prompt conditioning guard (#30782)
|
2026-07-11 13:14:31 +08:00 |
|
|
Jae B.
|
a91c2e6596
|
[Apple Silicon] [CI] Move the MLX lane to the check-changes + pr-gate composite (#30121)
|
2026-07-10 22:00:15 -07:00 |
|
|
Lucia Fang
|
51c5ddbe65
|
[eplb] chunk expert-weight P2P on CUDA to prevent NCCL rebalance hang (#30829)
|
2026-07-10 21:45:17 -07:00 |
|
|
Baizhou Zhang
|
07165d5daa
|
Add DCP to runtime parallel context (#30478)
|
2026-07-10 21:23:41 -07:00 |
|
|
Lawrence WuandQiaolin Yu
|
bbcfcaeefe
|
fix(pd): do not abort when req.disagg_prefill_dp_rank is used (#27546)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-07-10 21:08:02 -07:00 |
|
|
Alison Shao
|
90688366d9
|
test(disagg): set MC_GID_INDEX on RoCE hosts so mooncake KV transfer works (#30737)
|
2026-07-11 11:29:22 +08:00 |
|
|
|
0663ebc783
|
[minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra (#28715)
Co-authored-by: Xinyuan Tong <xinyuan-tong@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-07-11 11:11:06 +08:00 |
|
|
Chenchen HongandXiaoyu Zhang
|
e3ceccf781
|
[dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-11 11:05:05 +08:00 |
|
|
Cheng Wan
|
fc2ef35308
|
[refactor] Move MLP collective flags onto ForwardFlags (#30802)
|
2026-07-10 17:43:39 -07:00 |
|
|
Yihao Wang
|
7de33ce806
|
fix: fix mm processor double bos (#26505)
|
2026-07-11 07:53:08 +08:00 |
|
|
Mick
|
649ce5dd3d
|
model: support Pi0.5 (#30633)
|
2026-07-11 07:50:58 +08:00 |
|
|
Lianmin ZhengandAbhishek Parmar
|
4fcc994be1
|
Support priority request header override (#30811)
Co-authored-by: Abhishek Parmar <abhishek@orng.net>
|
2026-07-10 14:36:43 -07:00 |
|
|
Baizhou Zhang
|
3f1694f5e0
|
Update sgl-deep-gemm to 0.1.4.post1 (#30697)
|
2026-07-10 13:30:43 -07:00 |
|
|
Lianmin Zheng
|
7998fecfd1
|
[kv canary] Support UnifiedRadixCache in kv-canary and bracket nested model.forward (#30574)
|
2026-07-10 10:58:55 -07:00 |
|
|
Lianmin ZhengandYonghao Zhuang
|
3dc93a12ca
|
Improve EPLB dispatch handling and diagnostics (#30646)
Co-authored-by: Yonghao Zhuang <yhzhuang@meta.com>
|
2026-07-10 10:40:19 -07:00 |
|
|
Zhangheng
|
0299393758
|
[UnifiedTree]: Sync mamba int8 checkpoint (#30626)
|
2026-07-10 23:46:38 +08:00 |
|
|
Mick
|
559854fe6a
|
[diffusion] docs: sync cookbook and log hygiene (#30791)
|
2026-07-10 22:55:14 +08:00 |
|
|
Zhangheng
|
2286e25a21
|
[UnifiedTree]: Sync Replay SSM (#30636)
|
2026-07-10 21:54:59 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
6ed9843b57
|
[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-10 21:41:08 +08:00 |
|
|
Xiaoyu Zhang
|
e9493a015c
|
Fix diffusion BCG lifetime and add Z-Image-Turbo CI (#30584)
|
2026-07-10 21:19:59 +08:00 |
|
|
|
94de28764c
|
Fix TiktokenTokenizer missing num_special_tokens_to_add (#30643)
Co-authored-by: Sushil Dubey <sushildubey171@users.noreply.github.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-07-10 12:37:30 +00:00 |
|
|
BingjiaWang
|
fd19a76237
|
[BUG] fix strip streaming empty-string suffix from DSV4 tool arguments (#29883)
|
2026-07-10 02:05:26 -07:00 |
|
|
Mohammad Miadh Angkad
|
ecb7fb3989
|
Fix CuTe DSL DSA paged MQA export (#30627)
|
2026-07-10 01:32:58 -07:00 |
|
|
Liangsheng Yin
|
fef5eda4fb
|
[Refactor] Split DeepSeek-V4 MQALayer into a reusable attention base (#30711)
|
2026-07-10 01:14:03 -07:00 |
|
|
Mick
|
4a8e1b07a2
|
[diffusion] refactor: reorganize runtime utility and server_args modules (#30447)
|
2026-07-10 15:53:00 +08:00 |
|
|
Junjie CaoandZhangheng
|
1d8e3c248b
|
Fix DSV4 HiSparse SWA tail allocation forwarding (#30408)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-07-10 15:27:02 +08:00 |
|
|
Xinyuan Tong
|
b76dd0be69
|
Fix Mistral GSM8K chat eval (#27757)
|
2026-07-09 21:08:48 -07:00 |
|
|
zhaozx-cn
|
7966f6be86
|
[NPU] fix npu import cutlass error (#30454)
|
2026-07-10 10:55:31 +08:00 |
|
|
|
edd91cbdd5
|
[diffusion] feat: support action output for cosmos3 (#27168)
Co-authored-by: Kedi Wu <kediw@nvidia.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-07-10 10:48:04 +08:00 |
|
|
weireweireandweireweire
|
5e3dc5dd5f
|
Fix immediate profiler step range boundary (#30215)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-07-09 19:47:23 -07:00 |
|
|
Liangsheng Yin
|
7b9b2e4798
|
[style] Extract init-static values in memory-cache path (#30710)
|
2026-07-09 19:38:15 -07:00 |
|
|
Liangsheng Yin
|
ccd2028def
|
[style] Extract init-static values in tokenizer + multimodal path (#30709)
|
2026-07-09 19:36:34 -07:00 |
|
|
Liangsheng Yin
|
dda61b476e
|
[style] Extract init-static values in forward path (#30708)
|
2026-07-09 19:35:00 -07:00 |
|
|
Liangsheng Yin
|
b5e75b9423
|
[style] Extract init-static values in scheduler hot path (#30707)
|
2026-07-09 19:33:02 -07:00 |
|
|
Mick
|
5ce5e1ee3e
|
[Diffusion] Revert CPU AMX optimizations (#30716)
|
2026-07-10 09:09:38 +08:00 |
|
|
fzyzcjy
|
1e75ba236e
|
Avoid implicit field-based side channel in Scheduler planning (#29408)
|
2026-07-10 08:55:51 +08:00 |
|
|
Lianmin Zhengandtanujtiwari1998
|
32c8973ce8
|
Configurable decode retraction order (#30573)
Co-authored-by: tanujtiwari1998 <168470992+tanujtiwari1998@users.noreply.github.com>
|
2026-07-09 17:55:26 -07:00 |
|
|
fzyzcjy
|
5be9c9f7c6
|
Localize cur_batch field in Scheduler to avoid field-based state access (#29407)
|
2026-07-10 08:55:06 +08:00 |
|
|
fzyzcjy
|
69368d7593
|
Stop reading cur_batch in is_fully_idle and abort_request (#29406)
|
2026-07-10 08:54:31 +08:00 |
|
|
|
2e66707399
|
Fix pipeline-parallel abort missing in-flight requests in non-current microbatch slots (#29405)
Co-authored-by: burling <3637497+burling@users.noreply.github.com>
Co-authored-by: zhaotyer <89376832+zhaotyer@users.noreply.github.com>
|
2026-07-10 08:53:18 +08:00 |
|
|
|
2c6cd1ef41
|
[Dep] Upgrade flashinfer to 0.6.14 (#29910)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-07-09 17:52:33 -07:00 |
|
|
Even Zhou
|
b2f9a95867
|
[NPU] use standalone group for moe ep (#29030)
|
2026-07-10 08:49:49 +08:00 |
|
|
Mohammad Miadh Angkad
|
295f85df08
|
Fix DFlash mamba verify init ordering (#30680)
|
2026-07-09 17:40:12 -07:00 |
|
|
Lianmin Zhengandtanujtiwari1998
|
cfc66e05c5
|
[tokenizer] Support pluggable tokenizer worker class in multi-tokenizer mode (#30630)
Co-authored-by: tanujtiwari1998 <168470992+tanujtiwari1998@users.noreply.github.com>
|
2026-07-09 17:31:54 -07:00 |
|
|
|
87992eeec4
|
[DeepSeek V2] Reorder dual-stream MoE to main-first to avoid CUDA graph stream explosion (#30460)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Jiminator <jimmysh341@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-09 16:59:39 -07:00 |
|
|
Liangsheng Yin
|
504570f425
|
[Refactor] Make DeepSeek-V4 attention backend tolerate an absent CPU seq_lens mirror (#30695)
|
2026-07-09 16:39:47 -07:00 |
|