 sglang-botandClaude Opus 4.7
|
0a2615df24
|
chore: add vLLM SPDX copyright headers to ported files (#25182)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-05-13 15:17:30 -07:00 |
|
|
Yanbin Jiangandgh1595
|
01a225ac6f
|
[LoRA] MLA attention LoRA: q_b_proj / kv_b_proj support (#25001)
Co-authored-by: gh1595 <278903827+gh1595@users.noreply.github.com>
|
2026-05-13 15:15:30 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
28758d37dd
|
Add FlashInfer SM90 cutlass MXFP4 MoE backend (W4A16) for GPT-OSS + DeepSeek-V4 (#24816)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-13 14:53:18 -07:00 |
|
|
shuwennandClaude Opus 4.7
|
d6b28b4a69
|
[Refactor] Remove dead key_convert_fn / convert_to_bigram_key (#25161)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-13 13:54:36 -07:00 |
|
|
Ata Fatahi
|
3178a70577
|
[PD Disaggregation] Fix priority scheduling in PD disaggregation mode (#25062)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
|
2026-05-13 11:43:21 -07:00 |
|
|
oriandzhiguo.qin
|
22012ba1bc
|
Add BF16 support to EP-MoE for DeepGEMM (#17392)
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
|
2026-05-13 11:06:37 -07:00 |
|
|
Le Zhangandlezhang
|
6ac30192fa
|
[MLX] Add on-the-fly --quantization mlx_q4 / mlx_q8 for Apple Silicon (#24907)
Co-authored-by: lezhang <lezhang@local>
|
2026-05-13 11:06:13 -07:00 |
|
|
Mick
|
ff70aeac30
|
[diffusion] feat: add performance mode server args (#24491)
|
2026-05-14 00:57:46 +08:00 |
|
|
|
e2290b155a
|
Port KV Compression V2 from deepseek_v4_dev (#24890)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-05-13 22:40:38 +08:00 |
|
|
|
d0913fca8d
|
Port fused SiLU+clamp+FP8 quant from DSV4 dev branch (#24897)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: zcnrex <zcnrex@gmail.com>
|
2026-05-13 22:36:44 +08:00 |
|
|
litangss
|
9e00b7ca95
|
[NPU] add zbal support for npu (#24575)
|
2026-05-13 20:52:42 +08:00 |
|
|
|
2a4d382b07
|
[Disagg][NIXL] Add staging buffer support for heterogeneous TP KV transfer (#22536)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-13 19:54:02 +08:00 |
|
|
YC Yen-Ching Tseng
|
cf92ccbf18
|
[AMD] Run jit kernel PR test through run_suite.py register mechanism (#24987)
|
2026-05-13 02:57:08 -07:00 |
|
|
Jacob0226
|
fc20f5b114
|
[AMD] Skip redundant CatArrayBatchedCopy in GLM-5 NSA TileLang decode (#24125)
|
2026-05-13 02:55:28 -07:00 |
|
|
Thomas Wang
|
a9359707c1
|
[AMD] Enable preshuffle paged MQA and page_size=64 for NSA indexer (#23562)
|
2026-05-13 02:33:57 -07:00 |
|
|
McZyWu
|
9d0be860a4
|
[NPU] recover accuracy for gemma3-4b-it from 54% to 72% (reduced by transformer5.3) (#21537)
|
2026-05-13 16:46:04 +08:00 |
|
|
|
d8f7b78a29
|
[diffusion] fix: plumb max_sequence_length via diffusers_kwargs (#20930)
Co-authored-by: jiangqc <jqc1569978990@gmail.com>
Co-authored-by: jiangqianchen <jiangqianchen@xiaohongshu.com>
|
2026-05-13 16:32:47 +08:00 |
|
|
Lukas HumbelandClaude Sonnet 4.6
|
c32f2dc1ac
|
fix(nixl): close file descriptors after each FILE transfer (#24671)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-05-13 00:34:52 -07:00 |
|
|
Matti Varjokallio
|
839f7f2696
|
[AMD] Add _skip_rope_for_aiter_fused_mla method and check to avoid double rotating with gfx950 and Aiter backend (#24148)
|
2026-05-13 00:27:09 -07:00 |
|
|
Baizhou Zhang
|
51a9403104
|
Update flashinfer to 0.6.11.post1 (#25129)
|
2026-05-13 00:12:19 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
f2a90094c9
|
bench: fix wrong flag names in bench_one_batch{,_server} docstrings (#25143)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-12 23:46:47 -07:00 |
|
|
billishyahaoandDuyi-Wang
|
66a9234246
|
[AMD] support fp8 blockwise quantization combine for mori ep (#24879)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-05-12 23:24:40 -07:00 |
|
|
Khoa Pham
|
c665edec6e
|
[env] Make max KV chunk capacity configurable via SGLANG_MAX_KV_CHUNK_CAPACITY (#25120)
|
2026-05-12 22:37:45 -07:00 |
|
|
Liangsheng Yin
|
adae4042a7
|
spec: defer verify() idle hidden_size to worker fixup (#25109)
|
2026-05-12 22:13:52 -07:00 |
|
|
RulinJuiceandRulinJuice
|
3f048c80b8
|
Reject repetition_penalty=0 in SamplingParams.verify() (#24874)
Co-authored-by: RulinJuice <265952454+RulinJuice@users.noreply.github.com>
|
2026-05-12 21:25:23 -07:00 |
|
|
|
4e35c30cbe
|
[Bugfix, NSA HiCache] Fix missing override_kv_cache_dim in attach_hybrid_nsa_pool_to_hiradix_cache (#25022)
Co-authored-by: Taegeon Um <taegeon.um@samsung.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-05-13 11:45:08 +08:00 |
|
|
shuwenn
|
5ed9a494d0
|
[UnifiedTree] fix: allow partial match on evicted+backuped nodes (#24943)
|
2026-05-13 11:43:12 +08:00 |
|
|
ZhanghengandJINZ
|
6140e45ef3
|
[UnifiedTree]: Fix the leaf determination logic in _cascade_evict. (#25068)
Co-authored-by: JINZ <1023553676@qq.com>
|
2026-05-13 10:57:32 +08:00 |
|
|
sky
|
409d350fb6
|
Bugfix: fix symm not enabled due to incorrect registration of comm (#19329)
Signed-off-by: wangfakang <fakangwang@gmail.com>
|
2026-05-13 10:01:04 +08:00 |
|
|
chenxu214
|
642ac9c916
|
[NPU]pp support mla kv transfer (#23893)
|
2026-05-13 09:10:02 +08:00 |
|
|
|
d6d3d0f599
|
Optimize SWA memory preallocation for disaggregated decode (#24857)
Co-authored-by: weireweire <weiliangl@nvidia.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
|
2026-05-13 09:09:34 +08:00 |
|
|
Cheng WanandClaude Opus 4.7
|
4fb40bffac
|
perf(nvfp4): free unused source scales after weight processing (#25107)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-12 16:53:50 -07:00 |
|
|
Emmanuel AcheampongandClaude Sonnet 4.6
|
b49d05fd0e
|
feat: add Crusoe managed inference backend (#20475)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-05-12 16:23:23 -07:00 |
|
|
Khoa Pham
|
49ac447c94
|
[bench] Agentic support for bench_serving.py (#25016)
|
2026-05-12 16:00:45 -07:00 |
|
|
YAMY
|
a4109e87ac
|
Fix TRTLLM MHA routing for draft extend (#24856)
|
2026-05-12 15:48:32 -07:00 |
|
|
Brayden Zhongandb8zhong
|
d5f3254ed1
|
[Dependency] Flashinfer 0.6.8post1 -> 0.6.11 (#24452)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-12 14:38:32 -07:00 |
|
|
Lianmin Zheng
|
48fc26a814
|
Fix Eagle draft decode positions (#25015)
|
2026-05-12 14:04:58 -07:00 |
|
|
Kaixi Hou
|
486b54714b
|
[NVIDIA] Deterministic inference backend order on Blackwell (#21450)
|
2026-05-12 13:35:50 -07:00 |
|
|
Polisetty V R K Jyothendra VarmaandBrayden Zhong
|
52d4c697bb
|
Fix fused_moe import for non-NPU devices (#25076)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-05-12 23:05:51 +03:00 |
|
|
flutist-alibaba
|
00d8730d05
|
[Bug Fix] Fix broken sgemm_lora_a_graph_fwd due to invalid torch.mm() call (#24760)
|
2026-05-12 22:29:01 +03:00 |
|
|
Alison Shao
|
1419bcc39e
|
[CI] Temporarily disable multimodal-gen test_update_weights_from_disk (flaky) (#25032)
|
2026-05-12 12:28:33 -07:00 |
|
|
Liangsheng YinandQiaolin Yu
|
538832c8b7
|
spec: STANDALONE skips hidden_states end-to-end (Optional schema + None-safe consumers) (#25037)
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
|
2026-05-12 12:27:21 -07:00 |
|
|
|
e86fb42736
|
feat: emit per-iteration forward pass metrics via ZMQ PUB (#22789)
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-05-12 10:28:17 -07:00 |
|
|
Ke Bao
|
6be1a45d99
|
Fix swa component host hit (#25085)
|
2026-05-12 21:03:39 +08:00 |
|
|
iridiumineandiridiumine
|
693f49793a
|
[NPU] use causal_conv1d_update_v2 for performance (#24595)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
|
2026-05-12 17:04:02 +08:00 |
|
|
Praneth Paruchuri
|
1efe9e2164
|
[Bug Fix] Reject incompatible combination of --disable-cuda-graph-padding and --enable-torch-compile (#23903)
|
2026-05-12 16:18:36 +08:00 |
|
|
lw9527
|
8d27ce7371
|
Optimize uvicorn startup command (#25041)
|
2026-05-12 00:28:13 -07:00 |
|
|
Yihao Wang
|
b35fd5f104
|
[fix] skip legacy minicpmv conv template for MiniCPM-V 4.6 (#24998)
|
2026-05-12 15:27:28 +08:00 |
|
|
Yuwei AnandClaude Opus 4.7
|
7582237f8e
|
[Tiny Fix] Disable BCG when inner layer_model unresolved (#25021)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-12 14:51:27 +08:00 |
|
|
zhangxiaolei
|
ca3bc05fea
|
Deepseek-v4-Pro share expert tp1 (#24949)
|
2026-05-11 23:19:35 -07:00 |
|