 Yuhao Yang
|
37f030a0de
|
[MoE] Decouple Mega MoE from DeepEP backend (#24884)
|
2026-05-15 02:01:44 +08:00 |
|
|
Le ZhangandClaude Opus 4.7
|
3fc60e5748
|
[MLX] bench_one_batch: thread --quantization through to MlxModelRunner (#25221)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-14 09:56:42 -07:00 |
|
|
Jae B.
|
90afd680f3
|
[Apple Silicon] [MLX] Auto-detect MLX-format quantization_config dict (#25191)
|
2026-05-14 09:55:37 -07:00 |
|
|
Liangsheng Yin
|
4593bbdf31
|
ci: dynamic partition + LPT from live sglang-ci-stats model (#25263)
|
2026-05-14 02:35:59 -07:00 |
|
|
Xingyu Liu
|
2279b79f35
|
Add --model-config-parser registry for pluggable config formats (#25050)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
|
2026-05-14 01:54:06 -07:00 |
|
|
YAMY
|
4be25f2428
|
fix(disagg): broadcast bootstrap port across multi-node prefill ranks (#24378)
|
2026-05-14 16:39:01 +08:00 |
|
|
|
bc265c5f82
|
[AMD] Add amd jit resolve token ids bench ci (#25210)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
|
2026-05-14 00:13:12 -07:00 |
|
|
|
7b128e143a
|
[AMD] Add amd jit clamp position bench ci (#25209)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
|
2026-05-14 00:03:56 -07:00 |
|
|
Yihao Wang
|
41eb2d861b
|
[fix] load_audio: fall back to soundfile when torchcodec fails on WAV with trailing metadata (#24185)
|
2026-05-14 15:02:49 +08:00 |
|
|
YC Yen-Ching Tseng
|
22bfae0d1d
|
[AMD] Auto-fallback NSA indexer to page_size=1 when aiter preshuffle gluon kernel is unavailable (Deepseek v3.2) (#25205)
|
2026-05-14 00:01:56 -07:00 |
|
|
Qiaolin Yu
|
421179c453
|
[perf] avoid hidden states d2h when return_hidden_states=false (#25155)
|
2026-05-13 23:47:17 -07:00 |
|
|
AndyLi429
|
3640116397
|
[NPU]Bugfix:Set default values for npu_wrapper_preprocess parameters (#25130)
|
2026-05-14 14:21:11 +08:00 |
|
|
|
be156d6804
|
[HiCache] enable ssd offload support for mooncake store (#24277)
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: stmatengss <11641725+stmatengss@users.noreply.github.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-05-13 23:07:02 -07:00 |
|
|
Ke Bao
|
e4378ff37f
|
[UnifiedRadixCache] Fix HiCache load back start node (#25088)
|
2026-05-14 13:18:12 +08:00 |
|
|
Tejas Dharamsi
|
c016246b0f
|
[Rerank] Early-exit logprob scan and hoist math import (#25046)
|
2026-05-13 22:01:07 -07:00 |
|
|
Piotr MazurekandPiotr Mazurek
|
a6a6c3119b
|
LFM2: pass has_initial_state to causal_conv1d_fn for prefill (#24717)
Co-authored-by: Piotr Mazurek <piotr.mazurek@liquid.ai>
|
2026-05-13 21:57:58 -07:00 |
|
|
Liangsheng Yin
|
5c11c2492f
|
ci: emit machine-readable TIMINGS block at end of run_unittest_files (#25232)
|
2026-05-13 21:56:54 -07:00 |
|
|
Pai Liu
|
fd889097dc
|
[Bug Fix] Add priority property to DecodeRequest to fix AttributeError with --enable-priority-scheduling (#25064)
|
2026-05-14 11:54:25 +08:00 |
|
|
|
c701a08765
|
feat: [2/2][DeepEP] Add waterfill load balancing for shared expert dispatch (#19290)
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
Co-authored-by: root <aichenf@nvidia.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-05-13 19:23:41 -07:00 |
|
|
Lianmin Zhengandcctry
|
5fb6bde6c0
|
Add sglang:get_loads_duration_seconds metric (#25163)
Co-authored-by: cctry <cctry@meta.com>
|
2026-05-13 18:38:49 -07:00 |
|
|
Baizhou Zhangandpranjalssh
|
b7f856df70
|
DeepSeek V4 w4a4 MegaMoE (#25052)
Co-authored-by: pranjalssh <adkz.photos@gmail.com>
|
2026-05-13 18:35:32 -07:00 |
|
|
|
34c0029f0a
|
[diffusion] [AMD] feat: support online MXFP4 and fp8 quantization (#21431)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-05-14 08:52:01 +08:00 |
|
|
Qiaolin Yu
|
7618ad7075
|
[attn backend] Integrate tokenspeed_mla prefill/decode kernels (fp8 kv cache, blackwell) (#24925)
|
2026-05-13 17:36:17 -07:00 |
|
|
Liangsheng Yin
|
22d3f3996c
|
ci: decouple stage and runner for cuda registry (#25197)
|
2026-05-13 17:28:21 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
6c0633b0b1
|
fix(nvfp4): make process_weights_after_loading hot-reload-safe via alias-when-same-shape (#25190)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-13 16:57:39 -07:00 |
|
|
shiyu7
|
37f18438c5
|
[rebase]Deepseek_v4 support w4(mxfp4)a16 on hopper (#24986)
|
2026-05-13 16:33:46 -07:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
371cb2ade2
|
[Bench] Add MEM profile activity to bench_serving (#25026)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-13 16:22:11 -07:00 |
|
|
ziang663
|
8438709e9c
|
Fix scheduler admission for near-full KV requests (#25126)
|
2026-05-13 15:30:49 -07:00 |
|
|
Liangsheng Yin
|
f9ff5fc154
|
multi_layer_eagle: add tracing hooks (#24858)
|
2026-05-13 15:29:38 -07:00 |
|
|
sglang-botandClaude Opus 4.7
|
0a2615df24
|
chore: add vLLM SPDX copyright headers to ported files (#25182)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-05-13 15:17:30 -07:00 |
|
|
Yanbin Jiangandgh1595
|
01a225ac6f
|
[LoRA] MLA attention LoRA: q_b_proj / kv_b_proj support (#25001)
Co-authored-by: gh1595 <278903827+gh1595@users.noreply.github.com>
|
2026-05-13 15:15:30 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
28758d37dd
|
Add FlashInfer SM90 cutlass MXFP4 MoE backend (W4A16) for GPT-OSS + DeepSeek-V4 (#24816)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-13 14:53:18 -07:00 |
|
|
shuwennandClaude Opus 4.7
|
d6b28b4a69
|
[Refactor] Remove dead key_convert_fn / convert_to_bigram_key (#25161)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-13 13:54:36 -07:00 |
|
|
Ata Fatahi
|
3178a70577
|
[PD Disaggregation] Fix priority scheduling in PD disaggregation mode (#25062)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
|
2026-05-13 11:43:21 -07:00 |
|
|
oriandzhiguo.qin
|
22012ba1bc
|
Add BF16 support to EP-MoE for DeepGEMM (#17392)
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
|
2026-05-13 11:06:37 -07:00 |
|
|
Le Zhangandlezhang
|
6ac30192fa
|
[MLX] Add on-the-fly --quantization mlx_q4 / mlx_q8 for Apple Silicon (#24907)
Co-authored-by: lezhang <lezhang@local>
|
2026-05-13 11:06:13 -07:00 |
|
|
Mick
|
ff70aeac30
|
[diffusion] feat: add performance mode server args (#24491)
|
2026-05-14 00:57:46 +08:00 |
|
|
|
e2290b155a
|
Port KV Compression V2 from deepseek_v4_dev (#24890)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-05-13 22:40:38 +08:00 |
|
|
|
d0913fca8d
|
Port fused SiLU+clamp+FP8 quant from DSV4 dev branch (#24897)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: zcnrex <zcnrex@gmail.com>
|
2026-05-13 22:36:44 +08:00 |
|
|
litangss
|
9e00b7ca95
|
[NPU] add zbal support for npu (#24575)
|
2026-05-13 20:52:42 +08:00 |
|
|
|
2a4d382b07
|
[Disagg][NIXL] Add staging buffer support for heterogeneous TP KV transfer (#22536)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-13 19:54:02 +08:00 |
|
|
YC Yen-Ching Tseng
|
cf92ccbf18
|
[AMD] Run jit kernel PR test through run_suite.py register mechanism (#24987)
|
2026-05-13 02:57:08 -07:00 |
|
|
Jacob0226
|
fc20f5b114
|
[AMD] Skip redundant CatArrayBatchedCopy in GLM-5 NSA TileLang decode (#24125)
|
2026-05-13 02:55:28 -07:00 |
|
|
Thomas Wang
|
a9359707c1
|
[AMD] Enable preshuffle paged MQA and page_size=64 for NSA indexer (#23562)
|
2026-05-13 02:33:57 -07:00 |
|
|
McZyWu
|
9d0be860a4
|
[NPU] recover accuracy for gemma3-4b-it from 54% to 72% (reduced by transformer5.3) (#21537)
|
2026-05-13 16:46:04 +08:00 |
|
|
|
d8f7b78a29
|
[diffusion] fix: plumb max_sequence_length via diffusers_kwargs (#20930)
Co-authored-by: jiangqc <jqc1569978990@gmail.com>
Co-authored-by: jiangqianchen <jiangqianchen@xiaohongshu.com>
|
2026-05-13 16:32:47 +08:00 |
|
|
Lukas HumbelandClaude Sonnet 4.6
|
c32f2dc1ac
|
fix(nixl): close file descriptors after each FILE transfer (#24671)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-05-13 00:34:52 -07:00 |
|
|
Matti Varjokallio
|
839f7f2696
|
[AMD] Add _skip_rope_for_aiter_fused_mla method and check to avoid double rotating with gfx950 and Aiter backend (#24148)
|
2026-05-13 00:27:09 -07:00 |
|
|
Baizhou Zhang
|
51a9403104
|
Update flashinfer to 0.6.11.post1 (#25129)
|
2026-05-13 00:12:19 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
f2a90094c9
|
bench: fix wrong flag names in bench_one_batch{,_server} docstrings (#25143)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-12 23:46:47 -07:00 |
|