Commit Graph
12617 Commits
Author SHA1 Message Date
Kangyan-ZhouandClaude Opus 4.7 e8d57e7243 [SMG] Fix cache-aware policy pool isolation in PD mode (#25184)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 20:07:14 -07:00
Liangsheng Yin e51bde1e9f fix: prefix matching against matrix-expanded job names (#25212) 2026-05-13 20:02:57 -07:00
Khoa PhamandClaude Opus 4.7 856f13a916 chore(codeowners): add kpham-sgl to frozen_kv_mtp files (#25211)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 20:01:05 -07:00
c701a08765 feat: [2/2][DeepEP] Add waterfill load balancing for shared expert dispatch (#19290)
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
Co-authored-by: root <aichenf@nvidia.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-05-13 19:23:41 -07:00
jundu 426dd339da Migrate Intel CPU cases to the test/registered (#25139) 2026-05-14 10:22:09 +08:00
amote-i 65e9f81c7d [NPU] [DOC] add performance testing and optimization docs for npu (#25114) 2026-05-14 09:47:55 +08:00
Kangyan-ZhouandClaude 992fc0d6fe ci(sgl-kernel-build): actually reclaim disk in the wheel-build cleanup step (#25206)
Co-authored-by: Claude <noreply@anthropic.com>
2026-05-13 18:45:48 -07:00
Alison Shao 1e308aec66 ci: B200 conditional split + LPT_SLOP removal (stage-c partition 8→3) (#25203) 2026-05-13 18:40:45 -07:00
Lianmin Zhengandcctry 5fb6bde6c0 Add sglang:get_loads_duration_seconds metric (#25163)
Co-authored-by: cctry <cctry@meta.com>
2026-05-13 18:38:49 -07:00
Baizhou Zhangandpranjalssh b7f856df70 DeepSeek V4 w4a4 MegaMoE (#25052)
Co-authored-by: pranjalssh <adkz.photos@gmail.com>
2026-05-13 18:35:32 -07:00
34c0029f0a [diffusion] [AMD] feat: support online MXFP4 and fp8 quantization (#21431)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-05-14 08:52:01 +08:00
Kangyan-ZhouandClaude Opus 4.7 af7511e0e8 [sgl-model-gateway] Close PyO3 binding gaps and add regression tests (#24719)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 17:43:01 -07:00
Qiaolin Yu 7618ad7075 [attn backend] Integrate tokenspeed_mla prefill/decode kernels (fp8 kv cache, blackwell) (#24925) 2026-05-13 17:36:17 -07:00
Liangsheng Yin 22d3f3996c ci: decouple stage and runner for cuda registry (#25197) 2026-05-13 17:28:21 -07:00
Alison Shao dd98153d17 chore(ci_monitor): drop post_bisect_to_slack (#25192) 2026-05-13 17:05:38 -07:00
Cheng WanandClaude Opus 4.7 6c0633b0b1 fix(nvfp4): make process_weights_after_loading hot-reload-safe via alias-when-same-shape (#25190)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 16:57:39 -07:00
shiyu7 37f18438c5 [rebase]Deepseek_v4 support w4(mxfp4)a16 on hopper (#24986) 2026-05-13 16:33:46 -07:00
Khoa PhamandClaude Opus 4.7 371cb2ade2 [Bench] Add MEM profile activity to bench_serving (#25026)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 16:22:11 -07:00
Liangsheng Yin 9a32a0272f ci: compute matrix partition counts from est_time (#25193) 2026-05-13 16:18:54 -07:00
ziang663 8438709e9c Fix scheduler admission for near-full KV requests (#25126) 2026-05-13 15:30:49 -07:00
Liangsheng Yin f9ff5fc154 multi_layer_eagle: add tracing hooks (#24858) 2026-05-13 15:29:38 -07:00
sglang-botandClaude Opus 4.7 0a2615df24 chore: add vLLM SPDX copyright headers to ported files (#25182)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-13 15:17:30 -07:00
Yanbin Jiangandgh1595 01a225ac6f [LoRA] MLA attention LoRA: q_b_proj / kv_b_proj support (#25001)
Co-authored-by: gh1595 <278903827+gh1595@users.noreply.github.com>
2026-05-13 15:15:30 -07:00
Yuan Luoandluoyuan.luo 28758d37dd Add FlashInfer SM90 cutlass MXFP4 MoE backend (W4A16) for GPT-OSS + DeepSeek-V4 (#24816)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-05-13 14:53:18 -07:00
shuwennandClaude Opus 4.7 d6b28b4a69 [Refactor] Remove dead key_convert_fn / convert_to_bigram_key (#25161)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 13:54:36 -07:00
Liangsheng Yin 4d91a4f3a1 ci: merge sgl-kernel-build-wheels x86+arm into reusable workflow (#25135) 2026-05-13 13:51:59 -07:00
Kangyan-ZhouandClaude Opus 4.7 b1db9f71ee [SMG] Fix matrix-sibling concurrency collision in PR Test (SMG) (#25188)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 13:25:40 -07:00
Cheng WanandClaude Opus 4.7 72b49bfac6 docker, ci: swap GB DeepEP source from fzyzcjy fork to deepseek-ai/DeepEP@hybrid-ep (#25113)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 13:25:15 -07:00
Ata Fatahi 3178a70577 [PD Disaggregation] Fix priority scheduling in PD disaggregation mode (#25062)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2026-05-13 11:43:21 -07:00
oriandzhiguo.qin 22012ba1bc Add BF16 support to EP-MoE for DeepGEMM (#17392)
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
2026-05-13 11:06:37 -07:00
Le Zhangandlezhang 6ac30192fa [MLX] Add on-the-fly --quantization mlx_q4 / mlx_q8 for Apple Silicon (#24907)
Co-authored-by: lezhang <lezhang@local>
2026-05-13 11:06:13 -07:00
Mick ff70aeac30 [diffusion] feat: add performance mode server args (#24491) 2026-05-14 00:57:46 +08:00
e2290b155a Port KV Compression V2 from deepseek_v4_dev (#24890)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: DarkSharpness <2040703891@qq.com>
2026-05-13 22:40:38 +08:00
d0913fca8d Port fused SiLU+clamp+FP8 quant from DSV4 dev branch (#24897)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: zcnrex <zcnrex@gmail.com>
2026-05-13 22:36:44 +08:00
litangss 9e00b7ca95 [NPU] add zbal support for npu (#24575) 2026-05-13 20:52:42 +08:00
Shangming CaiandHanHan009527 4984552cc9 Fix tests for decode radix cache (#25145)
Co-authored-by: HanHan009527 <hanhan7630@outlook.com>
2026-05-13 20:31:44 +08:00
2a4d382b07 [Disagg][NIXL] Add staging buffer support for heterogeneous TP KV transfer (#22536)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-05-13 19:54:02 +08:00
Shangming Cai 5227b07669 [CI] Add DSV4 Flash disaggregation test (#24973)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-05-13 18:42:42 +08:00
YC Yen-Ching Tseng cf92ccbf18 [AMD] Run jit kernel PR test through run_suite.py register mechanism (#24987) 2026-05-13 02:57:08 -07:00
Jacob0226 fc20f5b114 [AMD] Skip redundant CatArrayBatchedCopy in GLM-5 NSA TileLang decode (#24125) 2026-05-13 02:55:28 -07:00
Thomas Wang a9359707c1 [AMD] Enable preshuffle paged MQA and page_size=64 for NSA indexer (#23562) 2026-05-13 02:33:57 -07:00
Lianmin Zheng 1ae3218d03 Add jasonjk-park and charlotte12l to CI_PERMISSIONS.json (#25104) 2026-05-13 01:51:05 -07:00
McZyWu 9d0be860a4 [NPU] recover accuracy for gemma3-4b-it from 54% to 72% (reduced by transformer5.3) (#21537) 2026-05-13 16:46:04 +08:00
d8f7b78a29 [diffusion] fix: plumb max_sequence_length via diffusers_kwargs (#20930)
Co-authored-by: jiangqc <jqc1569978990@gmail.com>
Co-authored-by: jiangqianchen <jiangqianchen@xiaohongshu.com>
2026-05-13 16:32:47 +08:00
zijiexiaandClaude Opus 4.7 7d515c6d1f docs: prepend SGLANG_JIT_DEEPGEMM_PRECOMPILE=0 for H200 FP8 Flash max-throughput (#25152)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 00:50:15 -07:00
Lukas HumbelandClaude Sonnet 4.6 c32f2dc1ac fix(nixl): close file descriptors after each FILE transfer (#24671)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-13 00:34:52 -07:00
Matti Varjokallio 839f7f2696 [AMD] Add _skip_rope_for_aiter_fused_mla method and check to avoid double rotating with gfx950 and Aiter backend (#24148) 2026-05-13 00:27:09 -07:00
Baizhou Zhang 51a9403104 Update flashinfer to 0.6.11.post1 (#25129) 2026-05-13 00:12:19 -07:00
Goalina 10a005e4ea [CI][NPU] use internal HTTP cache for Rust toolchain via RUSTUP_CACHE (#24801) 2026-05-13 09:58:07 +03:00
Cheng WanandClaude Opus 4.7 f2a90094c9 bench: fix wrong flag names in bench_one_batch{,_server} docstrings (#25143)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-12 23:46:47 -07:00