|
47483001b6
|
[PrefillDelayer] support NCCL all-gather for cross-DP info sync (#24768)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 21:20:03 -07:00 |
|
|
|
7edb4c3cea
|
[NUMA+Ray] Fix NUMA NVML handle resolution under shuffled CUDA_VISIBLE_DEVICES (#24766)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 21:18:39 -07:00 |
|
|
Liangsheng Yin
|
c95454b341
|
speculative: drop dead params/returns/no-ops (#24865)
|
2026-05-09 15:53:31 -07:00 |
|
|
Charles Chen
|
12f42f2e7e
|
Support Gemma3/4 + Eagle3 (#23976)
|
2026-05-09 13:34:56 -07:00 |
|
|
luchangliandZhangheng
|
8087e07d52
|
[UnifiedRadixTree]: Align cache_empty_result with RadixTree (#24779)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-05-09 23:52:22 +08:00 |
|
|
|
ef5e9f8aba
|
[DSV4] Cherry pick missing commits from deepseek_v4 branch and enhance tests (#24793)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
|
2026-05-09 04:15:37 -07:00 |
|
|
Brayden Zhongandb8zhong
|
4b23f6bdc5
|
Fix performance regression on Deepseek V3 on moe-runner-backend=triton on SM90 (#24562)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 03:49:12 -07:00 |
|
|
Brayden Zhongandb8zhong
|
05d1ab51e8
|
Enable PDL for various kernels in DSV32/GLM5 (#23965)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 03:42:56 -07:00 |
|
|
shuwenn
|
d5564c2a96
|
fix(fa3): translate page table to SWA loc in EAGLE3 topk>1 spec metadata (#24617)
|
2026-05-09 18:22:45 +08:00 |
|
|
JoyFuture
|
a309f1f8f4
|
fix(cuda_graph): zero out_cache_loc_swa on pad and use int32 (hybrid-SWA accuracy fix) (#24743)
|
2026-05-09 18:22:12 +08:00 |
|
|
Brayden Zhongandb8zhong
|
f4b7e73699
|
Enable trtllm-gen BF16 MoE for MTP (#24260)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 03:14:17 -07:00 |
|
|
sglang-npu-bot
|
f1a9a455e0
|
Revert "[NPU] fix profiler on npu" (#24815)
|
2026-05-09 17:53:02 +08:00 |
|
|
zhaozx-cn
|
e2527df8b6
|
[NPU] fix profiler on npu (#24685)
Signed-off-by: zhaozx-cn <zhaozx2116@163.com>
|
2026-05-09 17:48:24 +08:00 |
|
|
Jia Guo
|
fd636410a2
|
Restrict fa_skip_kv_cache to non-MLA backends (#24097)
|
2026-05-09 09:25:02 +00:00 |
|
|
Brayden Zhongandb8zhong
|
8f33bee31b
|
Reland Cute-DSL FP4 dense GEMM (#23590)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 02:20:58 -07:00 |
|
|
Yuxuan Zhang
|
d49fc092cb
|
[Bug Fix] GLM-5.1: drop constexpr on page_indice_batch_offset, skip offloader post_init on draft worker, support N=32 in copy_to_gpu_no_ce (#23550)
|
2026-05-09 15:43:45 +08:00 |
|
|
Liangsheng Yin
|
78da0d3106
|
[Spec] Move accept_tokens off EagleDraftInput; pass via method arg (#24735)
|
2026-05-08 23:24:18 -07:00 |
|
|
Chi McIsaac
|
8e534e8f15
|
[diffusion] fix: fix diffusers executor crash when component residency manager is absent (#24573)
|
2026-05-09 11:45:06 +08:00 |
|
|
storyicon
|
590b13b513
|
[diffusion] fix: fix NCCL deadlock in ulysses sp when sequence length has remainder (#24694)
Signed-off-by: storyicon <storyicon@foxmail.com>
|
2026-05-09 11:05:37 +08:00 |
|
|
Polisetty V R K Jyothendra VarmaandMa Mingfei
|
50ed01674e
|
fix is_arch_support_pdl function usage (#24600)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-05-09 09:39:34 +08:00 |
|
|
Liangsheng Yin
|
1613bae412
|
[Spec] Disambiguate verified_id into bonus_token(s) / accept_tokens (#24724)
|
2026-05-08 18:24:33 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
a61a14f416
|
[KDA] Optimize prefill kernels with diagonal and recompute fuse (#24271)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-09 08:52:51 +08:00 |
|
|
Brayden Zhongandb8zhong
|
9ee830346f
|
Disable Custom AR V2 when in multi-node (#24729)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-08 17:50:05 -07:00 |
|
|
|
d1c5937428
|
env: add SGLANG_RADIX_FORCE_MISS to force radix prefix-cache miss (#24726)
Co-authored-by: sihan-zzz <228612289+sihan-zzz@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-08 17:46:38 -07:00 |
|
|
YAMY
|
560829a171
|
feat(scheduler): add adaptive queue-based prefill delayer trigger (#23189)
|
2026-05-08 16:54:30 -07:00 |
|
|
YAMY
|
6971a03fe6
|
fix(fa3): skip scheduler_metadata precompute under DP attention (#24632)
|
2026-05-08 16:19:20 -07:00 |
|
|
Niko Ma
|
62c2e091f6
|
[PD] MORI-IO: Add state transfer, inline transfer model, and high-concurrency fixes (#22665)
|
2026-05-08 16:07:22 -07:00 |
|
|
Jimmy Shongandgemini-code-assist[bot]
|
fa8985486e
|
[test/fix]: isolate VLM MMMU eval output dirs to fix nightly-4-gpu cross-test pollution (#24623)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-05-08 15:01:53 -07:00 |
|
|
Jimmy Shong
|
096ad02b06
|
[Model] Laguna-XS.2 Model Support (#24204)
|
2026-05-09 05:43:13 +08:00 |
|
|
Cheng Wan
|
7b707c9222
|
disable the combination of --enable-two-batch-overlap and --enforce-s… (#24720)
|
2026-05-08 14:27:35 -07:00 |
|
|
Yuhao Yang
|
09912fd89d
|
Remove unnecessary bf16 assert in rotate_activation (#24686)
|
2026-05-09 05:00:52 +08:00 |
|
|
Yilong Zhao
|
f30d1d0b0a
|
logits: remove blocking H2D copy (#24627)
|
2026-05-08 13:22:13 -07:00 |
|
|
Ethan Feng
|
672f778512
|
[NemotronH] Fix expert scale weight loading (#24434)
|
2026-05-08 12:37:06 -07:00 |
|
|
zhongdaor-nvandzhongdaor-nv
|
2cf1a4ab38
|
feat: Add KV events for Mamba radix cache (#23678)
Signed-off-by: zhongdaor-nv <220807034+zhongdaor-nv@users.noreply.github.com>
Co-authored-by: zhongdaor-nv <220807034+zhongdaor-nv@users.noreply.github.com>
|
2026-05-08 11:53:36 -07:00 |
|
|
Lianmin Zheng
|
e40e339c72
|
Filter non-int token ids in benchmark and observe decode-side bootstrap/alloc metrics (#24684)
|
2026-05-08 11:45:37 -07:00 |
|
|
Mick
|
73b8eda103
|
[diffusion] fix: fix FA3 varlen out argument handling (#24688)
|
2026-05-08 19:01:49 +08:00 |
|
|
fanxingranandfanxingran
|
7f8e7a9130
|
fix(aiter): drop FP8 KV upcast; use native FP8 path in paged_attentio… (#24129)
Co-authored-by: fanxingran <fanxingran@amd.com>
|
2026-05-08 02:47:48 -07:00 |
|
|
jacky.cheng
|
f21d4868dc
|
[AMD] Replace naive triton RMSNorm with aiter RMSNorm for diffusion model (#24360)
|
2026-05-08 02:44:13 -07:00 |
|
|
YC Yen-Ching Tseng
|
e1150f66db
|
[AMD][diffusion] Temporal-unfolded batched Conv2D for ROCm VAE decode (#22971)
|
2026-05-08 02:32:14 -07:00 |
|
|
Brayden Zhongandb8zhong
|
80d0226b68
|
Turn on JIT custom AR implementation by default (#24363)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-08 02:05:31 -07:00 |
|
|
HAI
|
73792629d4
|
[AMD] Intro SGLANG_DIFFUSION_AITER_FP8_ATTN (#24677)
|
2026-05-08 01:31:00 -07:00 |
|
|
jacky.cheng
|
b22d3cd606
|
[AMD] Support fp8 MLA for diffusion model (#20319)
|
2026-05-08 00:56:24 -07:00 |
|
|
Yibo Cai
|
55d8223c2b
|
[sgl-kernel/cpu] support w8a8 int8 model for arm cpu (#16045)
skip gpu test as this one is not related to gpu backend.
|
2026-05-08 14:47:06 +08:00 |
|
|
JoyFuture
|
e1bc001872
|
fix(mimo_v2): auto-disable multimodal when vision/audio configs are absent (#24652)
|
2026-05-08 13:40:08 +08:00 |
|
|
maocheng23andlawrence-harmonic
|
7deed98e1b
|
[fix] /pause_generation and /continue_generation wrong for --tokenizer-worker-num > 1 (#24462)
Co-authored-by: lawrence-harmonic <185285563+lawrence-harmonic@users.noreply.github.com>
|
2026-05-07 21:32:21 -07:00 |
|
|
Mick
|
2afb450501
|
[diffusion] optimize: optimize frame returns path (#24616)
|
2026-05-08 12:10:09 +08:00 |
|
|
|
cdf5771f91
|
[MUSA][17/N] ci: Add MUSA diffusion, sgl-kernel tests, and CI workflow support (#20672)
Co-authored-by: ximin.chen <ximin.chen@mthreads.com>
Co-authored-by: R0CKSTAR <xiaodong.ye@mthreads.com>
|
2026-05-07 20:45:21 -07:00 |
|
|
|
5fa3bb2eaf
|
Enable flashinfer::trtllm_allreduce_fusion with PDL (#23765)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-05-08 10:41:10 +08:00 |
|
|
shuwennandQiaolin-Yu
|
d9dddd4d7d
|
[SPEC V2][2/N] feat: adaptive spec support spec v2 (#23336)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2026-05-07 18:33:47 -07:00 |
|
|
+6
|
35870d55ac
|
Deepseek V4 (#23882)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
|
2026-05-07 18:32:21 -07:00 |
|