 Andy Ye
|
d389039337
|
[diffusion] Opt in Qwen and Wan multi-output conditioning expansion (#31233)
|
2026-07-17 12:00:23 -07:00 |
|
|
fanxingranandkk
|
fec6131844
|
[AMD] Disable DSA fused top-k v2 on ROCm for GLM-5.x / DeepSeek-V3.2 (#30506)
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
|
2026-07-17 10:22:14 -07:00 |
|
|
Muhammad Safiullah MemonandMuhammad Safiullah
|
2db21daf8d
|
Fix Heartbeat Checker in KV Manager Disaggregation (#31584)
Co-authored-by: Muhammad Safiullah <muhammadsafiullah136@gmail.com>
|
2026-07-18 01:21:50 +08:00 |
|
|
Zhaoyi LiandMichael
|
2c64b7782e
|
[AMD][PD] Fix early-send cached-prefix KV racing the prefill forward on mori (#31368)
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
|
2026-07-17 10:08:04 -07:00 |
|
|
NOOBandR0CKSTAR
|
5e7eed4c00
|
[MLX] Honor --max-running-requests in the model runner stub (#30547)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-07-17 08:24:00 -07:00 |
|
|
Mick
|
681c223570
|
refactor: wrap split backends once on full-attention backends (#31439)
|
2026-07-17 19:15:04 +08:00 |
|
|
Mick
|
24a8944e15
|
fix: enable Kimi multimodal breakable prefill cuda graph replay (#31391)
|
2026-07-17 19:13:54 +08:00 |
|
|
|
132ade55cd
|
[Kernel] Rewrite JIT custom all-reduce (v2) with a decoupled kernel/storage design (#31049)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: root <root@GPUC5A6.maas>
|
2026-07-17 18:37:22 +08:00 |
|
|
Liangsheng Yin
|
19f4859b30
|
[CI] Exclude current process memory from GPU idle check (#31571)
|
2026-07-17 02:11:41 -07:00 |
|
|
Mohammad Miadh AngkadandBrayden Zhong
|
d67aa05697
|
Bump FlashInfer to 0.6.15 and revert regressions (#31502)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-07-17 00:50:12 -07:00 |
|
|
huangtingweiandZhangheng
|
44e3dd2713
|
[HiCache] Optimize HiCache host pool free-list release (#30658)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-07-17 14:52:08 +08:00 |
|
|
Liangsheng Yin
|
6e3be088a9
|
[Spec] Allocate the verify tree-mask scratch on the target backend only (#31527)
|
2026-07-16 23:23:21 -07:00 |
|
|
Junlin Wu
|
bbd2a3fe4a
|
✨ [llm][npu][quant] Add W4A4 MXFP4 quantization support for Qwen3 Dense on Ascend NPU (#23795)
|
2026-07-17 09:06:30 +03:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
1ac1ffea0c
|
[Kernel] Fill non-CUDA coverage: HIP (aiter/rocm-triton) + Ascend NPU backends (RFC #29630) (#31307)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-17 14:05:35 +08:00 |
|
|
Khoa PhamandCursor
|
96dd96c02b
|
[DCP] Auto-disable tc_piecewise and breakable prefill CUDA graphs under DCP (#31532)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-07-16 22:17:50 -07:00 |
|
|
Khoa Phamandkpham-sgl
|
d310fce85f
|
[Fix] Update PR #25015 revert for fused topk=1 draft postprocess (#31519)
Co-authored-by: kpham-sgl <kpham-sgl@users.noreply.github.com>
|
2026-07-16 21:51:16 -07:00 |
|
|
Khoa Phamandkpham-sgl
|
ead703815e
|
[DCP] Enable decode context parallel for Kimi K2.5 NVFP4 (#31514)
Co-authored-by: kpham-sgl <kpham-sgl@users.noreply.github.com>
|
2026-07-16 21:50:42 -07:00 |
|
|
AuFlowandAuFlow
|
bf417440e9
|
[Scheduler] Add SGLANG_MAX_NEW_TOKENS_LIMIT to cap per-request max_new_tokens (#22591)
Co-authored-by: AuFlow <AuFlow@users.noreply.github.com>
|
2026-07-16 21:34:10 -07:00 |
|
|
Liangsheng Yin
|
45824c69ca
|
fa3: build the topk>1 verify replay page table on-device (#31381)
|
2026-07-16 21:21:01 -07:00 |
|
|
Liangsheng Yin
|
27ad9d11b1
|
[CI] Wait for GPU memory release before each test class setUpClass (#31509)
|
2026-07-16 21:06:29 -07:00 |
|
|
Peng Xingchen
|
12af7e6c34
|
[NPU] Fix DSA top-k seed buffer shape for MTP IndexShare (#31005)
|
2026-07-17 12:05:57 +08:00 |
|
|
Liangsheng Yin
|
dfa6278370
|
[Fix] Publish idle scheduler metrics immediately when the running-reqs gauge is stale (#31517)
|
2026-07-16 21:04:10 -07:00 |
|
|
Liangsheng Yin
|
9910ef8167
|
flashmla: sync-free spec via device-side draft-extend (#31090)
|
2026-07-16 19:38:12 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
8432eafd3d
|
[Kernel] Decouple KernelBackend from device + device-based CapabilityRequirement (RFC #29630) (#31292)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-17 10:35:34 +08:00 |
|
|
amote-i
|
68d324d697
|
[PD] Fix send_multipart blocking after prefill failure (#31306)
|
2026-07-17 10:33:29 +08:00 |
|
|
Sam Shleifer
|
0675d3033f
|
Fix mamba track-boundary seqlen under overlap scheduler (#31369)
|
2026-07-17 10:22:07 +08:00 |
|
|
Polisetty V R K Jyothendra VarmaandRahul Vijayaraghavan
|
37f94cb7a0
|
[Intel GPU] DeepSeek V4 13/N: use sgl-kernel implementation of kernels in V2 Compressor to run on XPU (#28439)
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
|
2026-07-17 09:16:04 +08:00 |
|
|
ZiruandNiu Ziru
|
302c3b97d2
|
fix: Qwen3.5-35B-A3B-AWQ w2_weight KeyError and related params for CPU (#31174)
Co-authored-by: Niu Ziru <niuziru@a4bf018d3341.jf.intel.com>
|
2026-07-17 09:14:55 +08:00 |
|
|
jiayisunx
|
27ea5ed070
|
[XPU] Fix dtype mismatch in MRotaryEmbedding.forward_xpu by calling _… (#31441)
|
2026-07-17 09:14:25 +08:00 |
|
|
Kaixi
|
dc0b3eb68f
|
[2/3] [EAGLE] perf: Fuse TP vocab-parallel embedding (#30948)
|
2026-07-16 15:57:51 -07:00 |
|
|
Kaixi
|
d539bf2cda
|
[1/3] [EAGLE] perf: Fuse topk=1 draft postprocess (#30947)
|
2026-07-16 15:57:27 -07:00 |
|
|
Yoray Zack
|
77d23a796e
|
[1/N] elastic-ep: Add runtime EP scale-up (#30164)
|
2026-07-16 15:53:44 -07:00 |
|
|
cctryandZhiqiang Xie
|
d28e35b1a1
|
Fix num_running_reqs gauge on disagg prefill servers (#31495)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-07-16 15:43:06 -07:00 |
|
|
Bob ChenandZhiqiang Xie
|
7cd55c6818
|
[HiCache] Optimize L2 mem allocation when cache miss in L3 (#19320)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-07-16 15:00:53 -07:00 |
|
|
Liangsheng Yin
|
9a4d640244
|
[Perf] Cache uniform ragged-verify layout for DSpark verify-all compact (#31434)
|
2026-07-16 15:00:41 -07:00 |
|
|
Liangsheng Yin
|
fc1e3797b7
|
[Spec] Split the capture width from num_tokens_per_req and gate replay on it (#31255)
|
2026-07-16 14:59:11 -07:00 |
|
|
Alison Shao
|
059ac7efe8
|
Don't fail server startup when psutil can't parse /proc/meminfo (GB300 ShadowCallStack) (#31098)
|
2026-07-16 14:57:34 -07:00 |
|
|
yuyu5333andzekai
|
bff489284b
|
[Feature] Support DeepSeek-V4 Wint4Abf16 and Win4Afp8. (#25763)
Co-authored-by: zekai <zekai01@antgroup.com>
|
2026-07-16 14:24:34 -07:00 |
|
|
Liangsheng Yin
|
44f4ea917c
|
fa3: sync-free eagle spec via fixed-window draft-extend metadata (#31364)
|
2026-07-16 12:31:50 -07:00 |
|
|
Serge Panev
|
1f34911de7
|
[NemotronH] Load shared embed_tokens/lm_head in MTP draft weights (#30456)
|
2026-07-16 17:20:38 +00:00 |
|
|
Elizaveta Martirosianandronnie_zheng
|
3bc7c54111
|
[NPU] Updated baselines for GLM-Image (#31467)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-16 20:16:07 +03:00 |
|
|
pllimax
|
4ad418d2c3
|
Push test case scripts from test repo to main upstream community repository (#31114)
|
2026-07-16 21:24:01 +08:00 |
|
|
Mick
|
7d0fd5101d
|
optimization: shard kimi dp image feature transport and misc optimizations (#31227)
|
2026-07-16 20:31:42 +08:00 |
|
|
jojoandhzh0425
|
b296e1a503
|
[hicache]: add mamba concurrency io transfer kernel (#30535)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-07-16 18:13:02 +08:00 |
|
|
Wang, FangYuan
|
e2d021d4ab
|
[AMD] Support two batch overlap with MTP on DeepSeekV4 (#30238)
|
2026-07-16 02:34:04 -07:00 |
|
|
|
e5f9804e26
|
Refining fused A GEMM dispatch (#31241)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-16 16:57:01 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
a798a2aeea
|
[GDN/KDA] Fuse SM100 CuteDSL prefill state I/O into the chunk h kernel (#30169)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-07-16 16:40:33 +08:00 |
|
|
|
db7e6807de
|
[BugFix] Preserve tokenizer worker fanout when skip_tokenizer_init is enabled (#30682)
Co-authored-by: hjzhang <zhanghjzzz@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-07-16 01:29:46 -07:00 |
|
|
zhengyao
|
01b003255a
|
[AMD]Reuse fused FP8 KV cache write on standard aiter prefill/decode (#26852)
|
2026-07-16 01:05:04 -07:00 |
|
|
Liangsheng Yin
|
b55228cfdb
|
[Spec] Consolidate the verify step into eagle_worker_common.run_eagle_verify (#31380)
|
2026-07-16 00:56:54 -07:00 |
|