 Yuwei AnandClaude Opus 4.7
|
5207f074a4
|
Breakable Cuda Graph Support for bs > 1 (#24662)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-11 13:28:49 +08:00 |
|
|
Ming Yang
|
8e2142c15a
|
[MoE] Fix NaN in flashinfer TRT-LLM A2A dispatch by sanitizing padding slots (#24850)
|
2026-05-10 21:57:43 -07:00 |
|
|
Tejas Dharamsi
|
a6f359d103
|
[Rerank] Use heapq.nlargest for top_n to avoid full sort (#24871)
|
2026-05-10 21:48:37 -07:00 |
|
|
|
36c93fc6fb
|
[NPU] [Diffusion] Use fused operator to improve Wan model E2E performance. (#24028)
Co-authored-by: gengjinsong <gengjinsong@huawei.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gengjinsong <904939979@qq.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-11 07:17:31 +03:00 |
|
|
iridiumineandiridiumine
|
09a4828db9
|
[NPU] Fix warmup error with --disable-cuda-graph and mtp (#23819)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
|
2026-05-11 09:53:34 +08:00 |
|
|
McZyWu
|
4435a23a51
|
[NPU]adapt multibatch fia ops (#20177)
|
2026-05-11 09:44:14 +08:00 |
|
|
silencejade
|
407665a7d4
|
[NPU] Fix mrope_position computation in Eagle Worker v2 with PlanStream (#23423)
|
2026-05-11 09:43:37 +08:00 |
|
|
silencejade
|
0fc9598b3e
|
[NPU] Support radix-cache with mamba-extra-buffer for Qwen3.5 (#23891)
|
2026-05-11 09:40:44 +08:00 |
|
|
Jimmy Shong
|
e9a15b95da
|
[Fix] Disable FlashInfer allreduce fusion under deterministic inference (#24629)
|
2026-05-10 20:04:52 -05:00 |
|
|
|
aa7a9af12f
|
fix: STANDALONE spec-decode hidden-size mismatch crash (#24217)
Co-authored-by: root <root@sharp-heart-runs-fin-03.datacrunch.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-05-10 17:48:00 -07:00 |
|
|
Brayden Zhongandb8zhong
|
8acb0270fd
|
Followup fix for Custom AR V2 in non NVL scenarios (#24742)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-10 16:57:46 -07:00 |
|
|
YAMY
|
b202778aa5
|
Fix reduce_scatterv producer contract for SUM_LEN (#24785)
|
2026-05-10 16:51:13 -07:00 |
|
|
|
d82e339ce2
|
[Session R3] Add routed_experts_start_len for absolute routing slice control (#24851)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
Co-authored-by: Yuzhen Zhou <82826991+zyzshishui@users.noreply.github.com>
|
2026-05-10 10:04:43 -07:00 |
|
|
Yihao Wang
|
9150e77399
|
[Model] Add MiniCPM-V 4.6 support (#24855)
|
2026-05-10 12:24:17 -04:00 |
|
|
RunningLeon
|
335dbd60b4
|
Support Intern-S2-Preview (#24875)
|
2026-05-10 22:17:30 +08:00 |
|
|
Ke Bao
|
59faf986b2
|
[PD] Unify dsv4 dispatch with swa (#24888)
|
2026-05-10 22:01:13 +08:00 |
|
|
|
2f06867128
|
Optimize MHC pipeline: DeepGemm, fused norm, fused hc_head (#24775)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
|
2026-05-10 19:03:37 +08:00 |
|
|
Yuhao YangandCheng Wan
|
bd0aa22309
|
Fix PD bootstrap failure handling (#24772)
Co-authored-by: Cheng Wan <chwan@rice.edu>
|
2026-05-10 19:02:47 +08:00 |
|
|
Liangsheng Yin
|
8cc16c9974
|
[Spec] Cleanup idle stub and shape-check patterns (#24881)
|
2026-05-10 02:39:53 -07:00 |
|
|
|
c7f674e427
|
[Bug] Add dsv4 state_type branch to mooncake disaggregation (#24878)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-10 01:13:46 -07:00 |
|
|
Liangsheng Yin
|
d08744238a
|
[Spec V1] Split draft-extend phase from EagleDraftInput into new EagleDraftExtendInput (#24859)
|
2026-05-10 01:07:45 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
d3fd91ed97
|
[Gemma4] Optimize Gemm4 with fused Q/K/V RMSNorm + per-expert FP8 ckpt loader (#24696)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-10 00:24:12 -07:00 |
|
|
Qiaolin Yu
|
a87fb399de
|
[spec decoding] support kimi-k2.5-eagle3-mla (#24826)
|
2026-05-09 23:57:39 -07:00 |
|
|
shuwenn
|
b4d347e86e
|
[SPEC V2] fix: skip stale state updates in spec-v2 overlap (#23456)
|
2026-05-09 23:56:24 -07:00 |
|
|
|
cfd3fd00d0
|
[RL] Call torch.cuda.empty_cache() for in-place pause mode to avoid OOM (#24854)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 23:36:52 -07:00 |
|
|
Chi McIsaac
|
44efc23a9a
|
[diffusion] CI: add cache-dit CI tests (#19213)
|
2026-05-10 13:38:41 +08:00 |
|
|
|
1e6c6d1f07
|
[Utils] Make request dump robust to unpicklable server_args and large meta_info (#24767)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 21:41:41 -07:00 |
|
|
Stefan HeandBiao He
|
9578ba1b57
|
[Utils] Refactor device cache emptying (#24861)
Co-authored-by: Biao He <biao@Biaos-MacBook-Air.local>
|
2026-05-09 21:28:00 -07:00 |
|
|
|
47483001b6
|
[PrefillDelayer] support NCCL all-gather for cross-DP info sync (#24768)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 21:20:03 -07:00 |
|
|
|
7edb4c3cea
|
[NUMA+Ray] Fix NUMA NVML handle resolution under shuffled CUDA_VISIBLE_DEVICES (#24766)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 21:18:39 -07:00 |
|
|
Liangsheng Yin
|
c95454b341
|
speculative: drop dead params/returns/no-ops (#24865)
|
2026-05-09 15:53:31 -07:00 |
|
|
Charles Chen
|
12f42f2e7e
|
Support Gemma3/4 + Eagle3 (#23976)
|
2026-05-09 13:34:56 -07:00 |
|
|
luchangliandZhangheng
|
8087e07d52
|
[UnifiedRadixTree]: Align cache_empty_result with RadixTree (#24779)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-05-09 23:52:22 +08:00 |
|
|
|
ef5e9f8aba
|
[DSV4] Cherry pick missing commits from deepseek_v4 branch and enhance tests (#24793)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
|
2026-05-09 04:15:37 -07:00 |
|
|
Brayden Zhongandb8zhong
|
4b23f6bdc5
|
Fix performance regression on Deepseek V3 on moe-runner-backend=triton on SM90 (#24562)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 03:49:12 -07:00 |
|
|
Brayden Zhongandb8zhong
|
05d1ab51e8
|
Enable PDL for various kernels in DSV32/GLM5 (#23965)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 03:42:56 -07:00 |
|
|
shuwenn
|
d5564c2a96
|
fix(fa3): translate page table to SWA loc in EAGLE3 topk>1 spec metadata (#24617)
|
2026-05-09 18:22:45 +08:00 |
|
|
JoyFuture
|
a309f1f8f4
|
fix(cuda_graph): zero out_cache_loc_swa on pad and use int32 (hybrid-SWA accuracy fix) (#24743)
|
2026-05-09 18:22:12 +08:00 |
|
|
Brayden Zhongandb8zhong
|
f4b7e73699
|
Enable trtllm-gen BF16 MoE for MTP (#24260)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 03:14:17 -07:00 |
|
|
sglang-npu-bot
|
f1a9a455e0
|
Revert "[NPU] fix profiler on npu" (#24815)
|
2026-05-09 17:53:02 +08:00 |
|
|
zhaozx-cn
|
e2527df8b6
|
[NPU] fix profiler on npu (#24685)
Signed-off-by: zhaozx-cn <zhaozx2116@163.com>
|
2026-05-09 17:48:24 +08:00 |
|
|
Jia Guo
|
fd636410a2
|
Restrict fa_skip_kv_cache to non-MLA backends (#24097)
|
2026-05-09 09:25:02 +00:00 |
|
|
Brayden Zhongandb8zhong
|
8f33bee31b
|
Reland Cute-DSL FP4 dense GEMM (#23590)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 02:20:58 -07:00 |
|
|
Yuxuan Zhang
|
d49fc092cb
|
[Bug Fix] GLM-5.1: drop constexpr on page_indice_batch_offset, skip offloader post_init on draft worker, support N=32 in copy_to_gpu_no_ce (#23550)
|
2026-05-09 15:43:45 +08:00 |
|
|
Liangsheng Yin
|
78da0d3106
|
[Spec] Move accept_tokens off EagleDraftInput; pass via method arg (#24735)
|
2026-05-08 23:24:18 -07:00 |
|
|
Chi McIsaac
|
8e534e8f15
|
[diffusion] fix: fix diffusers executor crash when component residency manager is absent (#24573)
|
2026-05-09 11:45:06 +08:00 |
|
|
storyicon
|
590b13b513
|
[diffusion] fix: fix NCCL deadlock in ulysses sp when sequence length has remainder (#24694)
Signed-off-by: storyicon <storyicon@foxmail.com>
|
2026-05-09 11:05:37 +08:00 |
|
|
Polisetty V R K Jyothendra VarmaandMa Mingfei
|
50ed01674e
|
fix is_arch_support_pdl function usage (#24600)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-05-09 09:39:34 +08:00 |
|
|
Liangsheng Yin
|
1613bae412
|
[Spec] Disambiguate verified_id into bonus_token(s) / accept_tokens (#24724)
|
2026-05-08 18:24:33 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
a61a14f416
|
[KDA] Optimize prefill kernels with diagonal and recompute fuse (#24271)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-09 08:52:51 +08:00 |
|