Commit Graph
12537 Commits
Author SHA1 Message Date
Praneth Paruchuri 1efe9e2164 [Bug Fix] Reject incompatible combination of --disable-cuda-graph-padding and --enable-torch-compile (#23903) 2026-05-12 16:18:36 +08:00
lw9527 8d27ce7371 Optimize uvicorn startup command (#25041) 2026-05-12 00:28:13 -07:00
Yihao Wang b35fd5f104 [fix] skip legacy minicpmv conv template for MiniCPM-V 4.6 (#24998) 2026-05-12 15:27:28 +08:00
Yuwei AnandClaude Opus 4.7 7582237f8e [Tiny Fix] Disable BCG when inner layer_model unresolved (#25021)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-12 14:51:27 +08:00
zhangxiaolei ca3bc05fea Deepseek-v4-Pro share expert tp1 (#24949) 2026-05-11 23:19:35 -07:00
Liangsheng Yin a72d3aef17 [Spec] Multi-layer mamba scatter cleanup; fix positional call bug (#25030) 2026-05-11 22:42:30 -07:00
Ma Mingfei 71285335f7 Revert "Migrate Intel CPU cases to the test/registered." (#25044) 2026-05-12 13:32:47 +08:00
Liangsheng Yin 1f985c50db [Spec] Rename accepted_indices -> accept_indices; drop _token_id suffix per Rule 5 (#25038) 2026-05-11 22:29:02 -07:00
jundu ecf5d844f5 Migrate Intel CPU cases to the test/registered. (#22670) 2026-05-12 13:27:51 +08:00
Ke Bao d7f4761a48 [PD] Refactor hybrid state transfer (#24932) 2026-05-12 13:16:54 +08:00
Zhangheng 91907b7b93 [UnifiedTree]: Fix Unified HiCache tombstone lock release replay (#24972) 2026-05-12 13:16:06 +08:00
Liangsheng Yin 4ad63ad02f [Spec] Rename accepted_drafts -> correct_drafts for unambiguous naming (#24081) 2026-05-11 22:12:40 -07:00
tangcy98andzhangzhang 6bfb365c07 [PD] Rate limit prefill inflight polling warnings (#24967)
Signed-off-by: zhangzhang <tangchenyu@xiaohongshu.com>
Co-authored-by: zhangzhang <tangchenyu@xiaohongshu.com>
2026-05-12 12:50:57 +08:00
Ming Yang 6bb79c155b [Linear Attn] Add CUSTOM enum and plugin extensibility for kernel backends (#24937) 2026-05-11 21:46:53 -07:00
Qiaolin Yu cfc41d5b15 Fix kimi k2.5 mla eagle + dp attention (#25033) 2026-05-11 20:58:00 -07:00
Yihao Wang 0f3932c055 [Fix] Qwen3-ASR config: set thinker_config before super().__init__ (#24187) 2026-05-12 11:52:15 +08:00
Liangsheng Yin f526e3fa27 [Spec] Mamba scatter cleanup; fix multi-layer positional bug; dflash naming (#25029) 2026-05-11 20:36:50 -07:00
Jianhong Zhang 10375a1037 [NIXL][XPU] Fix uint64 overflow for mismatched P/D TP sizes (e.g. prefill_tp=1, decode_tp=2) (#24648) 2026-05-12 11:02:24 +08:00
R0CKSTAR 0a37d24e62 [diffusion] hardware: support sage attention backend on MUSA (attn backend, 21/N) (#24752)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-05-11 19:50:52 -07:00
shuwenn 5495026a3b [HiCache] feat: default storage prefetch timeout (#23309) 2026-05-11 18:49:35 -07:00
Doğaç Eldenk 186eb42459 Feat: Support SWA (Sliding Window Attention) for EAGLE-3 drafter (#24664) 2026-05-11 18:40:10 -07:00
Doğaç Eldenkandhnyls2002 a75b79e03b Feat: Support newer EAGLE-3 drafters (#24663)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-05-11 18:17:20 -07:00
Liangsheng Yin f3a8189e20 [Spec] Internal rename per N2 v2 naming rule (#25014) 2026-05-11 18:16:26 -07:00
popsiclexu bfc2eda42d [MUSA] Use MUSA-optimized operators in piecewise CUDA graph (#23633)
Signed-off-by: popsiclexu <zhenxuexu@gmail.com>
2026-05-11 17:55:27 -07:00
R0CKSTAR 74d70af09a [Apple Silicon] Add Metal kernel support in sgl-kernel (#23449)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
2026-05-11 17:54:27 -07:00
Liangsheng Yin de098f4f4d rerun-test: show running state in reply comment (#25018) 2026-05-11 17:04:29 -07:00
Lianmin Zheng 34555aee9c Add minosfuture to CI_PERMISSIONS.json (#25019) 2026-05-11 16:54:32 -07:00
e9dea79755 (3/n - prefill optimize)[LoRA][MoE] Optimize virtual experts: remove CPU-GPU sync & multi-block CUDA JIT histogram (#24262)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-11 16:36:57 -07:00
Liangsheng Yin 6c3541a914 spec: route idle hidden_size via EagleDraft{,Extend}Input classmethods (#25013) 2026-05-11 15:59:51 -07:00
Liangsheng Yin ce1736fcc6 [Spec] Remove dead kernel params; fix stale comment in trtllm_mla (#25010) 2026-05-11 14:50:46 -07:00
Lianmin Zheng 893dfb7b74 Add libertyeagle to CI_PERMISSIONS.json (#25011) 2026-05-11 14:44:07 -07:00
Liangsheng Yin 42bcbc00d4 [Spec] Drop Rule 5 (_len / _lens ban) from speculative naming rule (#25012) 2026-05-11 14:35:34 -07:00
Bruce Changlong Xu d3edfb579b [connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995) 2026-05-11 14:20:22 -07:00
Jia Guo da0eeb82f2 perf: add --prefill-only-disable-kv-cache to skip KV pool allocation (#23675) 2026-05-11 13:10:24 -07:00
Liangsheng Yin c7e53e68a2 [Spec] Fix ngram metric off-by-1 in num_accepted_drafts_per_req_cpu (#24965) 2026-05-11 12:25:18 -07:00
Yihao Wang 7407a62c1c [Docs] Update MiniCPM-V-4.6 documentation and deployment configuration (#24991) 2026-05-11 11:10:19 -07:00
Yan Ru Pei 4b6f776889 feat(kv-events): publish SWA radix cache events (#24718)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-05-11 10:31:45 -07:00
TianheandClaude Sonnet 4.6 95985f983d feat(trace): support SGLANG_TRACE_LEVEL env var for startup trace level (#24716)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-11 10:31:03 -07:00
Bingxu ChenandCursor Agent 2e69266f84 [AMD] avoid aiter re-installing triton in amd_install_dependency (#24981)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-05-11 23:05:16 +08:00
Bingxu ChenandCursor Agent aeb8fefc25 [AMD] Pin cache-dit==1.3.0 in rocm.Dockerfile + AMD CI install script (#24924)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-05-11 22:32:13 +08:00
Ke Bao d9cb38012e Update MiMo V2.5 cookbook image to nightly (#24983) 2026-05-11 22:04:31 +08:00
Ke Bao 62edbc37c4 [Doc] Add rerun-test slash command usage (#24979) 2026-05-11 21:30:01 +08:00
Ke Bao 9c03171f6c Fix gb envs in deployment guide (#24977) 2026-05-11 21:06:02 +08:00
Ke Bao 36ba60ad49 Register SWA unit tests under unit/mem_cache (#24974) 2026-05-11 20:21:05 +08:00
YC Yen-Ching Tseng 6b6963f426 [AMD] Update scripts/ci/amd/ensure_vram_clear.sh (#24586) 2026-05-11 18:47:09 +08:00
Mick 6d30b571b2 [diffusion] fix: fix single-step flow-match timesteps (#24708) 2026-05-11 18:09:24 +08:00
Hank Han c027ae677c ci: align torch CUDA wheel checks (#24940) 2026-05-11 16:22:20 +08:00
monkeyLoveding f7ba136279 [NPU] bump sgl-kernel-npu version to 2026.05.01 (#24951) 2026-05-11 16:13:39 +08:00
iridiumineandiridiumine df441b8fea [NPU] Support shared expert dual stream optimization (#23827)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
2026-05-11 15:50:15 +08:00
Brayden Zhongandb8zhong 1df9edcd01 Use Torch torch.mm for Deepseek V3.2 Indexer GEMM (#23856)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-11 00:41:05 -07:00