Commit Graph
12494 Commits
Author SHA1 Message Date
Ke Bao 36ba60ad49 Register SWA unit tests under unit/mem_cache (#24974) 2026-05-11 20:21:05 +08:00
YC Yen-Ching Tseng 6b6963f426 [AMD] Update scripts/ci/amd/ensure_vram_clear.sh (#24586) 2026-05-11 18:47:09 +08:00
Mick 6d30b571b2 [diffusion] fix: fix single-step flow-match timesteps (#24708) 2026-05-11 18:09:24 +08:00
Hank Han c027ae677c ci: align torch CUDA wheel checks (#24940) 2026-05-11 16:22:20 +08:00
monkeyLoveding f7ba136279 [NPU] bump sgl-kernel-npu version to 2026.05.01 (#24951) 2026-05-11 16:13:39 +08:00
iridiumineandiridiumine df441b8fea [NPU] Support shared expert dual stream optimization (#23827)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
2026-05-11 15:50:15 +08:00
Brayden Zhongandb8zhong 1df9edcd01 Use Torch torch.mm for Deepseek V3.2 Indexer GEMM (#23856)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-11 00:41:05 -07:00
Brayden Zhongandb8zhong 1d80a1a9fe Use Cute-DSL NVFP4 quantization kernels (#23745)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-11 00:40:02 -07:00
Baizhou Zhang ea217a2bf0 ci: remove Execute Notebooks workflow (#24460) 2026-05-11 00:26:32 -07:00
Cheng WanandClaude Opus 4.7 044bb88a97 fix: SGLANG_RADIX_FORCE_MISS chunk-cache passthrough (#24950)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-11 00:07:46 -07:00
Shangming Cai d102b0cbc3 Add CODEOWNERS for EPD module (#24942) 2026-05-11 14:42:48 +08:00
Bingxu Chenandbingxche 3ffb37789a [AMD] Fix DeepSeek import cascade by supporting both pre- and post-#2958 aiter fused_qk_rmsnorm APIs (#24799)
Co-authored-by: bingxche <cursoragent@cursor.com>
2026-05-10 23:41:57 -07:00
Liangsheng Yin faad02b3dd spec: centralize EagleDraft{,Extend}Input.hidden_states shape (#24926) 2026-05-10 22:49:20 -07:00
Mick 6e5b4de01a [diffusion] fix: further align ltx2.3 accuracy with tp (#24660) 2026-05-11 13:42:08 +08:00
Thomas ed70226ec1 [Diffusion][NPU][GPU] Fix SANA model execution error (#24798) 2026-05-11 08:41:36 +03:00
Артем Савкинandronnie_zheng 9ec2880eca [NPU] [Bugfix] Wan quantization fix (#24540)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-11 08:32:57 +03:00
Yuwei AnandClaude Opus 4.7 5207f074a4 Breakable Cuda Graph Support for bs > 1 (#24662)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-11 13:28:49 +08:00
Junlin Wu a623ee4cb5 📝 docs(diffusion): add MXFP8 quantization docs for Wan2.2 on Ascend NPU (#24918) 2026-05-11 08:13:34 +03:00
d5e707f132 Fix sgl-kernel-mla-test path after test was moved to test/manual (#24914)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
2026-05-10 22:00:08 -07:00
Ming Yang 8e2142c15a [MoE] Fix NaN in flashinfer TRT-LLM A2A dispatch by sanitizing padding slots (#24850) 2026-05-10 21:57:43 -07:00
Tejas Dharamsi a6f359d103 [Rerank] Use heapq.nlargest for top_n to avoid full sort (#24871) 2026-05-10 21:48:37 -07:00
Bingxu ChenandCursor Agent 22543b1982 [AMD] DSv4 nightly hotfix + schedule-aware --continue-on-error in AMD CI (#24825)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-05-10 21:46:32 -07:00
Yihao Wang 9f066cb55b [Docs] Add MiniCPM-V 4.6 cookbook (#24876) 2026-05-10 21:32:15 -07:00
36c93fc6fb [NPU] [Diffusion] Use fused operator to improve Wan model E2E performance. (#24028)
Co-authored-by: gengjinsong <gengjinsong@huawei.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gengjinsong <904939979@qq.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-11 07:17:31 +03:00
Hank Han 958f35d1e0 ci: run H20 stage with CUDA 13 (#24916) 2026-05-11 11:18:41 +08:00
YC Yen-Ching Tseng 126a36a986 [AMD] VRAM cleanup step to AMD nightly test workflows (#24612) 2026-05-11 11:08:51 +08:00
YC Yen-Ching Tseng b35d14b64d [AMD] Retry logic for lmms-eval installation (#24615) 2026-05-11 10:55:24 +08:00
iridiumineandiridiumine 09a4828db9 [NPU] Fix warmup error with --disable-cuda-graph and mtp (#23819)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
2026-05-11 09:53:34 +08:00
McZyWu 4435a23a51 [NPU]adapt multibatch fia ops (#20177) 2026-05-11 09:44:14 +08:00
silencejade 407665a7d4 [NPU] Fix mrope_position computation in Eagle Worker v2 with PlanStream (#23423) 2026-05-11 09:43:37 +08:00
silencejade 0fc9598b3e [NPU] Support radix-cache with mamba-extra-buffer for Qwen3.5 (#23891) 2026-05-11 09:40:44 +08:00
Jimmy Shong e9a15b95da [Fix] Disable FlashInfer allreduce fusion under deterministic inference (#24629) 2026-05-10 20:04:52 -05:00
aa7a9af12f fix: STANDALONE spec-decode hidden-size mismatch crash (#24217)
Co-authored-by: root <root@sharp-heart-runs-fin-03.datacrunch.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-10 17:48:00 -07:00
Brayden Zhongandb8zhong 8acb0270fd Followup fix for Custom AR V2 in non NVL scenarios (#24742)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-10 16:57:46 -07:00
YAMY b202778aa5 Fix reduce_scatterv producer contract for SUM_LEN (#24785) 2026-05-10 16:51:13 -07:00
egvenediktov 2473659e76 [NPU]Documentation update for communications quantization feature (#24668) 2026-05-10 23:49:21 +03:00
d82e339ce2 [Session R3] Add routed_experts_start_len for absolute routing slice control (#24851)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
Co-authored-by: Yuzhen Zhou <82826991+zyzshishui@users.noreply.github.com>
2026-05-10 10:04:43 -07:00
Yihao Wang 9150e77399 [Model] Add MiniCPM-V 4.6 support (#24855) 2026-05-10 12:24:17 -04:00
RunningLeon 335dbd60b4 Support Intern-S2-Preview (#24875) 2026-05-10 22:17:30 +08:00
Ke Bao 59faf986b2 [PD] Unify dsv4 dispatch with swa (#24888) 2026-05-10 22:01:13 +08:00
2f06867128 Optimize MHC pipeline: DeepGemm, fused norm, fused hc_head (#24775)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
2026-05-10 19:03:37 +08:00
Yuhao YangandCheng Wan bd0aa22309 Fix PD bootstrap failure handling (#24772)
Co-authored-by: Cheng Wan <chwan@rice.edu>
2026-05-10 19:02:47 +08:00
Liangsheng Yin 8cc16c9974 [Spec] Cleanup idle stub and shape-check patterns (#24881) 2026-05-10 02:39:53 -07:00
c7f674e427 [Bug] Add dsv4 state_type branch to mooncake disaggregation (#24878)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-10 01:13:46 -07:00
Liangsheng Yin d08744238a [Spec V1] Split draft-extend phase from EagleDraftInput into new EagleDraftExtendInput (#24859) 2026-05-10 01:07:45 -07:00
Yuan Luoandluoyuan.luo d3fd91ed97 [Gemma4] Optimize Gemm4 with fused Q/K/V RMSNorm + per-expert FP8 ckpt loader (#24696)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-05-10 00:24:12 -07:00
Qiaolin Yu a87fb399de [spec decoding] support kimi-k2.5-eagle3-mla (#24826) 2026-05-09 23:57:39 -07:00
shuwenn b4d347e86e [SPEC V2] fix: skip stale state updates in spec-v2 overlap (#23456) 2026-05-09 23:56:24 -07:00
cfd3fd00d0 [RL] Call torch.cuda.empty_cache() for in-place pause mode to avoid OOM (#24854)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-09 23:36:52 -07:00
Chi McIsaac 44efc23a9a [diffusion] CI: add cache-dit CI tests (#19213) 2026-05-10 13:38:41 +08:00