Commit Graph
12512 Commits
Author SHA1 Message Date
Liangsheng Yin de098f4f4d rerun-test: show running state in reply comment (#25018) 2026-05-11 17:04:29 -07:00
Lianmin Zheng 34555aee9c Add minosfuture to CI_PERMISSIONS.json (#25019) 2026-05-11 16:54:32 -07:00
e9dea79755 (3/n - prefill optimize)[LoRA][MoE] Optimize virtual experts: remove CPU-GPU sync & multi-block CUDA JIT histogram (#24262)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-11 16:36:57 -07:00
Liangsheng Yin 6c3541a914 spec: route idle hidden_size via EagleDraft{,Extend}Input classmethods (#25013) 2026-05-11 15:59:51 -07:00
Liangsheng Yin ce1736fcc6 [Spec] Remove dead kernel params; fix stale comment in trtllm_mla (#25010) 2026-05-11 14:50:46 -07:00
Lianmin Zheng 893dfb7b74 Add libertyeagle to CI_PERMISSIONS.json (#25011) 2026-05-11 14:44:07 -07:00
Liangsheng Yin 42bcbc00d4 [Spec] Drop Rule 5 (_len / _lens ban) from speculative naming rule (#25012) 2026-05-11 14:35:34 -07:00
Bruce Changlong Xu d3edfb579b [connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995) 2026-05-11 14:20:22 -07:00
Jia Guo da0eeb82f2 perf: add --prefill-only-disable-kv-cache to skip KV pool allocation (#23675) 2026-05-11 13:10:24 -07:00
Liangsheng Yin c7e53e68a2 [Spec] Fix ngram metric off-by-1 in num_accepted_drafts_per_req_cpu (#24965) 2026-05-11 12:25:18 -07:00
Yihao Wang 7407a62c1c [Docs] Update MiniCPM-V-4.6 documentation and deployment configuration (#24991) 2026-05-11 11:10:19 -07:00
Yan Ru Pei 4b6f776889 feat(kv-events): publish SWA radix cache events (#24718)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-05-11 10:31:45 -07:00
TianheandClaude Sonnet 4.6 95985f983d feat(trace): support SGLANG_TRACE_LEVEL env var for startup trace level (#24716)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-11 10:31:03 -07:00
Bingxu ChenandCursor Agent 2e69266f84 [AMD] avoid aiter re-installing triton in amd_install_dependency (#24981)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-05-11 23:05:16 +08:00
Bingxu ChenandCursor Agent aeb8fefc25 [AMD] Pin cache-dit==1.3.0 in rocm.Dockerfile + AMD CI install script (#24924)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-05-11 22:32:13 +08:00
Ke Bao d9cb38012e Update MiMo V2.5 cookbook image to nightly (#24983) 2026-05-11 22:04:31 +08:00
Ke Bao 62edbc37c4 [Doc] Add rerun-test slash command usage (#24979) 2026-05-11 21:30:01 +08:00
Ke Bao 9c03171f6c Fix gb envs in deployment guide (#24977) 2026-05-11 21:06:02 +08:00
Ke Bao 36ba60ad49 Register SWA unit tests under unit/mem_cache (#24974) 2026-05-11 20:21:05 +08:00
YC Yen-Ching Tseng 6b6963f426 [AMD] Update scripts/ci/amd/ensure_vram_clear.sh (#24586) 2026-05-11 18:47:09 +08:00
Mick 6d30b571b2 [diffusion] fix: fix single-step flow-match timesteps (#24708) 2026-05-11 18:09:24 +08:00
Hank Han c027ae677c ci: align torch CUDA wheel checks (#24940) 2026-05-11 16:22:20 +08:00
monkeyLoveding f7ba136279 [NPU] bump sgl-kernel-npu version to 2026.05.01 (#24951) 2026-05-11 16:13:39 +08:00
iridiumineandiridiumine df441b8fea [NPU] Support shared expert dual stream optimization (#23827)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
2026-05-11 15:50:15 +08:00
Brayden Zhongandb8zhong 1df9edcd01 Use Torch torch.mm for Deepseek V3.2 Indexer GEMM (#23856)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-11 00:41:05 -07:00
Brayden Zhongandb8zhong 1d80a1a9fe Use Cute-DSL NVFP4 quantization kernels (#23745)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-11 00:40:02 -07:00
Baizhou Zhang ea217a2bf0 ci: remove Execute Notebooks workflow (#24460) 2026-05-11 00:26:32 -07:00
Cheng WanandClaude Opus 4.7 044bb88a97 fix: SGLANG_RADIX_FORCE_MISS chunk-cache passthrough (#24950)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-11 00:07:46 -07:00
Shangming Cai d102b0cbc3 Add CODEOWNERS for EPD module (#24942) 2026-05-11 14:42:48 +08:00
Bingxu Chenandbingxche 3ffb37789a [AMD] Fix DeepSeek import cascade by supporting both pre- and post-#2958 aiter fused_qk_rmsnorm APIs (#24799)
Co-authored-by: bingxche <cursoragent@cursor.com>
2026-05-10 23:41:57 -07:00
Liangsheng Yin faad02b3dd spec: centralize EagleDraft{,Extend}Input.hidden_states shape (#24926) 2026-05-10 22:49:20 -07:00
Mick 6e5b4de01a [diffusion] fix: further align ltx2.3 accuracy with tp (#24660) 2026-05-11 13:42:08 +08:00
Thomas ed70226ec1 [Diffusion][NPU][GPU] Fix SANA model execution error (#24798) 2026-05-11 08:41:36 +03:00
Артем Савкинandronnie_zheng 9ec2880eca [NPU] [Bugfix] Wan quantization fix (#24540)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-11 08:32:57 +03:00
Yuwei AnandClaude Opus 4.7 5207f074a4 Breakable Cuda Graph Support for bs > 1 (#24662)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-11 13:28:49 +08:00
Junlin Wu a623ee4cb5 📝 docs(diffusion): add MXFP8 quantization docs for Wan2.2 on Ascend NPU (#24918) 2026-05-11 08:13:34 +03:00
d5e707f132 Fix sgl-kernel-mla-test path after test was moved to test/manual (#24914)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
2026-05-10 22:00:08 -07:00
Ming Yang 8e2142c15a [MoE] Fix NaN in flashinfer TRT-LLM A2A dispatch by sanitizing padding slots (#24850) 2026-05-10 21:57:43 -07:00
Tejas Dharamsi a6f359d103 [Rerank] Use heapq.nlargest for top_n to avoid full sort (#24871) 2026-05-10 21:48:37 -07:00
Bingxu ChenandCursor Agent 22543b1982 [AMD] DSv4 nightly hotfix + schedule-aware --continue-on-error in AMD CI (#24825)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-05-10 21:46:32 -07:00
Yihao Wang 9f066cb55b [Docs] Add MiniCPM-V 4.6 cookbook (#24876) 2026-05-10 21:32:15 -07:00
36c93fc6fb [NPU] [Diffusion] Use fused operator to improve Wan model E2E performance. (#24028)
Co-authored-by: gengjinsong <gengjinsong@huawei.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gengjinsong <904939979@qq.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-11 07:17:31 +03:00
Hank Han 958f35d1e0 ci: run H20 stage with CUDA 13 (#24916) 2026-05-11 11:18:41 +08:00
YC Yen-Ching Tseng 126a36a986 [AMD] VRAM cleanup step to AMD nightly test workflows (#24612) 2026-05-11 11:08:51 +08:00
YC Yen-Ching Tseng b35d14b64d [AMD] Retry logic for lmms-eval installation (#24615) 2026-05-11 10:55:24 +08:00
iridiumineandiridiumine 09a4828db9 [NPU] Fix warmup error with --disable-cuda-graph and mtp (#23819)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
2026-05-11 09:53:34 +08:00
McZyWu 4435a23a51 [NPU]adapt multibatch fia ops (#20177) 2026-05-11 09:44:14 +08:00
silencejade 407665a7d4 [NPU] Fix mrope_position computation in Eagle Worker v2 with PlanStream (#23423) 2026-05-11 09:43:37 +08:00
silencejade 0fc9598b3e [NPU] Support radix-cache with mamba-extra-buffer for Qwen3.5 (#23891) 2026-05-11 09:40:44 +08:00
Jimmy Shong e9a15b95da [Fix] Disable FlashInfer allreduce fusion under deterministic inference (#24629) 2026-05-10 20:04:52 -05:00