Commit Graph
16128 Commits
Author SHA1 Message Date
Khoa PhamandClaude Opus 5 beabc5949b Enable MoE deferred finalize by default and drop its expert_weights dtype workaround (#33618)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-05 17:56:47 -07:00
Aditya KamatandBrayden Zhong c9506d023f [Quantization] Route per-tensor FP8 checkpoints to FlashInfer on SM90 (#33148)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-08-06 00:54:10 +00:00
Xiaoyu ZhangandClaude Fable 5 4c0a8940fa [Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-06 08:52:09 +08:00
Xiaoyu ZhangandMohammad Miadh Angkad ba12a16a62 [diffusion] Prefer cuDNN SDPA over FA4 for dense attention on sm_100 (B200) (#33655)
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-08-06 08:49:10 +08:00
sglang-botandsglang-bot c952ee5ac1 chore: bump sgl-kernel version to 0.4.6 (#33678)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-08-05 17:46:54 -07:00
Mohammad Miadh Angkad 65d5a0ec25 Support ModelOpt MXFP8 checkpoints (#32538) 2026-08-05 17:44:32 -07:00
ashwini rathi ae5f8c94b7 ci(xpu): harden nightly + PR XPU CI (HF login / tag fetch / docker push retries) (#32390) 2026-08-06 08:25:53 +08:00
Liangsheng Yin 3869fe556f [CI] Collapse the EAGLE launch matrix and the scoring engine boots on the per-commit runners (#33756) 2026-08-05 16:43:19 -07:00
Mohammad Miadh Angkad 5424d2039c [CI] Fix GLM-Image usage unit tests (#33731) 2026-08-05 16:20:08 -07:00
Baizhou Zhang 070fde72bf [CI] Remove some unneeded CP tests (#33763) 2026-08-05 16:07:14 -07:00
Polisetty V R K Jyothendra Varma a1cc286062 [Intel GPU] DeepSeek V4 4/N: use sgl-kernel implementation of fused_q_norm_rope on XPU (#27790)
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
2026-08-05 16:04:35 -07:00
Liangsheng Yin c0ef548eef [misc] Unify MLA scaling init and remove dead buffer / scaling code (#33363) 2026-08-05 15:59:33 -07:00
YAMY 990a446773 Fix padded positions in breakable CUDA Graph attention (#33253)
TestBreakableCUDAGraphBasic and all NVIDIA CI tests pass.
2026-08-05 15:53:28 -07:00
YAMYandChunan Zeng 7bc90ab394 Select DeepGEMM standard layouts by memory budget (#33474)
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
2026-08-05 15:50:43 -07:00
Baizhou Zhang 25035bff8d Use main branch in Kimi Dockerfiles (#33760) 2026-08-05 15:33:14 -07:00
yvbbrjdrandhnyls2002 02cd44c59a feat(dgx-spark): add inkling-small MoE support for sm_121 (#33108)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-08-05 15:06:59 -07:00
Yanbin Jiang b9d572ee02 [test] Re-enable a pruned Inkling LoRA unit-test set (68 -> 9 cases) (#33752) 2026-08-05 15:06:28 -07:00
Liangsheng Yin 2d27133fcf [CI] Skip apt-get when the required packages are already installed (#33757) 2026-08-05 15:06:01 -07:00
cctry a3a1ebc7b7 Warn on risky serving-time Triton work (#33120) 2026-08-05 14:55:03 -07:00
Ziang Li 988c6e6aeb Pin online NVFP4 4over6 quantization settings (#33621) 2026-08-05 21:29:32 +00:00
Brayden ZhongandBrayden Zhong a14c870886 Fix broken Nemotron DP attention (#33123)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-08-05 14:27:05 -07:00
Hank Han 9436de717f [Spec][PD] Enable fused TopK for GLM-5.2 MTP IndexShare (#31477) 2026-08-05 14:17:42 -07:00
Zhiqiang Xie 106bcc1293 Observability enhancement for HiCache (#32388) 2026-08-05 14:13:06 -07:00
Shu Wang 55b1c09e73 [core] Consolidate compiled-kernel caches under SGLANG_CACHE_DIR (#32434) 2026-08-05 13:54:27 -07:00
Jialin Ouyang 717a559f02 [Scheduler] Align WAR fences with CUDA graph metadata reads (#33587) 2026-08-05 13:52:20 -07:00
ea65f8ddc9 Feat/spectrum (#31491)
Co-authored-by: jaron1990 <jaron1990@gmail.com>
Co-authored-by: jaron1990 <34618972+jaron1990@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: alexnails <alex.nails@radixark.ai>
2026-08-05 13:23:17 -07:00
5c4f72f92a [Build] Add srt_empty extra group for device-agnostic install (#31300)
Co-authored-by: yixiaodapeng <yixiaodapeng@example.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-05 13:17:46 -07:00
Liangsheng Yin de34dd11e9 [CI] Fold duplicate-server suites and prune the retract matrix on 1-gpu-5090 (#33745) 2026-08-05 12:41:51 -07:00
Jason Mancuso 36853b8ffc [Spec] Support logprobs with DFlash (#33459) 2026-08-05 12:37:12 -07:00
Liangsheng Yin 1a045669e4 [CI] Merge tokenizer worker tests and drop redundant triton attention e2e (#33641) 2026-08-05 11:55:11 -07:00
Khoa Pham 5f79cf3511 [DCP] Match the replicated draft KV pool's page granularity to its allocator (#33348) 2026-08-05 11:40:28 -07:00
Jialin Ouyang b1bd871df5 [Unified Radix Cache] Complete the tree-core interface boundary (#33580) 2026-08-05 11:39:28 -07:00
cctry 96c89863a3 Measure prefill busy time between launches (#33595) 2026-08-05 11:26:27 -07:00
WenhaoZhang acaab22d09 [diffusion] feat: add SageAttention packed varlen path for minimax-h3 (#33703) 2026-08-06 01:19:58 +08:00
Xinyuan TongandZijie Xia b3cdd016ba Add Ling-3.0-flash cookbook (#33556)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-08-05 22:53:34 +08:00
zhaozx-cn 4e7209caa8 [NPU] Add causal conv1d (#28267) 2026-08-05 22:22:49 +08:00
Xiaoyu ZhangandClaude Fable 5 3425c93666 [diffusion] Wan VAE RMSNorm+SiLU fusion behind quality=high (H200 FastWan2.2 e2e 9.611 -> 9.125 s) (#33546)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-05 21:33:35 +08:00
silencejade 593777c046 [FIX] [benchmark] Fix flush_cache failure after warmup by waiting for server idle (#33527) 2026-08-05 21:27:43 +08:00
Xuan LiaoandMa Mingfei 3b4fac5b99 [XPU] DeepSeek V4: use sgl-kernel-xpu implemetation of flash_mla_sparse_fwd for prefill (#31865)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-05 21:05:53 +08:00
Mick 99709f734d [VLM] split multimodal scheduling from mm_utils (#32415) 2026-08-05 20:24:12 +08:00
Xiaoyu ZhangandClaude Fable 5 a5888c956f [diffusion] Pack Ulysses Q/K/V input all-to-all into one collective + reusable a2a staging buffers (#33667)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-05 19:15:46 +08:00
2f22ed58ea [NPU] Adding a fast layernorm for diffusion models and fix BSA (#29027)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-08-05 14:06:00 +03:00
22d558b103 [Feature] Add GLM Image usage report (#33378)
Co-authored-by: wuyuefeng <wuyuefeng@noreply.gitcode.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-08-05 13:59:49 +03:00
YC Yen-Ching TsengandChen 8279702e0b [AMD] Stop publishing the K3 MI35X nightly image (#33689)
Co-authored-by: Chen <bingxche@amd.com>
2026-08-05 17:53:23 +08:00
Alex NailsandClaude Fable 5 6fa3f9df11 [Bugfix] Treat unsharded model.safetensors as HF weights in Mistral-native format detection (#33671)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-05 01:54:46 -07:00
Liangsheng Yin 4a3d6ca88c [CI] Skip sglang-kernel and sgl-deep-gemm reinstall on version match (#33637) 2026-08-05 01:46:16 -07:00
a6e5fa7081 [Scheduler] Honor explicit min-free-slots thresholds (#33403)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-08-05 01:44:18 -07:00
Liangsheng Yin c0d5ebd6c4 [CI] Move CPU-only unit tests to the CPU suite and trim dead 5090 registrations (#33654) 2026-08-05 01:43:29 -07:00
Mohammad Miadh Angkad 98ed5554bb Stop testing cu129 DeepGEMM wheels (#33675) 2026-08-05 01:38:28 -07:00
Trevor Morris 81c7a54ecd [NVIDIA] Use sm_100f instead of sm_100a for sgl-kernel and FlashMLA (#33433) 2026-08-05 01:36:46 -07:00