Commit Graph
14605 Commits
Author SHA1 Message Date
Ma Mingfei bd3b252e0a [CPU] use faster exp in silu_and_mul (#29382) 2026-06-29 09:38:30 +08:00
Liangsheng Yin 909123ddb8 [misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591) 2026-06-28 18:38:28 -07:00
Ma Mingfei 3217410cf6 [CPU] enable fused_sigmoid_mul on CPU device (#29378) 2026-06-29 09:38:04 +08:00
Polisetty V R K Jyothendra Varma d5abafcc1c [Intel GPU] add pytorch profiling support for XPU in bench offline throughput and enhance num steps (#28308)
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
2026-06-29 09:10:15 +08:00
Liangsheng Yin abaee4664e [dflash] fa3/fa4: device-side page table; drop seq_lens_cpu D2H sync (#29343) 2026-06-28 18:06:33 -07:00
Chao Shi bd2a5db987 [HiCache] Detect for double-free in HostKVCache (#29310) 2026-06-29 09:02:21 +08:00
Brayden ZhongandBrayden Zhong b9b860652e Fix DSA indexer fusion bug causing excessive memory consumption. (#29576)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-28 14:11:07 -07:00
Aurick Qiao ad30a9958e Fix dummy weight init for tensor subclasses (#29229) 2026-06-29 01:17:00 +08:00
Yinghai Lu c5b9388721 [scheduler] Add scheduler metrics reporter init hook (#29535) 2026-06-28 09:59:34 -07:00
ishandhanani aaa31eb0a1 feat: first-class session identity in SGLang (#29436) 2026-06-28 07:16:38 -07:00
Lianmin Zheng 828411e6f1 Fix FlashInfer A2A dispatcher during CUDA graph capture (#29461) 2026-06-28 02:21:26 -07:00
Mick 4cb6d81bda [diffusion] CI: make consistency GT probe robust to transient CDN failures (#29545) 2026-06-28 17:13:53 +08:00
Liangsheng Yin 6582fc1e5d dflash: drop verify_done barrier; rely on scheduler WAR fallback (#29556) 2026-06-28 01:47:17 -07:00
Martin Hua b1da2082ca chore: bump sgl-deep-gemm build-time apache-tvm-ffi 0.1.9 -> 0.1.11 (#28481) 2026-06-28 00:26:24 -07:00
Liangsheng Yin 593f5ba68f [Spec] Replace shared-infra dflash special-cases with capabilities (WAR barrier + seq_lens_cpu) (#29232) 2026-06-28 00:02:32 -07:00
Mick 97ddc66209 [diffusion] nightly: track SGLang-Diffusion only (#29434) 2026-06-28 14:23:17 +08:00
Mick 643e1cc779 fix: fix prefill-aware SWA floor tracking (#29520) 2026-06-28 14:18:28 +08:00
Xinyuan Tong ddc389cf09 [minimax-m3] Split 3/4: disagg K-only index-K transfer (#28714) 2026-06-28 13:54:42 +08:00
Lianmin Zheng 6eedc8f376 Fix EAGLE draft hidden dim extraction and centralize spec helpers (#29464) 2026-06-27 21:48:26 -07:00
Lianmin ZhengandYinghai Lu 5747ed3b19 Fix DP-attention SHM feature finalization race (#29543)
Co-authored-by: Yinghai Lu <yinghai@meta.com>
2026-06-27 21:36:58 -07:00
Mohammad Miadh Angkad ae09b8302f [CI] Fix GB300 DSV4 Pro FP4 nightly (#29502) 2026-06-27 21:06:17 -07:00
Mick 4a76699dfc [diffusion] fix: fix --warmup silently downgrading server-based warmup to request mode (#29514) 2026-06-28 11:46:07 +08:00
Lianmin Zheng e6cbc8f5fe Fix SWA cache loc slicing for all attention backends (#29460) 2026-06-27 20:37:58 -07:00
Liangsheng Yin 4e6ce8e4ab [Spec] Capture DFLASH draft greedy sampling inside the draft decode cuda graph (#29395) 2026-06-27 19:34:26 -07:00
sglang-botandClaude Sonnet 4.6 3d922a51fc test: remove multimodal piecewise CUDA graph gate test (#29537)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-06-27 19:03:32 -07:00
Khoa PhamandCursor da802ddcaf (perf): Shard Kimi-K2.5 Eagle3 draft fc + symm-mem AG (#29223)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-27 17:40:32 -07:00
073de15053 Fuse the DSA (V3.2, GLM-5.x) indexer Q/K paths into single kernels (#27705)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: Kaixi <kaiximatteoc@nvidia.com>
2026-06-27 14:29:56 -07:00
Brayden ZhongandBrayden Zhong e4253b39e2 Support JIT fused A GEMM (MLA down projection) and support GLM-5 hidden size, SM120 (#27397)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-27 13:32:06 -07:00
Xinyuan Tongandhzh0425 592f6c849b [minimax-m3] Split 2/4: mem-cache / HiCache / sparse KV pool (#28713)
Co-authored-by: hzh0425 <hzh0425@apache.org>
2026-06-28 00:19:38 +08:00
Mick cfd911ad6e docs: refine diffusion cookbook overview (#29507) 2026-06-28 00:10:21 +08:00
Aditya KamatandMick 1589603114 model: support baidu unlimited-ocr (#29186)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-06-27 23:36:19 +08:00
b030b1a5f3 hisparse: support NIXL DRAM KV destinations for HiSparse (#27563)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-06-27 22:32:29 +08:00
c1b5c7e499 Fix DeepSeek V4 PP HiCache SWA allocation and layer mapping (#29106)
Co-authored-by: hjzhang <zhanghjzzz@qq.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
2026-06-27 22:19:14 +08:00
jonah-bermanandXinyuan Tong 2f34dbe372 Add native Exa-backed web_search support (#29342)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-06-27 14:41:09 +01:00
Mick 3306233961 [diffusion] optimize: optimize LTX2.3 CFG path (#28624) 2026-06-27 19:23:14 +08:00
Mick 91f9e7372d [diffusion] CI: refactor CI (#28762) 2026-06-27 19:22:27 +08:00
amote-i a3c5e286f6 [NPU] [DOC] Fix and update Ascend NPU docs (#29501) 2026-06-27 18:23:11 +08:00
zijiexiaandClaude Opus 4.8 e0c0c0a45c [Cookbook] GLM-5.2: tune GB300 NVFP4 recipes + fill benchmarks (#29486)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-27 01:01:28 -07:00
9214b9338f [DSA] Enable draft-extend CUDA graph for DeepSeek Sparse Attention (#29413)
Co-authored-by: kpham-sgl <kpham-sgl@users.noreply.github.com>
Co-authored-by: Jackey Hua <107608053+zhendonghua@users.noreply.github.com>
2026-06-26 23:53:46 -07:00
Raiden MakotoandRaiden-Makoto 81d3c3ce77 [AMD] [GLM5] Guard cuda_runtime.h for ROCm in fused_metadata_copy (#29373)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
2026-06-26 23:29:19 -07:00
Xiaoyu Zhang c36f166364 [skill] Remove outdated llm-serving-auto-benchmark skill (#29487) 2026-06-27 14:19:11 +08:00
Chengze Fan 43435a2f8e [mori] Add a combine-kwargs hook and use_external_inp_buf plumbing (#29097) 2026-06-26 22:34:27 -07:00
Chengze Fan 19abebcc6a [server_args] Make MoRI per-rank dispatch-token requirement overridable (#29096) 2026-06-26 22:25:36 -07:00
Xiaoyu ZhangandClaude Opus 4.8 495f13fa12 [KDA-Pilot] Add diffusion residual-gate CUDA fast path for LTX2 (#29361)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-27 12:59:41 +08:00
Liangsheng Yin cd6dedf972 [router] Count requests/responses at the HTTP edge for true intake (#29467) 2026-06-26 21:21:41 -07:00
Lianmin Zheng 09ca4fc96b Skip FlashInfer FP8 autotune for MXFP8 quantized models (#29462) 2026-06-26 18:15:08 -07:00
IvanShan177andClaude Opus 4.8 13b5bd962a fix(spec): track current_token in ReasonerGrammarObject (#29102)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-26 16:43:35 -07:00
da0f4f6f92 [HiCache] remove large host mem constraint (#28614)
Co-authored-by: Teng Ma <stmatengss@gmail.com>
Co-authored-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
2026-06-26 16:20:48 -07:00
Baizhou Zhang 12f76d115c Update GLM-5.2 B300 and GB300 NVFP4 cookbook settings (#29466) 2026-06-26 16:15:33 -07:00
Michael c470acde2b [AMD] Register 1 kernel unit test for AMD nightly CI (#29333) 2026-06-26 16:06:02 -07:00