Commit Graph
238 Commits
Author SHA1 Message Date
Jinyan Yi b98a577fbe Doc/update ascend quickstart (#32205) 2026-07-23 20:25:20 +08:00
Liangsheng Yin 9b853e6832 [Scheduler] Enable decode retraction ordering under speculative decoding (#32023) 2026-07-23 00:42:56 -07:00
Xiaoyu ZhangandClaude Opus 4.8 99f636a86f [Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels (#32072)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 08:35:09 +08:00
Brayden Zhong e7511141ea Support CuteDSL GEMM BF16 on SM100 on by default when allowed by heuristic (#30567) 2026-07-22 14:13:12 -07:00
0a6d1930c3 [Attention Backend] Add HPC-Ops attention backend (#30540)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
2026-07-22 22:06:22 +08:00
axx-ty911 7dcf3f7cbf [Doc] Rename A5 product name (#31998) 2026-07-22 15:09:05 +08:00
dcd9014f15 [AMD][MXFP4] Reland "Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs" (#28291)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-07-21 02:50:23 -07:00
Rahul Vijayaraghavan fa0ced195e [XPU] Enable breakable prefill CUDA graph on XPU (#30273) 2026-07-21 09:09:40 +08:00
amote-i 97e0647bdc [NPU] [DOC] Fix issues about npu docs found by aidd (#31302) 2026-07-20 16:31:27 +08:00
b8ec544946 [DSA] Integrate Q8KV8 FP8 Sparse MLA Prefill into the DSA Backend (DeepSeek-V3.2) (#30514)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-07-19 11:58:16 +08:00
44e4999ab2 [Diffusion] Use SGLang server for ERNIE-Image prompt enhancement (#31354)
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-07-18 06:55:28 +03:00
67e7f8d13a [JIT] Refactor dtype traits into DTypeTrait and unify warp reductions (#30838)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: BBuf <xiaoyu.zhang@radixark.ai>
Co-authored-by: jessiewei7 <jessiewei747@gmail.com>
Co-authored-by: root <root@GPUC5A6.maas>
2026-07-18 10:07:18 +08:00
Brayden Zhong 238b2b2c9c Remove QServe and FBGEMM FP8 quantization (#31109) 2026-07-17 17:10:34 -07:00
Sam (Kesen Li) ec6a3163b7 [Feature] Add FP4 KV Cache Design and support SM120 GPUs (#21601) 2026-07-17 14:49:43 -07:00
Brayden ZhongandBrayden Zhong 7fc3fb9657 Remove deprecated Mamba flags from doc, wrong FP8 GEMM docstrings and change Nemotron image to 0.5.15 (#31094)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-07-17 14:34:29 -07:00
Mick 85ac56c823 docs: simplify diffusion new model guide (#30109) 2026-07-17 19:39:38 +08:00
Junlin Wu bbd2a3fe4a [llm][npu][quant] Add W4A4 MXFP4 quantization support for Qwen3 Dense on Ascend NPU (#23795) 2026-07-17 09:06:30 +03:00
AuFlowandAuFlow bf417440e9 [Scheduler] Add SGLANG_MAX_NEW_TOKENS_LIMIT to cap per-request max_new_tokens (#22591)
Co-authored-by: AuFlow <AuFlow@users.noreply.github.com>
2026-07-16 21:34:10 -07:00
amote-i 6275114548 [NPU] [DOC] Update model names supported on Ascend NPU (#31316) 2026-07-16 14:45:59 +08:00
Jun LiuandXinyuan Tong d2b1243be0 docs: document CUDA crash dump output (#31333)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-07-15 22:18:36 +08:00
Артем Савкинandronnie_zheng 8ed82afcc8 [MoE Refactor] [NPU] Refactor Ascend MoE implementation to reduce code duplication and align with community design (#25663)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-07-15 14:59:42 +03:00
bdc9848c25 [Doc]Standardize the names of PyTorch NPU-related software throughout the documentation by replacing them all with TorchNPU. (#29886)
Signed-off-by: a60124901 <anyuxin4@h-partners.com>
Signed-off-by: axx-ty911 <anyuxin4@h-partners.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-07-14 21:56:08 +03:00
Mick 43241b7f3f [diffusion] model: support fal Ideogram V4 Fast and Instant (#31177) 2026-07-14 19:51:35 +08:00
702bddcee8 [Model] Add support for JetBrains' Mellum v2 code generation model (#27375)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-07-13 22:54:38 -07:00
Brayden Zhongandroot 9756f768a6 Refactor FP4 quantization and remove deprecated JIT kernels (#30448)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
2026-07-14 09:22:07 +08:00
423b8485fb [Quantization] add humming quantization kernel (#23754)
Co-authored-by: guzekai01 <zekai01@antgroup.com>
Co-authored-by: Julian Huang <huangzhilin.hzl@gmail.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-07-14 08:42:56 +08:00
cfe4eefabb [diffusion] model: support LongLive 2.0 T2V and I2V inference (#27639)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-07-13 17:39:30 -07:00
zijiexia 50ed4c011f Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964) 2026-07-13 15:06:08 -07:00
Liangsheng Yin e2728ac504 [Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998) 2026-07-13 15:30:31 -05:00
sglang-botandsglang-bot 805385414e chore: bump docs install version to 0.5.15 (#31058)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-07-13 18:58:48 +00:00
11a82af5f8 [Platform] Route pin memory availability through current_platform (#28113)
Co-authored-by: N3u0ns <N3u0ns@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-07-13 11:37:59 -07:00
amote-i be9791071a [NPU] [DOC] Fix Ascend NPU docs issues found by AIDD (#31036) 2026-07-13 23:45:35 +08:00
amote-i f391c71758 [NPU] [DOC] --pp-size can not be used witgh --tp-size (#31039) 2026-07-13 22:35:20 +08:00
xutizhou eb31b5310c Support Waterfill with MegaMoE backend (#27350) 2026-07-13 03:56:46 -07:00
amote-i 2225817424 [NPU] [DOC] Optimize and fix docs issues on Ascend NPU (#30767) 2026-07-13 15:35:02 +08:00
loading66 79f096d43b [DOCS][NPU]update npu support features and models (#30843) 2026-07-11 15:21:29 +08:00
Lucia Fang 51c5ddbe65 [eplb] chunk expert-weight P2P on CUDA to prevent NCCL rebalance hang (#30829) 2026-07-10 21:45:17 -07:00
Chenchen HongandXiaoyu Zhang e3ceccf781 [dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-07-11 11:05:05 +08:00
Mick 559854fe6a [diffusion] docs: sync cookbook and log hygiene (#30791) 2026-07-10 22:55:14 +08:00
YAMY 2e4d6368c3 [GDN] Auto-select FlashInfer GDN prefill on validated SM100 configs (#29734) 2026-07-10 00:26:00 +08:00
7aab39a18b [Diffusion] SGLang backend for GLM Image AR. Step 1 - Separate server (#25381)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: yuefeng Wu <33725817+ChefWu551@users.noreply.github.com>
Co-authored-by: wuyuefeng <wuyuefeng@noreply.gitcode.com>
2026-07-09 15:54:50 +03:00
amote-i 4153410477 [NPU] [DOC] remove unsupported models from Ascend NPU models list (#30647) 2026-07-09 20:01:00 +08:00
Mohammad Miadh Angkad 666a09fe2a Disable multi-threaded load by default when prefetch is on (#30146) 2026-07-09 00:28:53 -07:00
amote-i 69ddbf9ef6 [NPU] [DOC] fix model name error on Ascend NPU (#30577) 2026-07-09 11:28:29 +08:00
amote-i 042228a195 [NPU] [DOC] Remove unsupported options of features on Ascend NPU (#30504) 2026-07-08 17:35:06 +08:00
zijiexia 0bf7ddb481 docs(install): add nightly install + docker tag guidance, and auto-bump version on release tag (#30308) 2026-07-07 12:10:05 -07:00
amote-i cfd3fdc54f [NPU] [DOC] Update features and mainstream models on ascend npu (#30370) 2026-07-07 19:03:43 +08:00
qinsir5522 5e9032c527 [NPU]Modify LoRA heading in ascend_npu_support_features.mdx to specify Qwen model limitations. (#30358) 2026-07-07 16:01:51 +08:00
ZeyuanChen2000 2d9f0b3317 [NPU] [DOC] Update arguments detail to NPU support features page (#30328) 2026-07-07 14:09:46 +08:00
loading66 998acf7df8 [DOCS][NPU]update npu support features (#30324) 2026-07-07 11:37:19 +08:00