Commit Graph
62 Commits
Author SHA1 Message Date
amote-i ac83d8a339 docs: delete deprecated args from npu supported features (#25995) 2026-05-21 20:20:29 +08:00
loading66 2e0d2d4c18 [NPU][DOCS]Add best practice and benchmark result parameter description (#25875) 2026-05-21 19:08:10 +08:00
jianzhao-xu f66881f03c [NPU]Ascend NPU Performance Profiling Guide and Ascend NPU Operator Development Guide (#25384) 2026-05-21 17:32:25 +08:00
jiayisunxandMa Mingfei 34479c19bd [XPU] upgrade triton-xpu version to 3.7.1 (#25730)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-21 10:29:20 +08:00
Xiaoyu Zhang ccbbae00ea [codex] Reland Wan2.2 ModelOpt CI checkpoints (#25857) 2026-05-20 22:15:25 +08:00
Cheng WanandClaude Sonnet 4.6 8131641bc6 [Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-20 00:18:04 -07:00
Cheng Wan a4b51d35ef Revert "[codex] Update Wan2.2 ModelOpt CI checkpoints" (#25845) 2026-05-19 21:45:20 -07:00
Xiaoyu Zhang 80fc524809 [diffusion] quant: update Wan2.2 modelOpt CI checkpoints (#25483) 2026-05-20 09:05:39 +08:00
amote-i de3fc46e3d [NPU] [DOC] remove Qwen3-235B-A22B 2K+2K 100ms mixed mode benchmark (#25778) 2026-05-19 20:48:43 +08:00
Liangsheng Yin e0273dcd31 pr-test-extra: re-trigger on labeled event (#25732) 2026-05-19 05:15:55 -07:00
Arseniy MironovandNapkin-AI 45a85efc3a [Diffusion][NPU]Add attention backends for diffusion models for Ascend NPU (#23482)
Co-authored-by: Napkin-AI <arseniy.mironov.dev@gmail.com>
2026-05-19 12:46:55 +03:00
amote-i 1f7bf155c3 [NPU] [DOCS] Improved the usability of Ascend NPU documents (#25735) 2026-05-19 16:22:22 +08:00
Ziang Li 78cb38ed5e [FlashInfer v0.6.11] [RL] Support FlashInfer per-token NVFP4 MoE (#22918) 2026-05-19 01:04:48 -07:00
Kurkur d028697d17 [NPU][Docs] Add Kimi-K2.5-W4A8 instance doc on NPU (#25269) 2026-05-19 09:08:28 +08:00
54eb2904a4 minor: docs include mac installation (#25178)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-05-18 15:48:59 +08:00
Xia WeiwenandMa Mingfei 8d5ed330cc [XPU] Enable qwen3.5 on XPU (#21668)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-18 14:59:19 +08:00
a080358cac [Refactor] Refactor DeepEP dispatcher (#22822)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-05-18 04:36:42 +03:00
Zheng Luo 435ea41cf0 Delegate ModelExpress loading to package (#24723)
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
2026-05-16 11:16:44 -07:00
amote-i 373a22c225 [NPU] [DOC] fix issues in ascend npu docs (#25268) 2026-05-14 17:25:47 +08:00
Lewisand百麒 0680f1b3d1 Add IntraNode NVLink configration in PD disaggregation docs (#23329)
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
2026-05-13 23:23:57 -07:00
jianzhao-xu edb1b3f8f5 [NPU] add Ascend NPU Accuracy Evaluation and Faq docs (#24777) 2026-05-14 11:28:16 +08:00
amote-i 65e9f81c7d [NPU] [DOC] add performance testing and optimization docs for npu (#25114) 2026-05-14 09:47:55 +08:00
Le Zhangandlezhang 6ac30192fa [MLX] Add on-the-fly --quantization mlx_q4 / mlx_q8 for Apple Silicon (#24907)
Co-authored-by: lezhang <lezhang@local>
2026-05-13 11:06:13 -07:00
Khoa Pham c665edec6e [env] Make max KV chunk capacity configurable via SGLANG_MAX_KV_CHUNK_CAPACITY (#25120) 2026-05-12 22:37:45 -07:00
R0CKSTAR 0a37d24e62 [diffusion] hardware: support sage attention backend on MUSA (attn backend, 21/N) (#24752)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-05-11 19:50:52 -07:00
shuwenn 5495026a3b [HiCache] feat: default storage prefetch timeout (#23309) 2026-05-11 18:49:35 -07:00
R0CKSTAR 74d70af09a [Apple Silicon] Add Metal kernel support in sgl-kernel (#23449)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
2026-05-11 17:54:27 -07:00
Ke Bao 62edbc37c4 [Doc] Add rerun-test slash command usage (#24979) 2026-05-11 21:30:01 +08:00
Junlin Wu a623ee4cb5 📝 docs(diffusion): add MXFP8 quantization docs for Wan2.2 on Ascend NPU (#24918) 2026-05-11 08:13:34 +03:00
egvenediktov 2473659e76 [NPU]Documentation update for communications quantization feature (#24668) 2026-05-10 23:49:21 +03:00
d82e339ce2 [Session R3] Add routed_experts_start_len for absolute routing slice control (#24851)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
Co-authored-by: Yuzhen Zhou <82826991+zyzshishui@users.noreply.github.com>
2026-05-10 10:04:43 -07:00
Brayden Zhongandb8zhong 8f33bee31b Reland Cute-DSL FP4 dense GEMM (#23590)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-09 02:20:58 -07:00
Jimmy Shong 096ad02b06 [Model] Laguna-XS.2 Model Support (#24204) 2026-05-09 05:43:13 +08:00
amote-i d32e283947 [NPU] [DOC] refresh npu supported model list (#24676) 2026-05-08 17:08:15 +08:00
Revanth Reddy Airre be088f8076 fix(router): configure HTTP client connection settings (#24330)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
2026-05-07 11:42:45 -07:00
Revanth Reddy Airre d363315de9 fix(router): make HTTP pool idle timeout configurable (#24329)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
2026-05-06 22:11:11 -07:00
Baizhou Zhang 7ec18f7e4e [Doc] Fix instruction on Cuda 13 environments (#24516) 2026-05-06 02:37:23 -07:00
Xiaoyu Zhang 8c703f215e Add HunyuanVideo ModelOpt FP8 diffusion support (#23199) 2026-05-05 19:27:28 +08:00
Mick 2f7d99b7f7 [diffusion] cli: support component attention backend overrides (#24320) 2026-05-05 08:39:27 +08:00
Liangsheng Yinandfzyzcjy 4743cf6051 misc: add marlin to moe runner choices; drop dead env var doc (#24384)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
2026-05-04 15:01:47 -07:00
Praneth Paruchuri e93bb638bf [docs]update sm75 to sm80 min gpu support (#24336) 2026-05-04 13:50:20 -07:00
Chi McIsaacandJunhao Liu 62265ca7fc [diffusion] feat: initial support for dynamic batching (#18764)
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Junhao Liu <junhaoliu2023@gmail.com>
2026-05-04 00:44:42 +08:00
Xiaoyu ZhangandMick f2d1390909 [Diffusion] Add Qwen Image ModelOpt FP8 support (#23155)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-05-04 00:24:22 +08:00
Glen Liu 76b9c8de6f [Feature] add LoRADrainer to address high P99 TTFT (#17913) 2026-05-02 16:13:43 -07:00
Xiaoyu Zhang 589f90b368 [diffusion] chore: use lmsys as org for modelopt checkpoints (#23924) 2026-05-02 17:18:58 +08:00
3272af2f00 [Apple Silicon] [MLX] MLX decode partial overlap scheduling for generation (async eval) (#22416)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-04-29 12:21:14 -07:00
hhwxw d9270b8c6a fix(moe): relocate orphan tuned configs after #23019 (#24004) 2026-04-29 02:00:13 -07:00
AlonKejzman 66ea0aee7f tokenizer: Add fastokens support (#23753) 2026-04-28 11:43:10 -07:00
Pai Liu 7b9ff79f93 docs: update Python prerequisite to 3.10 (#23801) 2026-04-27 15:36:38 -07:00
1874. 47b8eadbc4 [Docs] Update Ascend NPU GGUF quantization documentation (#23845) 2026-04-27 17:30:24 +03:00