Commit Graph
1276 Commits
Author SHA1 Message Date
Pai Liu 7b9ff79f93 docs: update Python prerequisite to 3.10 (#23801) 2026-04-27 15:36:38 -07:00
1874.andronnie_zheng 046c14a3ed [NPU] Support GGUF quantization for Ascend NPU (dense + MoE) (#17883)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-04-25 17:16:47 +03:00
Yujing 6175946db7 [Feature]Add MSProbe dump support in SGLang (#18349) 2026-04-25 10:12:50 +03:00
6d03861476 support Hy3 preview (#23533)
Co-authored-by: pengmeng <pengmeng@tencent.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: russellfeng <russellfeng@tencent.com>
2026-04-24 12:03:24 -07:00
Mick cd1fa7506a [diffusion] model: support LTX2.3 high quality pipeline (#23366) 2026-04-24 14:18:20 +08:00
zijiexia 6490afe36e [docs] add deprecation notice banner to legacy documentation site (#23516) 2026-04-22 20:17:53 -07:00
jianzhao-xuandJianzhao Xu 2f3e6a3143 [NPU] offloading docs update (#23378)
Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>
2026-04-22 11:01:55 +08:00
Yanbin Jiang 4f764dfbb8 [Lora] Support LoRA and multi-batch in bench_one_batch_server (#23047) 2026-04-21 14:20:11 -07:00
amote-i 301604f953 [NPU] [DOC] Quick start doc for Ascend NPU (#23238) 2026-04-21 11:19:09 +08:00
shuwennandQiaolin-Yu b65799cf83 [SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2026-04-20 14:25:04 -07:00
7ca3566130 Multi platform Plugin (#21388)
Co-authored-by: root <root@tjzj-inf-sci-k8s-bzz2-0183.tjzj.baidu.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Alex Nails <alexj.nails@gmail.com>
Co-authored-by: root <root@tjzj-inf-sci-k8s-bzz2-0000.tjzj.baidu.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-04-19 17:23:51 -07:00
amote-i ea20f1baa4 [NPU] [DOC] Update npu best practice docs to match latest code (#23077) 2026-04-18 14:17:00 +08:00
Mick 0d94c3366a [diffusion] feat: introduce ltx-2-two-stage device manager (#22869) 2026-04-18 11:04:33 +08:00
Xiaoyu Zhang 615d6c93b2 [codex] Add flashinfer TRTLLM backend for diffusion NVFP4 (#22717) 2026-04-18 09:06:28 +08:00
Lianmin Zheng 44e67c6835 Remove deprecated double sparsity feature (#23009) 2026-04-17 13:33:12 -07:00
Mick 0b2058853d [diffusion] doc: update doc (#23052) 2026-04-17 16:23:46 +08:00
Duyi-Wang 8c190f6b91 [AMD] Add SGLANG_MORI_MOE_MAX_INPUT_TOKENS to truncate dispatch before MoE. (#22952) 2026-04-16 23:40:15 -07:00
xdtbynd 53f87c463d [Docs] [npu] change the feature support status (#23041) 2026-04-17 14:34:54 +08:00
Jan Bernlöhr 04a53955b9 feat: add coordinated checkpoint prefetch for network filesystem loading (#20843) 2026-04-16 20:08:19 -07:00
Liangsheng Yin db7a751d48 refactor: extract FanOutCommunicator and use declarative spec table (#22967) 2026-04-16 15:37:19 -07:00
ybyang 41258f874d [PD]feat(bench): add --fake-prefill flag for decode-only stress testing (#22973) 2026-04-16 13:57:55 -07:00
Zaire 71377deda7 [Docs] fix profiling endpoint (#22982)
Signed-off-by: Zaire404 <3147879462@qq.com>
2026-04-16 12:51:39 -04:00
Yuhao Yang 9da998a882 [diffusion] feat: disaggregated diffusion (#21701) 2026-04-16 23:51:32 +08:00
amote-i 78147306b7 [NPU] [DOC] Update npu best practice docs to match latest code (#22975) 2026-04-16 20:45:22 +08:00
hhwxw 2480cc2a16 docs: fix incorrect default max-payload-size in gateway config reference (#22923) 2026-04-16 13:25:27 +08:00
Xiaoyu Zhang 695ab705cb [diffusion] quant: update modelopt quantization docs and CI coverage (#22772) 2026-04-15 21:30:28 +08:00
jianzhao-xuandJianzhao Xu 45a83ffbe3 [NPU] Offloading docs update (#22860)
Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>
2026-04-15 15:04:41 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 4.6 ada52e5972 [Docs] Move ptxas sm_103a workaround into For CUDA 13 section (#22852)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-14 22:30:21 -07:00
chx96642264 680bd4b429 [NPU] Modify the parameter name and optional values, and add the parameter restrictions. Modify some parameters supported type. (#22804) 2026-04-14 21:34:07 +08:00
McZyWuandroot 1588856e9b [NPU] qwen3next low latency best practice docs. (#22808)
Co-authored-by: root <root@localhost.localdomain>
2026-04-14 21:21:37 +08:00
amote-i ddc7daaf89 [NPU] [DOC] Update NPU docs to match latest code (#22796) 2026-04-14 21:10:28 +08:00
loading66 074c2a476d fix:[NPU]correct the full name of then Kimi model (#22799) 2026-04-14 20:15:22 +08:00
jianzhao-xuandJianzhao Xu 68dfffaaa3 Offloading docs update (#22795)
Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>
2026-04-14 20:03:29 +08:00
xdtbynd 88253c39b0 [Docs] Fix formatting of tool-call-parser options (#22793) 2026-04-14 19:21:31 +08:00
amote-i 368cdfbe2f [NPU] [DOC] Fix outdated descriptions in the NPU documentation (#22707) 2026-04-14 19:21:15 +08:00
Xiaoyu Zhang f97c608caa [diffusion] quant: add FLUX.1-dev modelopt nvfp4 support (#22672) 2026-04-14 15:00:59 +08:00
看海的人 13a4aafdbe [NPU] update glm5 running guide (#22712) 2026-04-13 22:53:24 +08:00
chx96642264 c6403a11cb Modify the optional values and constraints of parameter. (#22705) 2026-04-13 22:50:48 +08:00
jianzhao-xuandJianzhao Xu b6a91b1afe [NPU] --attn-cp-size --init-expert-location --eplb-algorithm parameter docs update (#22704)
Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>
2026-04-13 22:42:34 +08:00
Liwansi 8d904e50f2 [NPU]qwen3-8b and 32b md bugfix (#22687) 2026-04-13 22:20:17 +08:00
loading66andh30064329 2089ac86a7 Improve parameters usage constraints for npu deployment (#22700)
Co-authored-by: h30064329 <hanbing45@h-partners.com>
2026-04-13 22:02:56 +08:00
看海的人andzhsurpass 56c97c7738 [NPU] update npu doc (#22697)
Co-authored-by: zhsurpass <zhsurpass@users.noreply.github.com>
2026-04-13 21:55:38 +08:00
xdtbyndandxdtbynd d01b2bf257 [Docs] Fix default values and options in Ascend server arguments documentation (#22698)
Co-authored-by: xdtbynd <supercluster@vip.qq.com>
2026-04-13 21:22:37 +08:00
Polisetty V R K Jyothendra VarmaandMa Mingfei 7d2c11970c [Intel GPU] Upgrade pytorch xpu version to 2.11 (#21908)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-04-13 13:16:24 +08:00
Mick bf022e177c Revert "[Diffusion] Add FLUX.1-dev ModelOpt NVFP4 support (#22574)" (#22649) 2026-04-13 11:17:32 +08:00
Xiaoyu Zhang 37fc47c645 diffusion: fix layerwise offload for ModelOpt quantized DiTs (#22594) 2026-04-13 08:01:54 +08:00
Xiaoyu Zhang 03a1a7b81c [Diffusion] Add FLUX.1-dev ModelOpt NVFP4 support (#22574) 2026-04-13 07:57:41 +08:00
Mick 495ef8ec64 [diffusion] model: support LTX2.3 two stage (#22182) 2026-04-12 22:15:57 +08:00
Mohammad Miadh Angkad bcc0c65aa8 [DSA] Hopper FP8 FlashMLA KV padding (#22372) 2026-04-12 02:19:17 -07:00
Wenyao Gao 4dfc8e1c3f VLM: support passing --mm-process-config for all models (#18467) 2026-04-12 17:08:05 +08:00