Commit Graph
30 Commits
Author SHA1 Message Date
Jimmy Shong 096ad02b06 [Model] Laguna-XS.2 Model Support (#24204) 2026-05-09 05:43:13 +08:00
amote-i d32e283947 [NPU] [DOC] refresh npu supported model list (#24676) 2026-05-08 17:08:15 +08:00
Revanth Reddy Airre be088f8076 fix(router): configure HTTP client connection settings (#24330)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
2026-05-07 11:42:45 -07:00
Revanth Reddy Airre d363315de9 fix(router): make HTTP pool idle timeout configurable (#24329)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
2026-05-06 22:11:11 -07:00
Baizhou Zhang 7ec18f7e4e [Doc] Fix instruction on Cuda 13 environments (#24516) 2026-05-06 02:37:23 -07:00
Xiaoyu Zhang 8c703f215e Add HunyuanVideo ModelOpt FP8 diffusion support (#23199) 2026-05-05 19:27:28 +08:00
Mick 2f7d99b7f7 [diffusion] cli: support component attention backend overrides (#24320) 2026-05-05 08:39:27 +08:00
Liangsheng Yinandfzyzcjy 4743cf6051 misc: add marlin to moe runner choices; drop dead env var doc (#24384)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
2026-05-04 15:01:47 -07:00
Praneth Paruchuri e93bb638bf [docs]update sm75 to sm80 min gpu support (#24336) 2026-05-04 13:50:20 -07:00
Chi McIsaacandJunhao Liu 62265ca7fc [diffusion] feat: initial support for dynamic batching (#18764)
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Junhao Liu <junhaoliu2023@gmail.com>
2026-05-04 00:44:42 +08:00
Xiaoyu ZhangandMick f2d1390909 [Diffusion] Add Qwen Image ModelOpt FP8 support (#23155)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-05-04 00:24:22 +08:00
Glen Liu 76b9c8de6f [Feature] add LoRADrainer to address high P99 TTFT (#17913) 2026-05-02 16:13:43 -07:00
Xiaoyu Zhang 589f90b368 [diffusion] chore: use lmsys as org for modelopt checkpoints (#23924) 2026-05-02 17:18:58 +08:00
3272af2f00 [Apple Silicon] [MLX] MLX decode partial overlap scheduling for generation (async eval) (#22416)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-04-29 12:21:14 -07:00
hhwxw d9270b8c6a fix(moe): relocate orphan tuned configs after #23019 (#24004) 2026-04-29 02:00:13 -07:00
AlonKejzman 66ea0aee7f tokenizer: Add fastokens support (#23753) 2026-04-28 11:43:10 -07:00
Pai Liu 7b9ff79f93 docs: update Python prerequisite to 3.10 (#23801) 2026-04-27 15:36:38 -07:00
1874. 47b8eadbc4 [Docs] Update Ascend NPU GGUF quantization documentation (#23845) 2026-04-27 17:30:24 +03:00
amote-i 06725ecf0d [NPU] [DOC] Add support new models doc for NPU (#23824) 2026-04-27 17:13:23 +08:00
Yujing 9ec4aa1b5c [Doc]Add msprobe doc in docs_new path (#23712) 2026-04-27 10:06:50 +03:00
zijiexia c74b345e3a [docs] Update FA4 support SWA (#23793) 2026-04-26 20:40:36 -07:00
amote-i 11d77a60df [NPU] [DOC] Update supported models and features of npu (#23564) 2026-04-25 15:37:07 +08:00
shuwenn f30a6f4d7e [DOC] Add DFLASH speculative decoding documentation (#23553) 2026-04-24 17:18:46 -07:00
Mick cd1fa7506a [diffusion] model: support LTX2.3 high quality pipeline (#23366) 2026-04-24 14:18:20 +08:00
Zaili Wang cbc2bee547 [Intel CPU/XPU] SGL doc updates (#23547)
merge this one as doc change only.
2026-04-24 09:23:27 +08:00
amote-i 18f3310aad [NPU] [DOC] Update Ascend NPU best practice (#23459) 2026-04-22 17:51:28 +08:00
zijiexia 1408d97408 [Docs] Improve SGLang Diffusion docs navigation and compatibility table (#23411) 2026-04-21 16:59:42 -07:00
zijiexia e22dfe8fc2 [Docs] Update installation and TPU documentation to fix the render problem (#23344) 2026-04-21 01:12:50 -07:00
zijiexiaandMingyi 900aad5f72 [Docs] Sync docs_new with legacy docs and update migration redirects (#23337)
Co-authored-by: Mingyi <wisclmy0611@gmail.com>
2026-04-21 00:15:17 -07:00
+15 a3291b5654 Add new Mintlify documentation site (docs_new/) (#23001)
Co-authored-by: AdityaVKochar <adityavardhankochar@gmail.com>
Co-authored-by: mintlify[bot] <109931778+mintlify[bot]@users.noreply.github.com>
Co-authored-by: adhyan-jain <adhyanjain2006@gmail.com>
Co-authored-by: Adhyan Jain <71976554+adhyan-jain@users.noreply.github.com>
Co-authored-by: Maitri-shah29 <maitrirajivshah@gmail.com>
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
Co-authored-by: Maitri Shah <shah29maitri@gmail.com>
Co-authored-by: Aditya Vardhan Kochar <80113212+AdityaVKochar@users.noreply.github.com>
Co-authored-by: Rishit Shivam <164783543+pokymono@users.noreply.github.com>
Co-authored-by: Rishitshivam <164783543+Rishitshivam@users.noreply.github.com>
Co-authored-by: IshhanKheria <ishhankheria06@gmail.com>
Co-authored-by: Ishita Joshi <ishitata.joshi@gmail.com>
Co-authored-by: Richard Chen <104477092+Richardczl98@users.noreply.github.com>
Co-authored-by: longGGGGGG <553746008@qq.com>
Co-authored-by: Richard <richardchen@radixark.ai>
Co-authored-by: Nakul Sinha <nakul.new4socials@gmail.com>
Co-authored-by: Divyam Agrawal <ludicrouslytrue@gmail.com>
Co-authored-by: Richardczl98 <Zhenlinc@stanford.edu>
Co-authored-by: Krishang Zinzuwadia <krishangzinzuwadia@gmail.com>
Co-authored-by: nimeshas <nimesha.s106@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jignas Paturu <86356085+JignasP@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-04-20 15:10:22 -07:00