 Jimmy Shong
|
096ad02b06
|
[Model] Laguna-XS.2 Model Support (#24204)
|
2026-05-09 05:43:13 +08:00 |
|
|
Mick
|
17888fa92a
|
[diffusion] doc: update ltx2 multi-gpu deployment guide (#24682)
|
2026-05-08 18:38:05 +08:00 |
|
|
amote-i
|
d32e283947
|
[NPU] [DOC] refresh npu supported model list (#24676)
|
2026-05-08 17:08:15 +08:00 |
|
|
amote-i
|
47e9ec11ad
|
[NPU] [DOC] fix ascend_npu_support_new_models TOC (#24658)
|
2026-05-08 14:07:00 +08:00 |
|
|
+6
|
35870d55ac
|
Deepseek V4 (#23882)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
|
2026-05-07 18:32:21 -07:00 |
|
|
Revanth Reddy Airre
|
be088f8076
|
fix(router): configure HTTP client connection settings (#24330)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
|
2026-05-07 11:42:45 -07:00 |
|
|
Revanth Reddy Airre
|
d363315de9
|
fix(router): make HTTP pool idle timeout configurable (#24329)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
|
2026-05-06 22:11:11 -07:00 |
|
|
Baizhou Zhang
|
7ec18f7e4e
|
[Doc] Fix instruction on Cuda 13 environments (#24516)
|
2026-05-06 02:37:23 -07:00 |
|
|
zijiexia
|
83b48fd523
|
[codex] update Nemotron3 Nano Omni cookbook benchmarks (#23998)
|
2026-05-05 14:53:15 -07:00 |
|
|
zijiexia
|
e0faed8ebc
|
[Docs] Add B200, GB200, GB300 NVIDIA hardware platform support for Kimi-K2.6 (#24441)
|
2026-05-05 14:53:05 -07:00 |
|
|
Khoa Pham
|
932d89690a
|
Gemma4-mtp cookbook (#24433)
|
2026-05-05 23:04:41 +08:00 |
|
|
Xiaoyu Zhang
|
8c703f215e
|
Add HunyuanVideo ModelOpt FP8 diffusion support (#23199)
|
2026-05-05 19:27:28 +08:00 |
|
|
Yuhao YangandClaude Opus 4.6
|
6279aee716
|
[docs] Update B300 Pro cookbook with accuracy-verified serving configs (#24367)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-05-05 07:26:03 +01:00 |
|
|
Mick
|
2f7d99b7f7
|
[diffusion] cli: support component attention backend overrides (#24320)
|
2026-05-05 08:39:27 +08:00 |
|
|
Liangsheng Yinandfzyzcjy
|
4743cf6051
|
misc: add marlin to moe runner choices; drop dead env var doc (#24384)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
|
2026-05-04 15:01:47 -07:00 |
|
|
Praneth Paruchuri
|
e93bb638bf
|
[docs]update sm75 to sm80 min gpu support (#24336)
|
2026-05-04 13:50:20 -07:00 |
|
|
Chi McIsaacandJunhao Liu
|
62265ca7fc
|
[diffusion] feat: initial support for dynamic batching (#18764)
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Junhao Liu <junhaoliu2023@gmail.com>
|
2026-05-04 00:44:42 +08:00 |
|
|
Xiaoyu ZhangandMick
|
f2d1390909
|
[Diffusion] Add Qwen Image ModelOpt FP8 support (#23155)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-05-04 00:24:22 +08:00 |
|
|
Glen Liu
|
76b9c8de6f
|
[Feature] add LoRADrainer to address high P99 TTFT (#17913)
|
2026-05-02 16:13:43 -07:00 |
|
|
Xiaoyu Zhang
|
589f90b368
|
[diffusion] chore: use lmsys as org for modelopt checkpoints (#23924)
|
2026-05-02 17:18:58 +08:00 |
|
|
zijiexia
|
8b23d32ec1
|
feat: implement workflow to sync LMSYS SGLang blog (#23438)
|
2026-04-30 16:17:29 -07:00 |
|
|
Brian
|
da07b22949
|
[Docs] quick fix delete --enable-dp-attention in sgl-jax (#24052)
|
2026-04-30 15:39:03 +08:00 |
|
|
Baizhou Zhang
|
b3ead32d3c
|
[minor] Remove incorrect note after supporting w4a16 moe for DeepSeek V4 (#24035)
|
2026-04-29 13:26:13 -07:00 |
|
|
|
3272af2f00
|
[Apple Silicon] [MLX] MLX decode partial overlap scheduling for generation (async eval) (#22416)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-04-29 12:21:14 -07:00 |
|
|
Xinyuan Tong
|
4cf109bbd1
|
debug followup (#24058)
|
2026-04-29 23:03:27 +08:00 |
|
|
Xinyuan Tong
|
1279ae0787
|
Bugfix (#24027)
|
2026-04-29 21:13:51 +08:00 |
|
|
hhwxw
|
d9270b8c6a
|
fix(moe): relocate orphan tuned configs after #23019 (#24004)
|
2026-04-29 02:00:13 -07:00 |
|
|
Brian
|
6c7b242181
|
mimo v2.5 pro sglang-jax cookbook (#23936)
|
2026-04-29 16:58:41 +08:00 |
|
|
Baizhou Zhang
|
4e885baa9b
|
docs(cookbook): add H200 (FP4) deployment option for DeepSeek-V4 (#23980)
|
2026-04-28 19:38:53 -07:00 |
|
|
zijiexia
|
387c932dfc
|
[Docs] update Docker image for Nemotron 3 Nano Omni (#23968)
|
2026-04-28 15:08:34 -07:00 |
|
|
AlonKejzman
|
66ea0aee7f
|
tokenizer: Add fastokens support (#23753)
|
2026-04-28 11:43:10 -07:00 |
|
|
zijiexia
|
ad785a2299
|
[Docs] add Nemotron 3 Nano Omni cookbook (#23907)
|
2026-04-28 10:24:40 -07:00 |
|
|
Xinyuan Tong
|
e458a9248f
|
docs: enable MiMo V2.5 MTP cookbook path (#23945)
|
2026-04-28 10:22:19 -07:00 |
|
|
Xinyuan Tong
|
3fce8f2009
|
[Docs] add cookbook for Ling-2.6 family (#23947)
|
2026-04-29 00:42:04 +08:00 |
|
|
Yuhao Yang
|
4e1ef6b3cf
|
[Docs] Add single-node H200 DeepSeek-V4-Pro low-latency recipe (#23943)
|
2026-04-28 23:03:26 +08:00 |
|
|
zijiexia
|
7ce2352323
|
[docs] fix sglang serve --model-path in cookbooks (#23905)
|
2026-04-27 21:54:21 -07:00 |
|
|
Xiaoyu Zhang
|
6fbad22feb
|
Remove smoke wording from tests and comments (#23355)
|
2026-04-28 12:05:27 +08:00 |
|
|
Baizhou Zhang
|
3177fa7951
|
Enable DeepGemm warmup in DeepSeek-V4 cookbook (#23883)
|
2026-04-27 18:41:12 -07:00 |
|
|
Pai Liu
|
7b9ff79f93
|
docs: update Python prerequisite to 3.10 (#23801)
|
2026-04-27 15:36:38 -07:00 |
|
|
Xinyuan Tong
|
f34222da1b
|
[Docs] add cookbook for MiMo-V2.5 family (#23851)
|
2026-04-28 01:38:41 +08:00 |
|
|
1874.
|
47b8eadbc4
|
[Docs] Update Ascend NPU GGUF quantization documentation (#23845)
|
2026-04-27 17:30:24 +03:00 |
|
|
amote-i
|
06725ecf0d
|
[NPU] [DOC] Add support new models doc for NPU (#23824)
|
2026-04-27 17:13:23 +08:00 |
|
|
zijiexia
|
c2ec64f243
|
docs: verify GB300 Pro DeepSeek V4 recipes (#23817)
|
2026-04-27 00:21:26 -07:00 |
|
|
Yujing
|
9ec4aa1b5c
|
[Doc]Add msprobe doc in docs_new path (#23712)
|
2026-04-27 10:06:50 +03:00 |
|
|
zijiexia
|
c74b345e3a
|
[docs] Update FA4 support SWA (#23793)
|
2026-04-26 20:40:36 -07:00 |
|
|
zijiexia
|
3d95ca7546
|
docs(DeepSeek-V4): mark gb200|big|low-latency verified (#23737)
|
2026-04-26 11:15:59 -07:00 |
|
|
Ethan (Yusheng) Su
|
3cfd1561df
|
docs(DeepSeek-V4): add h200|big verified recipes + tune H200 Pro parameters (#23742)
|
2026-04-25 21:44:51 -07:00 |
|
|
Yuhao Yang
|
049f1bf6fb
|
docs(DeepSeek-V4): add GB200 platform to cookbook recipe (#23725)
|
2026-04-25 20:54:55 -07:00 |
|
|
fzyzcjy
|
d4c1665626
|
docs(DeepSeek-V4): mark h200|big|pd-disagg verified + recipe fixes (#23715)
|
2026-04-25 22:49:12 +08:00 |
|
|
fzyzcjy
|
880599cd43
|
docs(DeepSeek-V4): bump GB300 Pro PD decode --mem-fraction-static 0.83 → 0.9 (#23698)
|
2026-04-25 16:35:44 +08:00 |
|