 R0CKSTAR
|
0a37d24e62
|
[diffusion] hardware: support sage attention backend on MUSA (attn backend, 21/N) (#24752)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-05-11 19:50:52 -07:00 |
|
|
shuwenn
|
5495026a3b
|
[HiCache] feat: default storage prefetch timeout (#23309)
|
2026-05-11 18:49:35 -07:00 |
|
|
R0CKSTAR
|
74d70af09a
|
[Apple Silicon] Add Metal kernel support in sgl-kernel (#23449)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
|
2026-05-11 17:54:27 -07:00 |
|
|
Yihao Wang
|
7407a62c1c
|
[Docs] Update MiniCPM-V-4.6 documentation and deployment configuration (#24991)
|
2026-05-11 11:10:19 -07:00 |
|
|
Ke Bao
|
d9cb38012e
|
Update MiMo V2.5 cookbook image to nightly (#24983)
|
2026-05-11 22:04:31 +08:00 |
|
|
Ke Bao
|
62edbc37c4
|
[Doc] Add rerun-test slash command usage (#24979)
|
2026-05-11 21:30:01 +08:00 |
|
|
Ke Bao
|
9c03171f6c
|
Fix gb envs in deployment guide (#24977)
|
2026-05-11 21:06:02 +08:00 |
|
|
Mick
|
6e5b4de01a
|
[diffusion] fix: further align ltx2.3 accuracy with tp (#24660)
|
2026-05-11 13:42:08 +08:00 |
|
|
Junlin Wu
|
a623ee4cb5
|
📝 docs(diffusion): add MXFP8 quantization docs for Wan2.2 on Ascend NPU (#24918)
|
2026-05-11 08:13:34 +03:00 |
|
|
Yihao Wang
|
9f066cb55b
|
[Docs] Add MiniCPM-V 4.6 cookbook (#24876)
|
2026-05-10 21:32:15 -07:00 |
|
|
egvenediktov
|
2473659e76
|
[NPU]Documentation update for communications quantization feature (#24668)
|
2026-05-10 23:49:21 +03:00 |
|
|
|
d82e339ce2
|
[Session R3] Add routed_experts_start_len for absolute routing slice control (#24851)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
Co-authored-by: Yuzhen Zhou <82826991+zyzshishui@users.noreply.github.com>
|
2026-05-10 10:04:43 -07:00 |
|
|
|
ef5e9f8aba
|
[DSV4] Cherry pick missing commits from deepseek_v4 branch and enhance tests (#24793)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
|
2026-05-09 04:15:37 -07:00 |
|
|
Brayden Zhongandb8zhong
|
8f33bee31b
|
Reland Cute-DSL FP4 dense GEMM (#23590)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 02:20:58 -07:00 |
|
|
Jimmy Shong
|
096ad02b06
|
[Model] Laguna-XS.2 Model Support (#24204)
|
2026-05-09 05:43:13 +08:00 |
|
|
Mick
|
17888fa92a
|
[diffusion] doc: update ltx2 multi-gpu deployment guide (#24682)
|
2026-05-08 18:38:05 +08:00 |
|
|
amote-i
|
d32e283947
|
[NPU] [DOC] refresh npu supported model list (#24676)
|
2026-05-08 17:08:15 +08:00 |
|
|
amote-i
|
47e9ec11ad
|
[NPU] [DOC] fix ascend_npu_support_new_models TOC (#24658)
|
2026-05-08 14:07:00 +08:00 |
|
|
+6
|
35870d55ac
|
Deepseek V4 (#23882)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
|
2026-05-07 18:32:21 -07:00 |
|
|
Revanth Reddy Airre
|
be088f8076
|
fix(router): configure HTTP client connection settings (#24330)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
|
2026-05-07 11:42:45 -07:00 |
|
|
Revanth Reddy Airre
|
d363315de9
|
fix(router): make HTTP pool idle timeout configurable (#24329)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
|
2026-05-06 22:11:11 -07:00 |
|
|
Baizhou Zhang
|
7ec18f7e4e
|
[Doc] Fix instruction on Cuda 13 environments (#24516)
|
2026-05-06 02:37:23 -07:00 |
|
|
zijiexia
|
83b48fd523
|
[codex] update Nemotron3 Nano Omni cookbook benchmarks (#23998)
|
2026-05-05 14:53:15 -07:00 |
|
|
zijiexia
|
e0faed8ebc
|
[Docs] Add B200, GB200, GB300 NVIDIA hardware platform support for Kimi-K2.6 (#24441)
|
2026-05-05 14:53:05 -07:00 |
|
|
Khoa Pham
|
932d89690a
|
Gemma4-mtp cookbook (#24433)
|
2026-05-05 23:04:41 +08:00 |
|
|
Xiaoyu Zhang
|
8c703f215e
|
Add HunyuanVideo ModelOpt FP8 diffusion support (#23199)
|
2026-05-05 19:27:28 +08:00 |
|
|
Yuhao YangandClaude Opus 4.6
|
6279aee716
|
[docs] Update B300 Pro cookbook with accuracy-verified serving configs (#24367)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-05-05 07:26:03 +01:00 |
|
|
Mick
|
2f7d99b7f7
|
[diffusion] cli: support component attention backend overrides (#24320)
|
2026-05-05 08:39:27 +08:00 |
|
|
Liangsheng Yinandfzyzcjy
|
4743cf6051
|
misc: add marlin to moe runner choices; drop dead env var doc (#24384)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
|
2026-05-04 15:01:47 -07:00 |
|
|
Praneth Paruchuri
|
e93bb638bf
|
[docs]update sm75 to sm80 min gpu support (#24336)
|
2026-05-04 13:50:20 -07:00 |
|
|
Chi McIsaacandJunhao Liu
|
62265ca7fc
|
[diffusion] feat: initial support for dynamic batching (#18764)
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Junhao Liu <junhaoliu2023@gmail.com>
|
2026-05-04 00:44:42 +08:00 |
|
|
Xiaoyu ZhangandMick
|
f2d1390909
|
[Diffusion] Add Qwen Image ModelOpt FP8 support (#23155)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-05-04 00:24:22 +08:00 |
|
|
Glen Liu
|
76b9c8de6f
|
[Feature] add LoRADrainer to address high P99 TTFT (#17913)
|
2026-05-02 16:13:43 -07:00 |
|
|
Xiaoyu Zhang
|
589f90b368
|
[diffusion] chore: use lmsys as org for modelopt checkpoints (#23924)
|
2026-05-02 17:18:58 +08:00 |
|
|
zijiexia
|
8b23d32ec1
|
feat: implement workflow to sync LMSYS SGLang blog (#23438)
|
2026-04-30 16:17:29 -07:00 |
|
|
Brian
|
da07b22949
|
[Docs] quick fix delete --enable-dp-attention in sgl-jax (#24052)
|
2026-04-30 15:39:03 +08:00 |
|
|
Baizhou Zhang
|
b3ead32d3c
|
[minor] Remove incorrect note after supporting w4a16 moe for DeepSeek V4 (#24035)
|
2026-04-29 13:26:13 -07:00 |
|
|
|
3272af2f00
|
[Apple Silicon] [MLX] MLX decode partial overlap scheduling for generation (async eval) (#22416)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-04-29 12:21:14 -07:00 |
|
|
Xinyuan Tong
|
4cf109bbd1
|
debug followup (#24058)
|
2026-04-29 23:03:27 +08:00 |
|
|
Xinyuan Tong
|
1279ae0787
|
Bugfix (#24027)
|
2026-04-29 21:13:51 +08:00 |
|
|
hhwxw
|
d9270b8c6a
|
fix(moe): relocate orphan tuned configs after #23019 (#24004)
|
2026-04-29 02:00:13 -07:00 |
|
|
Brian
|
6c7b242181
|
mimo v2.5 pro sglang-jax cookbook (#23936)
|
2026-04-29 16:58:41 +08:00 |
|
|
Baizhou Zhang
|
4e885baa9b
|
docs(cookbook): add H200 (FP4) deployment option for DeepSeek-V4 (#23980)
|
2026-04-28 19:38:53 -07:00 |
|
|
zijiexia
|
387c932dfc
|
[Docs] update Docker image for Nemotron 3 Nano Omni (#23968)
|
2026-04-28 15:08:34 -07:00 |
|
|
AlonKejzman
|
66ea0aee7f
|
tokenizer: Add fastokens support (#23753)
|
2026-04-28 11:43:10 -07:00 |
|
|
zijiexia
|
ad785a2299
|
[Docs] add Nemotron 3 Nano Omni cookbook (#23907)
|
2026-04-28 10:24:40 -07:00 |
|
|
Xinyuan Tong
|
e458a9248f
|
docs: enable MiMo V2.5 MTP cookbook path (#23945)
|
2026-04-28 10:22:19 -07:00 |
|
|
Xinyuan Tong
|
3fce8f2009
|
[Docs] add cookbook for Ling-2.6 family (#23947)
|
2026-04-29 00:42:04 +08:00 |
|
|
Yuhao Yang
|
4e1ef6b3cf
|
[Docs] Add single-node H200 DeepSeek-V4-Pro low-latency recipe (#23943)
|
2026-04-28 23:03:26 +08:00 |
|
|
zijiexia
|
7ce2352323
|
[docs] fix sglang serve --model-path in cookbooks (#23905)
|
2026-04-27 21:54:21 -07:00 |
|