Commit Graph
336 Commits
Author SHA1 Message Date
121aa8dcc7 [diffusion] perf: fuse MiniMax-H3's RMSNorm and indexed AdaLN under quality lossless (#43327)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 22:39:11 +08:00
Jimmy Shong 408f5d057a docs: add Clef accuracy results to the deployment wizard (#43349) 2026-10-09 22:19:27 +08:00
1203eb9181 [diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against attention over the copy engine (#43164)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 22:04:29 +08:00
f1e0472fcc [diffusion] model: support Wan-Animate-2 (#42941)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-09 20:46:23 +08:00
59eb71a831 [diffusion] fix: align SGLD CFG combine formula with diffusers Z-Image (#23772)
Co-authored-by: SGLang CI <ci@sglang.ai>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-09 19:47:03 +08:00
vOvandXiaoyu Zhang 7cfecbef56 [diffusion][model] Add native SANA-Video 2.0 support (#41492)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-09 17:28:03 +08:00
Jimmy Shong 14e3414513 [Docs] Add Clef cookbook with selectable Clef Flash variant (#43235) 2026-10-09 01:56:45 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1fc6b8962c [Docs] Cookbook: AgentX launches for Qwen3.5 / Qwen3.8-Flash-Next; refresh GLM-5.2, DeepSeek-V4, DeepSeek-V4.1 (#43083)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 13:55:35 +08:00
Baizhou Zhang 33bffcd490 [CP] GLM-5.3-Flash Prefill CP implemented on layer boundaries (#42044) 2026-10-08 20:42:11 -07:00
Liangsheng Yin b4fe282836 [MemCache] Delete ChunkCache (#43201) 2026-10-08 17:31:16 -07:00
Ankur Singh 2b94cb4eb5 docs(cookbook): add Qwen3.8 GB300 long-context recipe (#43159)
Signed-off-by: Ankur-singh <ankusingh@nvidia.com>
2026-10-08 16:56:30 -07:00
d1ba943016 [Model] Add support for EmbeddingGemma 2 (#42782)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 13:54:45 -07:00
4f320fb85a [diffusion] perf: FastH3 8-Step V2 native support, native Blackwell VSA and batched H3 VAE decode (#37662)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-08 14:35:27 +08:00
Thomas Wang b72da1b817 [AMD] Update v4 amd cookbook 1008 (#43033) 2026-10-08 11:18:41 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 7b6b6ee25e [Docs] Cookbook: interactive SemiAnalysis InferenceX AgentX launches for GLM-5.2, DeepSeek-V4 and DeepSeek-V4.1 (#42726)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 09:33:40 +08:00
Richard Wang 5cb7fb886c [Feature] support pplx-decider-v1.1 and update the pplx-decider cookbooks (#42645) 2026-10-08 09:03:50 +08:00
Kevin MiandClaude Opus 5.5 79ef49cb6b [Docs] GLM-5.3-Flash: measured MI355X MXFP4 agentic recipe (#43015)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 15:49:49 -07:00
Thomas Wang 9a21d82958 [AMD] Update v4.1 amd cookbook 1006 (#42847) 2026-10-06 19:58:58 -07:00
7a4d6dfd2f [diffusion] feat: name the quality tiers after what they guarantee (#42370)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-10-07 09:49:30 +08:00
MickandMick Qian 1351f32bb4 [diffusion] refactor: simplify Kandinsky 6 models, SR sampling and tests (#42768)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 08:48:16 +08:00
Duyi-Wang 66dd4e15b9 [AMD][Docs] Add MI355X DeepSeek-V4 Pro PD recipes (#42757) 2026-10-06 16:58:40 -07:00
WenhaoZhangandMick 2579875b5d [diffusion] feat: support loading community ComfyUI-GGUF Qwen-Image-2.1 transformers (#42556)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-06 23:30:48 +08:00
16a23a672b [diffusion] model: support Kandinsky 6 (#42743)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Lev Novitskiy <57654885+leffff@users.noreply.github.com>
Co-authored-by: Kirill <kykozlov@gmail.com>
Co-authored-by: Artem Borisov <divotionchannel@gmail.com>
2026-10-06 22:13:29 +08:00
WMCandjacky.cheng ba94488b42 [diffusion] feat: default Qwen-Image 2.1 to VAE tiling on gfx1151 (#41655)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-10-06 20:20:58 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 f2f0be731c [Docs] GLM-5.2: move GB300 AgentX recipe to the agentic HiCache section and drop no-op settings (#42167)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:40:30 +08:00
Yash AkhauriandXiaoyu Zhang 36b216e2ee [Docs] Refresh K2 Horizon checkpoint revisions (#42130)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-06 09:19:04 +08:00
3120bb87a2 [diffusion] fix: fix the OOM hint's placement advice and add a 24 GB Wan2.1 recipe (#41723)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:01:02 +08:00
c83c84b422 [diffusion] chore: keep the DiT off component offload under explicit multi-GPU fsdp (#41722)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 21:56:52 +08:00
MickandMick Qian 83a6e1d39b [diffusion] docs: keep model compatibility details in cookbook recipes (#42227)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 20:02:43 +08:00
WenhaoZhangandMick Qian f048d5aa4b [diffusion] feat: add community LoRA recipes and Kohya mapping (#35857)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 18:22:56 +08:00
billishyahao 0343bc1483 [AMD][Docs] fix mori io and umbp playground (#42512) 2026-10-04 09:28:11 -07:00
WenhaoZhang 44fac689f5 [diffusion] optimization: decode json pixel lists to numpy at the entrypoint (#41895) 2026-10-04 22:20:20 +08:00
Baizhou Zhang fccc61c1c5 [CP] Support DP x TP x CP for attention with interleave CP strategy (#42038) 2026-10-03 20:57:36 -07:00
Richard WangandRichard Wang 482b062d28 [Feature] serve pplx-decider decision checkpoints on /v1/systemone (#42183)
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
2026-10-03 10:18:53 +08:00
Zhang, Jiejing cbe070b6bf [Docs][AMD] Update GLM-5.2 MI355X daily image to 20260930 (#42278) 2026-10-02 15:39:07 -07:00
Alex O. P.andPo-Han Huang e667ab10d5 [diffusion] quantization: ConvRot INT8 online W8A8 for DiTs (sgl-kernel + convrot_int8_customkernel) (#38040)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
2026-10-02 23:26:28 +08:00
f17f7705a5 [AMD] [GLM-5.3-Flash] Enable FP8 and MXFP4 serving on gfx950 (#39273)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: long10024070 <long10024070@users.noreply.github.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: sunxxuns <126995791+sunxxuns@users.noreply.github.com>
Co-authored-by: Long Luong <long.luong2+personal@onemount.com>
2026-10-01 15:59:44 -07:00
Mohammad Miadh AngkadandMohammad Angkad 40e1bb0f36 [Docs] Add NVIDIA NVFP4 checkpoint to GLM-5.3-Flash cookbook (#41986)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-01 12:15:30 +08:00
MickandMick Qian 2ab1b537f8 [diffusion] docs: recommend docker for gpu deployments (#41966)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-01 09:52:31 +08:00
Yu-Yun Changandkk 6af651ea0c [AMD][Quark] Serve the Kimi-K3 MXFP4 checkpoint on ROCm (#40811)
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
2026-09-30 18:14:15 -07:00
Cheng Wan a9c97c9f69 [Feature] Add --attn-dp-size and deprecate --enable-dp-attention (#41818) 2026-09-30 13:34:18 -07:00
Kevin MiandKevin Mi 3a398442bf dsv4.1-amd: serve DeepSeek-V4.1 on gfx950 (#41308)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
2026-09-30 11:47:14 -07:00
jacky.cheng 47dcde70f4 [Docs] Add MI355X FP8 agentic recipe to the Qwen3.5 cookbook (#41849) 2026-09-30 17:44:19 +08:00
amote-i 964c45cf31 [NPU] [DOC]: add Kimi-K3 NPU PD disaggregation recipes (#41717) 2026-09-30 16:42:46 +08:00
zijiexiaandClaude Sonnet 5.5 f884231f5a [Docs] Add IQuestLab card logo to cookbook landing page (#41746)
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-09-29 12:47:21 -07:00
MickandMick Qian dc1bd46802 [diffusion] feat: support bounded exact conditioning cache across native models (#40470)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-29 15:27:22 +08:00
WenhaoZhang 49d26ff0c2 [diffusion] model: support flux 3 action robot policies (#41066) 2026-09-29 10:17:19 +08:00
79cafec013 [Model] Add IQuest Q1 support and MTP draft (#41590)
Co-authored-by: zelong huang <yzhu@ubiquant.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: zelong518 <zelonghuang05@gmail.com>
Co-authored-by: chenwenxiaolive <cocoshirolive@gmail.com>
2026-09-28 17:21:31 -07:00
Stanislav PetrovandStanislav Petrov b95329a74d [Docs] Add GigaChat 3.5 and GigaChat 3.5 Reasoning cookbook pages (#41118)
Co-authored-by: Stanislav Petrov <stapetrov@sberbank.ru>
2026-09-29 08:16:22 +08:00
Zhang, Jiejing 26d7539799 [Docs][AMD] Update GLM-5.2 MI355X daily image (#41597) 2026-09-28 15:42:54 -07:00