Commit Graph
205 Commits
Author SHA1 Message Date
Xiaoyu Zhang f61163b4b0 [Docs] Let the Qwen3 B300 recipe use the default attention backend (#43554) 2026-10-10 10:00:04 -07:00
MickandMick Qian a65f4ffba5 [diffusion] docs: standardize diffusion cookbook command builders (#43472)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-10 11:14:31 +08:00
436d73ddda [diffusion] model: support HunyuanImage-3.0-Instruct (#36311)
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: wes-lyu <294033513+wes-lyu@users.noreply.github.com>
Co-authored-by: Wes <its.wesley.lyu@gmail.com>
Co-authored-by: AuFlow <73925903+AuFlow@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-10 11:11:28 +08:00
MickandMick Qian 77ba54f7df [diffusion] docs: add Wan-Animate-2 cookbook command picker (#43380)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-10 09:45:16 +08:00
MickandMick Qian cde16aa64d [diffusion] model: support Qwen-Image 2.1 Turbo and checkpoint sampling grids (#43391)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-10 09:12:56 +08:00
Jimmy Shong 408f5d057a docs: add Clef accuracy results to the deployment wizard (#43349) 2026-10-09 22:19:27 +08:00
f1e0472fcc [diffusion] model: support Wan-Animate-2 (#42941)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-09 20:46:23 +08:00
vOvandXiaoyu Zhang 7cfecbef56 [diffusion][model] Add native SANA-Video 2.0 support (#41492)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-09 17:28:03 +08:00
Jimmy Shong 14e3414513 [Docs] Add Clef cookbook with selectable Clef Flash variant (#43235) 2026-10-09 01:56:45 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1fc6b8962c [Docs] Cookbook: AgentX launches for Qwen3.5 / Qwen3.8-Flash-Next; refresh GLM-5.2, DeepSeek-V4, DeepSeek-V4.1 (#43083)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 13:55:35 +08:00
Liangsheng Yin b4fe282836 [MemCache] Delete ChunkCache (#43201) 2026-10-08 17:31:16 -07:00
Ankur Singh 2b94cb4eb5 docs(cookbook): add Qwen3.8 GB300 long-context recipe (#43159)
Signed-off-by: Ankur-singh <ankusingh@nvidia.com>
2026-10-08 16:56:30 -07:00
4f320fb85a [diffusion] perf: FastH3 8-Step V2 native support, native Blackwell VSA and batched H3 VAE decode (#37662)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-08 14:35:27 +08:00
Thomas Wang b72da1b817 [AMD] Update v4 amd cookbook 1008 (#43033) 2026-10-08 11:18:41 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 7b6b6ee25e [Docs] Cookbook: interactive SemiAnalysis InferenceX AgentX launches for GLM-5.2, DeepSeek-V4 and DeepSeek-V4.1 (#42726)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 09:33:40 +08:00
Richard Wang 5cb7fb886c [Feature] support pplx-decider-v1.1 and update the pplx-decider cookbooks (#42645) 2026-10-08 09:03:50 +08:00
Kevin MiandClaude Opus 5.5 79ef49cb6b [Docs] GLM-5.3-Flash: measured MI355X MXFP4 agentic recipe (#43015)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 15:49:49 -07:00
Thomas Wang 9a21d82958 [AMD] Update v4.1 amd cookbook 1006 (#42847) 2026-10-06 19:58:58 -07:00
7a4d6dfd2f [diffusion] feat: name the quality tiers after what they guarantee (#42370)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-10-07 09:49:30 +08:00
Duyi-Wang 66dd4e15b9 [AMD][Docs] Add MI355X DeepSeek-V4 Pro PD recipes (#42757) 2026-10-06 16:58:40 -07:00
16a23a672b [diffusion] model: support Kandinsky 6 (#42743)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Lev Novitskiy <57654885+leffff@users.noreply.github.com>
Co-authored-by: Kirill <kykozlov@gmail.com>
Co-authored-by: Artem Borisov <divotionchannel@gmail.com>
2026-10-06 22:13:29 +08:00
Zhang, Jiejing c76faa1ff2 docs(cookbook): enable Top-K v2 for GLM-5.2 MI355X MTP (#42613) 2026-10-06 11:33:24 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 f2f0be731c [Docs] GLM-5.2: move GB300 AgentX recipe to the agentic HiCache section and drop no-op settings (#42167)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:40:30 +08:00
Yash AkhauriandXiaoyu Zhang 36b216e2ee [Docs] Refresh K2 Horizon checkpoint revisions (#42130)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-06 09:19:04 +08:00
438d9d2074 [Feature] DeepEP v2: expanded (do_expand=True) prefill dispatch (#37261)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-10-05 00:02:10 -07:00
billishyahao 0343bc1483 [AMD][Docs] fix mori io and umbp playground (#42512) 2026-10-04 09:28:11 -07:00
Richard WangandRichard Wang 482b062d28 [Feature] serve pplx-decider decision checkpoints on /v1/systemone (#42183)
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
2026-10-03 10:18:53 +08:00
Kedar PotdarandClaude Opus 5.5 8acd36b56b [Docs] GLM-5.2 GB300 NVFP4: add env vars from InferenceX AgentX recipe (#42109)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-02 09:11:29 +08:00
f17f7705a5 [AMD] [GLM-5.3-Flash] Enable FP8 and MXFP4 serving on gfx950 (#39273)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: long10024070 <long10024070@users.noreply.github.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: sunxxuns <126995791+sunxxuns@users.noreply.github.com>
Co-authored-by: Long Luong <long.luong2+personal@onemount.com>
2026-10-01 15:59:44 -07:00
Mohammad Miadh AngkadandMohammad Angkad 40e1bb0f36 [Docs] Add NVIDIA NVFP4 checkpoint to GLM-5.3-Flash cookbook (#41986)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-01 12:15:30 +08:00
MickandMick Qian 2ab1b537f8 [diffusion] docs: recommend docker for gpu deployments (#41966)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-01 09:52:31 +08:00
Yu-Yun Changandkk 6af651ea0c [AMD][Quark] Serve the Kimi-K3 MXFP4 checkpoint on ROCm (#40811)
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
2026-09-30 18:14:15 -07:00
Cheng Wan a9c97c9f69 [Feature] Add --attn-dp-size and deprecate --enable-dp-attention (#41818) 2026-09-30 13:34:18 -07:00
Kevin MiandKevin Mi 3a398442bf dsv4.1-amd: serve DeepSeek-V4.1 on gfx950 (#41308)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
2026-09-30 11:47:14 -07:00
jacky.cheng 47dcde70f4 [Docs] Add MI355X FP8 agentic recipe to the Qwen3.5 cookbook (#41849) 2026-09-30 17:44:19 +08:00
amote-i 964c45cf31 [NPU] [DOC]: add Kimi-K3 NPU PD disaggregation recipes (#41717) 2026-09-30 16:42:46 +08:00
WenhaoZhang 49d26ff0c2 [diffusion] model: support flux 3 action robot policies (#41066) 2026-09-29 10:17:19 +08:00
79cafec013 [Model] Add IQuest Q1 support and MTP draft (#41590)
Co-authored-by: zelong huang <yzhu@ubiquant.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: zelong518 <zelonghuang05@gmail.com>
Co-authored-by: chenwenxiaolive <cocoshirolive@gmail.com>
2026-09-28 17:21:31 -07:00
Stanislav PetrovandStanislav Petrov b95329a74d [Docs] Add GigaChat 3.5 and GigaChat 3.5 Reasoning cookbook pages (#41118)
Co-authored-by: Stanislav Petrov <stapetrov@sberbank.ru>
2026-09-29 08:16:22 +08:00
Thomas Wang b252aceffe [AMD] Update v4 cookbook for megamoe, fp8 kv attn, BCG (#41458) 2026-09-27 10:53:21 -07:00
MickandMick Qian 2ee82fe158 [diffusion] model: support Anima Base v1.0 (#41011)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-26 09:53:51 +08:00
Liangsheng Yin f337f01b80 [Test] Remove dead eval modules and point GSM8K/MMLU docs to sgl-eval (#41215) 2026-09-25 12:50:31 -07:00
MickandMick Qian 0fb699ac03 [diffusion] model: support Ming-Image Design and Design-Layer (#41067)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-25 14:44:37 +08:00
Qiaolin Yu a1eb691ab5 [Docs] Enable Qwen3.8 Flash Next NVIDIA NVFP4 on B200/B300/GB300 (#41046) 2026-09-24 14:19:00 -07:00
ChangLiu0709 6a14b80141 [AMD] GLM-5.2 MI355X MXFP4: bump image to 20260923 daily (#41109) 2026-09-24 12:02:01 -07:00
Theresa Shan 7a9feacf91 [Docs] DeepSeek-V4 MI355X Pro Official PD pairs with DSpark and UMBP (#41024) 2026-09-23 21:48:27 -07:00
zijiexiaandClaude Opus 5.5 ffac53d779 [Doc] Add H200 recipes to MiMo-V2.6 cookbook (#40969)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-23 16:49:35 -07:00
James LiuandClaude Opus 5.5 208f6f7501 [Spec] Support DFLASH for Kimi K3 (#40794)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-23 15:58:39 -07:00
a3d11f9d95 [diffusion] feat: support permanent lifetime for layerwise resident layers (#40599)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-23 13:49:09 +08:00
Liangsheng Yin 78980a3b0b [misc] Remove deprecated endpoints, env vars and aliases past two releases (#40795) 2026-09-22 18:14:45 -07:00