Cheng Wan
|
dc0b394471
|
[Refactor] Remove Kimi K3's own layer communication and let the consumer set an FFN's exit (#42936)
|
2026-10-09 01:27:46 -07:00 |
|
Cheng Wan
|
305ad5503d
|
[Refactor] Run Kimi K3's fused collectives through stage boundaries (#42898)
|
2026-10-09 01:27:23 -07:00 |
|
Cheng Wan
|
2b469040d2
|
[Refactor] Support attention-TP dense FFNs and unpadded batches on stage boundaries (#42897)
|
2026-10-09 01:27:00 -07:00 |
|
Cheng Wan
|
125f88cb75
|
[Refactor] Run Kimi K3 through stage boundaries (#42894)
|
2026-10-09 01:25:51 -07:00 |
|
Cheng Wan
|
48a6c0a5d0
|
[Fix] Return an FFN's output to the attention rows at a pipeline handoff (#42892)
|
2026-10-09 01:25:05 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
1fc6b8962c
|
[Docs] Cookbook: AgentX launches for Qwen3.5 / Qwen3.8-Flash-Next; refresh GLM-5.2, DeepSeek-V4, DeepSeek-V4.1 (#43083)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 13:55:35 +08:00 |
|
Baizhou Zhang
|
33bffcd490
|
[CP] GLM-5.3-Flash Prefill CP implemented on layer boundaries (#42044)
|
2026-10-08 20:42:11 -07:00 |
|
Liangsheng Yin
|
b4fe282836
|
[MemCache] Delete ChunkCache (#43201)
|
2026-10-08 17:31:16 -07:00 |
|
Ankur Singh
|
2b94cb4eb5
|
docs(cookbook): add Qwen3.8 GB300 long-context recipe (#43159)
Signed-off-by: Ankur-singh <ankusingh@nvidia.com>
|
2026-10-08 16:56:30 -07:00 |
|
 
|
e902207a4e
|
[Speculative] Support block verification for the DFlash family (#43012)
Co-authored-by: maocheng <mao.cheng@MacBook-Pro-MD663G60VV.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 13:59:52 -07:00 |
|
 
|
d1ba943016
|
[Model] Add support for EmbeddingGemma 2 (#42782)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 13:54:45 -07:00 |
|
 
|
f795fe352d
|
[Test] Add a docs drift check for server_arguments.mdx (#38520)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:37:22 -07:00 |
|
  
|
4f320fb85a
|
[diffusion] perf: FastH3 8-Step V2 native support, native Blackwell VSA and batched H3 VAE decode (#37662)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-08 14:35:27 +08:00 |
|
Thomas Wang
|
b72da1b817
|
[AMD] Update v4 amd cookbook 1008 (#43033)
|
2026-10-08 11:18:41 +08:00 |
|
 
|
c892301ff7
|
[Platform] Thread vendor KV pool classes through the in-tree builders; add PlatformCapabilities (#35594)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
|
2026-10-07 19:16:10 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
7b6b6ee25e
|
[Docs] Cookbook: interactive SemiAnalysis InferenceX AgentX launches for GLM-5.2, DeepSeek-V4 and DeepSeek-V4.1 (#42726)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 09:33:40 +08:00 |
|
Richard Wang
|
5cb7fb886c
|
[Feature] support pplx-decider-v1.1 and update the pplx-decider cookbooks (#42645)
|
2026-10-08 09:03:50 +08:00 |
|
 Kevin MiandClaude Opus 5.5
|
79ef49cb6b
|
[Docs] GLM-5.3-Flash: measured MI355X MXFP4 agentic recipe (#43015)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 15:49:49 -07:00 |
|
Thomas Wang
|
9a21d82958
|
[AMD] Update v4.1 amd cookbook 1006 (#42847)
|
2026-10-06 19:58:58 -07:00 |
|
 
|
7a4d6dfd2f
|
[diffusion] feat: name the quality tiers after what they guarantee (#42370)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-07 09:49:30 +08:00 |
|
Eddie A. Tsai
|
e13933c4fd
|
[diffusion] docs: add gfx1151 Strix Halo serving guidance (#41670)
|
2026-10-07 09:14:07 +08:00 |
|
 MickandMick Qian
|
1351f32bb4
|
[diffusion] refactor: simplify Kandinsky 6 models, SR sampling and tests (#42768)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-07 08:48:16 +08:00 |
|
Baizhou Zhang
|
f497b626b6
|
build: use one DeepEP ref for implementation and packaging (#42827)
|
2026-10-06 17:04:28 -07:00 |
|
Duyi-Wang
|
66dd4e15b9
|
[AMD][Docs] Add MI355X DeepSeek-V4 Pro PD recipes (#42757)
|
2026-10-06 16:58:40 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
3eec178e48
|
[Spec][MegaMoE] Let the speculative draft choose its own W4A4 MXFP4 MegaMoE MMA type (#42022)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 14:09:57 -07:00 |
|
 WenhaoZhangandMick
|
2579875b5d
|
[diffusion] feat: support loading community ComfyUI-GGUF Qwen-Image-2.1 transformers (#42556)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-06 23:30:48 +08:00 |
|
   
|
16a23a672b
|
[diffusion] model: support Kandinsky 6 (#42743)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Lev Novitskiy <57654885+leffff@users.noreply.github.com>
Co-authored-by: Kirill <kykozlov@gmail.com>
Co-authored-by: Artem Borisov <divotionchannel@gmail.com>
|
2026-10-06 22:13:29 +08:00 |
|
 WMCandjacky.cheng
|
ba94488b42
|
[diffusion] feat: default Qwen-Image 2.1 to VAE tiling on gfx1151 (#41655)
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-06 20:20:58 +08:00 |
|
Max Kong
|
01345197af
|
[diffusion] chore: harden OpenAI upload filename handling (#17270)
=
|
2026-10-06 16:14:39 +08:00 |
|
  
|
e446698cdd
|
[SM120&90] Add CUDA fused Triton sparse-MLA prefill backend for DSA (#32779)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
|
2026-10-05 21:08:05 -07:00 |
|
Zhang, Jiejing
|
c76faa1ff2
|
docs(cookbook): enable Top-K v2 for GLM-5.2 MI355X MTP (#42613)
|
2026-10-06 11:33:24 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
f2f0be731c
|
[Docs] GLM-5.2: move GB300 AgentX recipe to the agentic HiCache section and drop no-op settings (#42167)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 09:40:30 +08:00 |
|
 Yash AkhauriandXiaoyu Zhang
|
36b216e2ee
|
[Docs] Refresh K2 Horizon checkpoint revisions (#42130)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-06 09:19:04 +08:00 |
|
 
|
3120bb87a2
|
[diffusion] fix: fix the OOM hint's placement advice and add a 24 GB Wan2.1 recipe (#41723)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 09:01:02 +08:00 |
|
maocheng23
|
57826a62ea
|
[Speculative] Add opt-in block verification (#42297)
|
2026-10-05 11:49:23 -07:00 |
|
 
|
c83c84b422
|
[diffusion] chore: keep the DiT off component offload under explicit multi-GPU fsdp (#41722)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 21:56:52 +08:00 |
|
 MickandMick Qian
|
83a6e1d39b
|
[diffusion] docs: keep model compatibility details in cookbook recipes (#42227)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-05 20:02:43 +08:00 |
|
 
|
7352073ec6
|
[diffusion] feat: support --async-output-save to overlap output saving with the next request (#37549)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-05 19:53:38 +08:00 |
|
 WenhaoZhangandMick Qian
|
f048d5aa4b
|
[diffusion] feat: add community LoRA recipes and Kohya mapping (#35857)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-05 18:22:56 +08:00 |
|
 
|
438d9d2074
|
[Feature] DeepEP v2: expanded (do_expand=True) prefill dispatch (#37261)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-10-05 00:02:10 -07:00 |
|
Cheng Wan
|
1f299e9f2f
|
[Refactor] Build layer stacks in order with append_stages (#42481)
|
2026-10-04 16:40:24 -07:00 |
|
billishyahao
|
0343bc1483
|
[AMD][Docs] fix mori io and umbp playground (#42512)
|
2026-10-04 09:28:11 -07:00 |
|
WenhaoZhang
|
44fac689f5
|
[diffusion] optimization: decode json pixel lists to numpy at the entrypoint (#41895)
|
2026-10-04 22:20:20 +08:00 |
|
 
|
ba68306256
|
[diffusion] feat: let requests choose the video libx264 preset (#41797)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-04 16:22:36 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
0bdd0cc8dc
|
[Deps] Upgrade the CUDA PyTorch stack to 2.14 (#38641)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-04 00:48:02 -07:00 |
|
Baizhou Zhang
|
fccc61c1c5
|
[CP] Support DP x TP x CP for attention with interleave CP strategy (#42038)
|
2026-10-03 20:57:36 -07:00 |
|
 sglang-botandsglang-bot
|
8afef58af4
|
docs: sync LMSYS SGLang blog cards (#41296)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-10-04 02:26:05 +00:00 |
|
Cheng Wan
|
10edb05e72
|
[Refactor] Let the remaining placement consumers read the parallel context (#42348)
|
2026-10-03 14:59:32 -07:00 |
|
 
|
aaf7ebe077
|
Advertise the KV-event replay endpoint in /server_info (#42274)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-04 04:42:33 +08:00 |
|
   
|
5b5d721239
|
[PD] Add opt-in prefill-complete decode KV allocation (#40703)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-03 21:03:09 +08:00 |
|