Cheng Wan
|
234ccba7f6
|
[Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460)
|
2026-10-10 12:43:09 -07:00 |
|
Cheng Wan
|
3b16eeedce
|
[Refactor] Declare pipeline neighbours from a shared declaration function (#43459)
|
2026-10-10 12:42:46 -07:00 |
|
Cheng Wan
|
514feb1afc
|
[Fix] Keep residual rows and sums consistent across appends and pipeline handoffs (#43454)
|
2026-10-10 12:40:53 -07:00 |
|
Xiaoyu Zhang
|
f61163b4b0
|
[Docs] Let the Qwen3 B300 recipe use the default attention backend (#43554)
|
2026-10-10 10:00:04 -07:00 |
|
Xiaoyu Zhang
|
587b6d622d
|
[Docs] Document Qwen3-4B/8B H200 mixed-chunk latency tradeoffs (#43551)
|
2026-10-10 09:59:46 -07:00 |
|
Shunkangz
|
de487f8039
|
[kv-shard 3/4] Enable Control Plane C (#40102)
|
2026-10-10 22:53:58 +08:00 |
|
 
|
72657f7ca5
|
[diffusion] perf: pipeline every USPAttention Ulysses path's exchange over the copy engine (#43521)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 21:34:18 +08:00 |
|
siliangchen-amd
|
ff19159e16
|
[AMD] Add an opt-in AITER CK blockscale GEMM for gfx942 block-FP8 linears (#41071)
Signed-off-by: siliangchen-amd <SiLiang.Chen@amd.com
|
2026-10-10 01:31:20 -07:00 |
|
 
|
d8c5eca3ac
|
[diffusion] fix: keep a LoRA unmerged under merge_mode auto when merging would round its update away (#43385)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 15:02:03 +08:00 |
|
tao
|
6e8f3e09dd
|
[Model Loader] Add InstantTensor loader support (#40453)
|
2026-10-09 23:01:59 -07:00 |
|
Yuwei An
|
8b2aaf7060
|
[Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287)
|
2026-10-09 22:42:35 -07:00 |
|
 
|
ccae3b3639
|
[diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against cuDNN SDPA on Blackwell (#43373)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 12:58:30 +08:00 |
|
 MickandMick Qian
|
a65f4ffba5
|
[diffusion] docs: standardize diffusion cookbook command builders (#43472)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-10 11:14:31 +08:00 |
|
     
|
436d73ddda
|
[diffusion] model: support HunyuanImage-3.0-Instruct (#36311)
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: wes-lyu <294033513+wes-lyu@users.noreply.github.com>
Co-authored-by: Wes <its.wesley.lyu@gmail.com>
Co-authored-by: AuFlow <73925903+AuFlow@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-10 11:11:28 +08:00 |
|
Liangsheng Yin
|
465253ef52
|
[Scheduler] Fix the deterministic-inference hang when a prefill chunk is shorter than its alignment (#43444)
|
2026-10-09 19:06:18 -07:00 |
|
 MickandMick Qian
|
77ba54f7df
|
[diffusion] docs: add Wan-Animate-2 cookbook command picker (#43380)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-10 09:45:16 +08:00 |
|
 MickandMick Qian
|
cde16aa64d
|
[diffusion] model: support Qwen-Image 2.1 Turbo and checkpoint sampling grids (#43391)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-10 09:12:56 +08:00 |
|
 bookinstockandMick Qian
|
32f34e898b
|
[diffusion] fix: honor requested inference step count for MiniMax H3(#38671)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-10 09:02:57 +08:00 |
|
 
|
bd7c7971ba
|
[diffusion] perf: move MiniMax-H3's pipelined Ulysses copies off the SMs (#43361)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 08:58:07 +08:00 |
|
 
|
121aa8dcc7
|
[diffusion] perf: fuse MiniMax-H3's RMSNorm and indexed AdaLN under quality lossless (#43327)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 22:39:11 +08:00 |
|
Jimmy Shong
|
408f5d057a
|
docs: add Clef accuracy results to the deployment wizard (#43349)
|
2026-10-09 22:19:27 +08:00 |
|
 
|
1203eb9181
|
[diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against attention over the copy engine (#43164)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 22:04:29 +08:00 |
|
 
|
67d063f63b
|
[diffusion] feat: allow per-role attention backend override (#35310)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 20:57:29 +08:00 |
|
 
|
f1e0472fcc
|
[diffusion] model: support Wan-Animate-2 (#42941)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 20:46:23 +08:00 |
|
  
|
59eb71a831
|
[diffusion] fix: align SGLD CFG combine formula with diffusers Z-Image (#23772)
Co-authored-by: SGLang CI <ci@sglang.ai>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-09 19:47:03 +08:00 |
|
Xinyuan Tong
|
91b3692a4c
|
docs: add thinking budget guide (#41601)
|
2026-10-09 17:50:34 +08:00 |
|
 vOvandXiaoyu Zhang
|
7cfecbef56
|
[diffusion][model] Add native SANA-Video 2.0 support (#41492)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-09 17:28:03 +08:00 |
|
Jimmy Shong
|
14e3414513
|
[Docs] Add Clef cookbook with selectable Clef Flash variant (#43235)
|
2026-10-09 01:56:45 -07:00 |
|
amote-i
|
ff146fa20c
|
[NPU] [DOC] remove --enable-torch-compile from Ascend support matrix (#43336)
|
2026-10-09 16:55:39 +08:00 |
|
Cheng Wan
|
dc0b394471
|
[Refactor] Remove Kimi K3's own layer communication and let the consumer set an FFN's exit (#42936)
|
2026-10-09 01:27:46 -07:00 |
|
Cheng Wan
|
305ad5503d
|
[Refactor] Run Kimi K3's fused collectives through stage boundaries (#42898)
|
2026-10-09 01:27:23 -07:00 |
|
Cheng Wan
|
2b469040d2
|
[Refactor] Support attention-TP dense FFNs and unpadded batches on stage boundaries (#42897)
|
2026-10-09 01:27:00 -07:00 |
|
Cheng Wan
|
125f88cb75
|
[Refactor] Run Kimi K3 through stage boundaries (#42894)
|
2026-10-09 01:25:51 -07:00 |
|
Cheng Wan
|
48a6c0a5d0
|
[Fix] Return an FFN's output to the attention rows at a pipeline handoff (#42892)
|
2026-10-09 01:25:05 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
1fc6b8962c
|
[Docs] Cookbook: AgentX launches for Qwen3.5 / Qwen3.8-Flash-Next; refresh GLM-5.2, DeepSeek-V4, DeepSeek-V4.1 (#43083)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 13:55:35 +08:00 |
|
Baizhou Zhang
|
33bffcd490
|
[CP] GLM-5.3-Flash Prefill CP implemented on layer boundaries (#42044)
|
2026-10-08 20:42:11 -07:00 |
|
Liangsheng Yin
|
b4fe282836
|
[MemCache] Delete ChunkCache (#43201)
|
2026-10-08 17:31:16 -07:00 |
|
Ankur Singh
|
2b94cb4eb5
|
docs(cookbook): add Qwen3.8 GB300 long-context recipe (#43159)
Signed-off-by: Ankur-singh <ankusingh@nvidia.com>
|
2026-10-08 16:56:30 -07:00 |
|
 
|
e902207a4e
|
[Speculative] Support block verification for the DFlash family (#43012)
Co-authored-by: maocheng <mao.cheng@MacBook-Pro-MD663G60VV.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 13:59:52 -07:00 |
|
 
|
d1ba943016
|
[Model] Add support for EmbeddingGemma 2 (#42782)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 13:54:45 -07:00 |
|
 
|
f795fe352d
|
[Test] Add a docs drift check for server_arguments.mdx (#38520)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-08 00:37:22 -07:00 |
|
  
|
4f320fb85a
|
[diffusion] perf: FastH3 8-Step V2 native support, native Blackwell VSA and batched H3 VAE decode (#37662)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-08 14:35:27 +08:00 |
|
Thomas Wang
|
b72da1b817
|
[AMD] Update v4 amd cookbook 1008 (#43033)
|
2026-10-08 11:18:41 +08:00 |
|
 
|
c892301ff7
|
[Platform] Thread vendor KV pool classes through the in-tree builders; add PlatformCapabilities (#35594)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
|
2026-10-07 19:16:10 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
7b6b6ee25e
|
[Docs] Cookbook: interactive SemiAnalysis InferenceX AgentX launches for GLM-5.2, DeepSeek-V4 and DeepSeek-V4.1 (#42726)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 09:33:40 +08:00 |
|
Richard Wang
|
5cb7fb886c
|
[Feature] support pplx-decider-v1.1 and update the pplx-decider cookbooks (#42645)
|
2026-10-08 09:03:50 +08:00 |
|
 Kevin MiandClaude Opus 5.5
|
79ef49cb6b
|
[Docs] GLM-5.3-Flash: measured MI355X MXFP4 agentic recipe (#43015)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 15:49:49 -07:00 |
|
Thomas Wang
|
9a21d82958
|
[AMD] Update v4.1 amd cookbook 1006 (#42847)
|
2026-10-06 19:58:58 -07:00 |
|
 
|
7a4d6dfd2f
|
[diffusion] feat: name the quality tiers after what they guarantee (#42370)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-07 09:49:30 +08:00 |
|
Eddie A. Tsai
|
e13933c4fd
|
[diffusion] docs: add gfx1151 Strix Halo serving guidance (#41670)
|
2026-10-07 09:14:07 +08:00 |
|