Commit Graph
1915 Commits
Author SHA1 Message Date
Po-Han Huang (NVIDIA)andClaude Opus 5.5 dbad07a06f [Docs] Cookbook: refresh SemiAnalysis AgentX launches (DeepSeek-V4.1 GB200/GB300, GLM-5.2 FP8 B300) (#43983)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-13 14:39:45 +08:00
Jimmy Shong 3eebf987ed [PD] Support heterogeneous TP for hybrid SWA KV transfer (#40909) 2026-10-12 23:21:54 -07:00
Thomas Wang c2dfd5d3d6 [AMD] Update v4 amd cookbook 1012 (#43962) 2026-10-12 19:57:55 -07:00
e775fa7253 [Build][CI] Drop Python 3.10: require Python 3.11+ and run CUDA CI on Python 3.12 (#43021)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-10-12 18:40:16 -07:00
8afe107c24 [XPU] Upgrade XPU backend to PyTorch 2.14 (#42003)
Co-authored-by: Ashwini Rathi <arathi@habana.ai>
Co-authored-by: Y <ashwini.rathi@intel.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-10-12 18:24:48 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 b0c84d4518 [Docs] Cookbook: refresh SemiAnalysis AgentX launches (GLM-5.2 B300, DeepSeek-V4.1 GB300) (#43799)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 17:08:11 +08:00
Baizhou Zhang 450837e770 [Docs] Update GLM-5.3-Flash playground: B300 default, CP8, EP and PD (#43802) 2026-10-12 01:38:12 -07:00
Anupa SajikumarandSiju Samuel 8d491fbc3e [XPU] Support decode context parallelism (DCP) on Intel XPU (#34355)
Co-authored-by: Siju Samuel <siju.samuel@intel.com>
2026-10-12 15:50:33 +08:00
Baizhou Zhang 62c853b654 docs: clarify prefill CP terminology and simplify wording (#43787) 2026-10-12 00:24:57 -07:00
Mohammad Miadh AngkadandMohammad Angkad 166b4ae7fc [Fix] Adapt to transformers 5.18 / 5.19 changes (#43688)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-11 23:24:57 -07:00
sglang-botandsglang-bot f9bd83e7a9 docs: sync LMSYS SGLang blog cards (#43462)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-10-12 06:07:15 +00:00
ChengYM 0d0be8fc98 [AMD][MORI] Add MORI EP V2 support (#40666) 2026-10-11 20:54:13 -07:00
WenhaoZhang a954b395e6 [diffusion] perf: layerwise offload for the LTX-2.5 Gemma-4 text encoder (#43683) 2026-10-12 09:34:35 +08:00
WenhaoZhang a67228aa43 [diffusion] fix: shard Qwen-Image adaLN modulation and text FFN under TP (#43691) 2026-10-12 09:32:52 +08:00
Liangsheng Yin 00ba90fd1a [DSpark] Run the same markov block in the draft graph tail; drop SGLANG_DSPARK_FOLDED_SAMPLING (#43668) 2026-10-11 15:15:59 -07:00
97bfa5cc53 [diffusion] fix: select VSA-H3 for FastH3 when no transformer backend is given (#43690)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 23:05:25 +08:00
MickandMick Qian 11bfd868ac [diffusion] perf: encode LTX video/audio through the shared bounded MP4 path (#43656)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-11 21:15:49 +08:00
65386cb95a [diffusion] perf: add the dynamic LoRA delta inside the second GEMM (#43501)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:50:53 +08:00
664e4c6499 [diffusion] feat: warn instead of disabling on unvalidated models for BCG(#43568)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:40:28 +08:00
23764b1242 [diffusion] feat: bind each GPU worker to its GPU's NUMA node (#43565)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 08:38:58 +08:00
Cheng Wan 234ccba7f6 [Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460) 2026-10-10 12:43:09 -07:00
Cheng Wan 3b16eeedce [Refactor] Declare pipeline neighbours from a shared declaration function (#43459) 2026-10-10 12:42:46 -07:00
Cheng Wan 514feb1afc [Fix] Keep residual rows and sums consistent across appends and pipeline handoffs (#43454) 2026-10-10 12:40:53 -07:00
Xiaoyu Zhang f61163b4b0 [Docs] Let the Qwen3 B300 recipe use the default attention backend (#43554) 2026-10-10 10:00:04 -07:00
Xiaoyu Zhang 587b6d622d [Docs] Document Qwen3-4B/8B H200 mixed-chunk latency tradeoffs (#43551) 2026-10-10 09:59:46 -07:00
Shunkangz de487f8039 [kv-shard 3/4] Enable Control Plane C (#40102) 2026-10-10 22:53:58 +08:00
72657f7ca5 [diffusion] perf: pipeline every USPAttention Ulysses path's exchange over the copy engine (#43521)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 21:34:18 +08:00
siliangchen-amd ff19159e16 [AMD] Add an opt-in AITER CK blockscale GEMM for gfx942 block-FP8 linears (#41071)
Signed-off-by: siliangchen-amd <SiLiang.Chen@amd.com
2026-10-10 01:31:20 -07:00
d8c5eca3ac [diffusion] fix: keep a LoRA unmerged under merge_mode auto when merging would round its update away (#43385)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 15:02:03 +08:00
tao 6e8f3e09dd [Model Loader] Add InstantTensor loader support (#40453) 2026-10-09 23:01:59 -07:00
Yuwei An 8b2aaf7060 [Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287) 2026-10-09 22:42:35 -07:00
ccae3b3639 [diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against cuDNN SDPA on Blackwell (#43373)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 12:58:30 +08:00
MickandMick Qian a65f4ffba5 [diffusion] docs: standardize diffusion cookbook command builders (#43472)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-10 11:14:31 +08:00
436d73ddda [diffusion] model: support HunyuanImage-3.0-Instruct (#36311)
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: wes-lyu <294033513+wes-lyu@users.noreply.github.com>
Co-authored-by: Wes <its.wesley.lyu@gmail.com>
Co-authored-by: AuFlow <73925903+AuFlow@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-10 11:11:28 +08:00
Liangsheng Yin 465253ef52 [Scheduler] Fix the deterministic-inference hang when a prefill chunk is shorter than its alignment (#43444) 2026-10-09 19:06:18 -07:00
MickandMick Qian 77ba54f7df [diffusion] docs: add Wan-Animate-2 cookbook command picker (#43380)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-10 09:45:16 +08:00
MickandMick Qian cde16aa64d [diffusion] model: support Qwen-Image 2.1 Turbo and checkpoint sampling grids (#43391)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-10 09:12:56 +08:00
bookinstockandMick Qian 32f34e898b [diffusion] fix: honor requested inference step count for MiniMax H3(#38671)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-10 09:02:57 +08:00
bd7c7971ba [diffusion] perf: move MiniMax-H3's pipelined Ulysses copies off the SMs (#43361)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-10 08:58:07 +08:00
121aa8dcc7 [diffusion] perf: fuse MiniMax-H3's RMSNorm and indexed AdaLN under quality lossless (#43327)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 22:39:11 +08:00
Jimmy Shong 408f5d057a docs: add Clef accuracy results to the deployment wizard (#43349) 2026-10-09 22:19:27 +08:00
1203eb9181 [diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against attention over the copy engine (#43164)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 22:04:29 +08:00
67d063f63b [diffusion] feat: allow per-role attention backend override (#35310)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-09 20:57:29 +08:00
f1e0472fcc [diffusion] model: support Wan-Animate-2 (#42941)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-09 20:46:23 +08:00
59eb71a831 [diffusion] fix: align SGLD CFG combine formula with diffusers Z-Image (#23772)
Co-authored-by: SGLang CI <ci@sglang.ai>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-09 19:47:03 +08:00
Xinyuan Tong 91b3692a4c docs: add thinking budget guide (#41601) 2026-10-09 17:50:34 +08:00
vOvandXiaoyu Zhang 7cfecbef56 [diffusion][model] Add native SANA-Video 2.0 support (#41492)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-09 17:28:03 +08:00
Jimmy Shong 14e3414513 [Docs] Add Clef cookbook with selectable Clef Flash variant (#43235) 2026-10-09 01:56:45 -07:00
amote-i ff146fa20c [NPU] [DOC] remove --enable-torch-compile from Ascend support matrix (#43336) 2026-10-09 16:55:39 +08:00
Cheng Wan dc0b394471 [Refactor] Remove Kimi K3's own layer communication and let the consumer set an FFN's exit (#42936) 2026-10-09 01:27:46 -07:00