Commit Graph
122 Commits
Author SHA1 Message Date
Mick bfeae4e79a [diffusion] feat: support loading serialized convrot w4a4 checkpoints (#36039) 2026-08-24 19:13:35 +08:00
Xiaoyu Zhang 46b92b22e2 [diffusion] Accelerate LingBot Video RMSNorm in quality=high (#35969) 2026-08-24 18:02:00 +08:00
Mick adc09a1f63 [diffusion] feat: support loading self-describing quanto int8 encoders (#36052) 2026-08-24 16:37:09 +08:00
Mick 8df3b9eff9 [diffusion] feat: support loading mixed w4a8 text encoders (#36037) 2026-08-24 13:31:27 +08:00
Xiaoyu Zhang 344613c159 [diffusion] Default Hunyuan VAE to tiled decode (#36012) 2026-08-24 13:18:06 +08:00
Mick 230c052ebc [diffusion] chore: reuse srt AutoRound for quantized DiTs (#36068) 2026-08-24 11:21:44 +08:00
amote-i 11b1b4c374 [NPU] [DOC] Polish English wording in NPU docs (#36123) 2026-08-24 10:48:36 +08:00
Mick 2d84de5e69 [diffusion] feat: support loading serialized comfy w4a8 checkpoints (#36036) 2026-08-24 10:32:21 +08:00
Mick fee00a41db [diffusion] feat: add composable component weight path cli (#36078) 2026-08-24 09:31:08 +08:00
Mick 1c1c9d9b4e [diffusion] refactor: reuse srt quantization contracts and mxfp8 kernels (#36063) 2026-08-24 09:26:54 +08:00
Xiaoyu Zhang 447048dba2 [diffusion] Reject unsafe quality=high BCG replay (#36008) 2026-08-24 08:50:26 +08:00
Xiaoyu Zhang f4448e677f [diffusion] Reuse SANA fast paths in SANA-Video BCG (#35961) 2026-08-24 08:47:04 +08:00
Mick dd15fb57b5 [diffusion] feat: automatically infer comfy fp8 activation scaling (#36060) 2026-08-23 18:43:33 +08:00
amote-i c9f6b9ba25 [NPU] [DOC] Refresh supported features and models on Ascend NPU (#35836) 2026-08-23 13:05:03 +08:00
Mick 70319a0881 [diffusion] feat: support loading serialized comfy convrot int8 native encoders (#36023) 2026-08-23 12:00:38 +08:00
Mick a36c0746b9 [diffusion] feat: support serialized comfy convrot int8 dits (#35994) 2026-08-23 09:29:59 +08:00
Mick 453b98c490 [diffusion] feat: support single-file component weight overrides (#35979) 2026-08-22 23:09:35 +08:00
Mick 489e605b35 [diffusion] feat: admit compatible quantized native encoders (#35962) 2026-08-22 18:51:01 +08:00
Mick b391ef171f [diffusion] feat: load serialized bnb4 components with transformers (#35945) 2026-08-22 15:33:53 +08:00
Xiaoyu Zhang 96bfd2476c [diffusion] Enable SANA-Video breakable CUDA graphs (#35729) 2026-08-22 12:57:09 +08:00
Xiaoyu Zhang 83e9ece672 [diffusion] Fuse SANA-Video interleaved RoPE (#35695) 2026-08-22 12:56:45 +08:00
Mick 5290327025 [diffusion] feat: resolve hub component subfolders (#35939) 2026-08-22 12:01:44 +08:00
R0CKSTARandAlex Nails d90318b3e2 [MLX] Upgrade to Torch 2.13/MLX 0.32+ and redesign the Torch-MLX tensor bridge (#32984)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-21 18:51:42 -07:00
Mick b26695a26e [diffusion] feat: reject unsupported quantized component checkpoints (#35873) 2026-08-22 09:33:43 +08:00
zijiexiaandClaude Opus 5 fe8f9d7457 [Docs] Add --prerelease=allow to cookbook uv install commands (#35920)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-21 15:51:48 -07:00
YAMY 834400705f perf: overlap Qwen shared expert with DeepEP routed experts (#34938) 2026-08-21 15:39:44 -07:00
sglang-botandsglang-bot 4d42deff0a chore: bump docs install version to 0.5.18 (#35911)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-08-21 13:24:03 -07:00
Davis Wertheimer 70983bd7db Add SGLang Granite SWA support via existing Granite models (#35794)
Signed-off-by: Davis Wertheimer <davis.wertheimer@ibm.com>
2026-08-21 11:13:15 -07:00
Mick 8658d00764 [diffusion] feat: support loading peft lora (#35868) 2026-08-21 22:58:59 +08:00
li_maxandMick 0447ade326 [diffusion] fix: fall back to a component's default attention backend (#35796)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-21 22:56:44 +08:00
Mick 5a46d657b7 [diffusion] refactor: resolve lora weight sources deterministically (#35774) 2026-08-21 21:05:40 +08:00
Xiaoyu Zhang 39d4d65a51 [diffusion] Accelerate SANA-Video linear attention in quality=high (#35728) 2026-08-21 18:05:43 +08:00
Xiaoyu Zhang a5c52a9358 [diffusion] Enable LongCat breakable CUDA graphs (#35724) 2026-08-21 17:59:16 +08:00
MickandClaude Opus 5 e0cf75d9bd [doc] standardize diffusion cookbook model pages (#34247)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-21 10:25:40 +08:00
Xiaoyu Zhang 7e80e889a2 [diffusion] Fuse LTX-2.5 decoder 3D RoPE (#35698) 2026-08-21 10:13:09 +08:00
Yihao Wang ba8e601358 [docs] fix note formatting in sglang-d documentation (#35761) 2026-08-20 16:39:39 -07:00
Jiajun Li a4ef828207 fix(openai): avoid duplicate routed expert in response when return_meta_info = True (#35323) 2026-08-20 15:21:58 -07:00
Liangsheng Yin 0149f56e84 [CI] Gate /rerun-test on commenter trust and remove /rerun-stage (#35750) 2026-08-20 15:05:52 -07:00
Chao Shi 2ef0fe4669 TP/PP Consensus checker (#34406) 2026-08-21 01:36:03 +08:00
Mick be373395b4 [diffusion] feat: support out-of-tree models and pipelines (#35713) 2026-08-21 00:33:34 +08:00
Mick 7f8f030000 [diffusion] feat: let every layerwise component be configurable (#35688) 2026-08-20 22:38:05 +08:00
Mick 82c6fc2db9 [diffusion] quant: support pruned safetensors checkpoints for minimax-h3 (#35418) 2026-08-20 19:34:14 +08:00
21c88f8625 [diffusion] quant: support gguf (#35370)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-20 15:46:34 +08:00
Mohammad Miadh Angkad ba433bb462 [Docs] Update contribution guide (#35419) 2026-08-19 22:31:24 -07:00
Siyuan Chen 38b74d294b Add docs for TP LMHead optimizaiton (#35283) 2026-08-19 14:59:35 -07:00
Xiaoyu ZhangandClaude Opus 5 9113fc6d93 [docs] Add a fused-kernels page for SGLang Diffusion (#35436)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-19 16:32:42 +08:00
MickandClaude Fable 5 e73201e462 [diffusion] feat: support cache-dit, cfg gating, attention backend override as per-request param (#35339)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-19 08:24:03 +08:00
MickandClaude Opus 5 77fc5c128e [perf] overlap page preprocessing, pack the vit, enable prefill CUDA graph for paddle-ocr (#35318)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-19 08:20:55 +08:00
MickandClaude Opus 5 3f26febaff [diffusion] fix: decouple encoder parallelism from the dit parallel layout (#34713)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-19 00:16:09 +08:00
LinyuanLi 9485c083bb [NPU] Add mxfp4-w4a4 MOE Quantization Support for NPU (#30319) 2026-08-18 19:06:05 +03:00