Commit Graph
13618 Commits
Author SHA1 Message Date
WenhaoZhangandMick 2579875b5d [diffusion] feat: support loading community ComfyUI-GGUF Qwen-Image-2.1 transformers (#42556)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-06 23:30:48 +08:00
49bafb58cd perf(mla): use native SATFINITE FP8 conversion in MLA KV/Q preparation (#42659)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-06 22:47:47 +08:00
Xiaoshuai Zhangandjet 679d2851ba fix(mimo-vl): keep multimodal features when capturing aux hidden states and correct vision preprocessing (#40888)
Co-authored-by: jet <dev@jetd.one>
2026-10-06 22:15:14 +08:00
16a23a672b [diffusion] model: support Kandinsky 6 (#42743)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Lev Novitskiy <57654885+leffff@users.noreply.github.com>
Co-authored-by: Kirill <kykozlov@gmail.com>
Co-authored-by: Artem Borisov <divotionchannel@gmail.com>
2026-10-06 22:13:29 +08:00
730f1f3e5b [DeepSeek-V4.1] Unify mHC into one state machine and drop medium-batch fusion variants (#42245)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-06 21:01:42 +08:00
WenhaoZhang 2a5f45d3d4 [diffusion] fix: skip zero blocks when hashing large conditioning inputs (#42748) 2026-10-06 20:43:08 +08:00
WMCandjacky.cheng ba94488b42 [diffusion] feat: default Qwen-Image 2.1 to VAE tiling on gfx1151 (#41655)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-10-06 20:20:58 +08:00
Mohammad Miadh AngkadandMohammad Angkad 45db430530 [DSA] Fix pooled page table refresh for target verify CUDA graph replay (#42750)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-06 18:57:52 +08:00
Gawr Gura 0721 b563bbd597 [Fix] Don't let a failed deep_ep import-time check kill servers that never use DeepEP (#40671) 2026-10-06 01:58:02 -07:00
e49e971131 [mem_cache] Keep prefix_indices current for chunked requests kept out of the tree (#42467)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-10-06 01:40:35 -07:00
Jzz1943 1be3013118 [diffusion] feat: support Ideogram TurboTime LoRA (#30487) 2026-10-06 16:15:21 +08:00
Max Kong 01345197af [diffusion] chore: harden OpenAI upload filename handling (#17270)
=
2026-10-06 16:14:39 +08:00
Jinbao ChenandMick Qian d0494af08b [diffusion] security: pin multimodal-gen ZMQ scheduler ingress to loopback on wildcard --host (#36854)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-06 16:05:17 +08:00
Liangsheng Yin c7f3ae1dd5 [mem_cache] Hold a request's tree lock as one TreeLock (#42686) 2026-10-06 00:59:38 -07:00
c683190b40 [PD] Wait for prefill completion before Mooncake early KV transfer (#41395)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-10-06 15:17:12 +08:00
Rumit Desai 33ce0943e9 [Bugfix] Guard merge_state sgl_kernel import on non-CUDA platforms (#42682) 2026-10-06 14:19:20 +08:00
Joe 40fb5935c0 Allow platforms to declare Mamba extra-buffer support (#36410) 2026-10-06 14:18:49 +08:00
Liangsheng Yin 9a09b48da7 [Fix] Add maybe_hand_to_session to the one-batch benchmark TreeCacheNamespace (#42723) 2026-10-05 23:09:41 -07:00
b524de2de6 [diffusion] optimization: release the allocator cache when the server idles not per request (#41718)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-06 12:27:08 +08:00
e446698cdd [SM120&90] Add CUDA fused Triton sparse-MLA prefill backend for DSA (#32779)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
2026-10-05 21:08:05 -07:00
1e1bdeedbb [Perf] Improve GLM-5.3-Flash DFlash decoding on B300 (#42489)
Co-authored-by: lianghougong <lianghouhong@xiaohongshu.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-06 12:05:37 +08:00
Mohammad Miadh AngkadandMohammad Angkad fcbbefa82a [GLM-5.3-Flash] Autotune MoE kernels at prefill sizes (#42693)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-05 21:04:54 -07:00
Yuwei An 620c76f25d [DSV4.1] Add opt-in TRT-LLM sparse attention support (#41603) 2026-10-06 12:02:10 +08:00
Ke Bao ed75fe67f1 Declare hybrid Mamba indexer host pool (#40915) 2026-10-06 10:18:36 +08:00
CuzMi 67959f80ab [diffusion] optimization: fuse Anima FP32 split-half Q/K RoPE (#42609) 2026-10-06 10:18:09 +08:00
Thomas Wang 1abd356595 [AMD] Add engram host/device address mapping (#42552) 2026-10-05 19:12:12 -07:00
MickandMick Qian 21c9bbdf2c [diffusion] fix: fix concurrent server perf dump writes across ranks (#41541)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-06 09:29:51 +08:00
5d385007b3 [diffusion] kernels: take the Wan VAE decoder's remaining first-decode work off the request path (#41830)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:05:29 +08:00
3120bb87a2 [diffusion] fix: fix the OOM hint's placement advice and add a 24 GB Wan2.1 recipe (#41723)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:01:02 +08:00
Liangsheng Yin ad7a9b53cc [mem_cache] Make release_kv_cache's final checkpoint an explicit checkpoint flag (#42270) 2026-10-05 17:32:07 -07:00
Liangsheng Yin c01d59eb90 [Session] Let a streaming session own its KV record and tree lock from the first turn (#42537) 2026-10-05 17:28:09 -07:00
Liangsheng Yin f3fe753475 [misc] Rename SGLANG_OPT_SWA_RELEASE_LEAF_LOCK_AFTER_WINDOW to SGLANG_OPT_RELEASE_PREFILL_SWA (#42657) 2026-10-05 17:24:15 -07:00
Yuwei An 18ec2ecce3 [Refactor][TCPCG] Relocate shared graph tensor and DSA head-gate helpers (1/9) (#42285) 2026-10-05 17:06:52 -07:00
ADiL 968726f3ce [HiCache] Route --file-storage-path to the file storage backend (#33883)
Signed-off-by: adlashab <adlashab@amd.com>
2026-10-05 15:33:49 -07:00
61ba98443d [DSA] k-pool: 256-token logical page so index page id = logical page id (#42178)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
2026-10-05 15:02:44 -07:00
c765f8818a [DFlash2] Keep the greedy selector walk in range for all-NaN score rows (#41737)
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-10-05 14:29:13 -07:00
maocheng23 57826a62ea [Speculative] Add opt-in block verification (#42297) 2026-10-05 11:49:23 -07:00
debanshd efb62ce269 [diffusion] fix: resolve QKV layout inference for MiniMax-H3 checkpoints (#40158)
Signed-off-by: Debanshu Das <debanshu@google.com>
2026-10-05 23:01:37 +08:00
150f568900 [diffusion] kernels: stop specializing on per-request sequence lengths (#41710)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 22:21:01 +08:00
a977e3b9d5 [diffusion] optimization: stream an oversized DiT in auto mode instead of OOMing (#41721)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 21:58:27 +08:00
ad3e80d4de [diffusion] chore: warm the image writer and the HTTP route models at startup (#41833)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 21:58:00 +08:00
c83c84b422 [diffusion] chore: keep the DiT off component offload under explicit multi-GPU fsdp (#41722)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 21:56:52 +08:00
wxy 23bf107469 [diffusion] optimization: cache LTX-2 RoPE coords to avoid per-step recompute (#22441) 2026-10-05 21:21:36 +08:00
Shiwen Cheng 91f9bf8d17 [diffusion] fix: fix scheduler host not working when ipv6 in multi modal gen (#22813) 2026-10-05 21:14:09 +08:00
liukeandMick f20f8e120d [diffusion] model: restore folded H3 GGUF patch embedding (#39523)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-05 21:10:06 +08:00
Akshat Anandandcipheraxat 860ebe720e [diffusion] fix: skip warmup preferred preload when it would OOM (#40761)
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
2026-10-05 19:59:35 +08:00
aiyueqiandMick 8663e3b670 [diffusion] optimization: avoid full-video clone in VAE post-processing for MiniMax-H3 (#40095)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-05 19:56:11 +08:00
d349e672bc [diffusion] feat: recycle warmup-only entries of conditioning-cache at the first served store (#41832)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 19:55:30 +08:00
7352073ec6 [diffusion] feat: support --async-output-save to overlap output saving with the next request (#37549)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 19:53:38 +08:00
WenhaoZhangandMick Qian f048d5aa4b [diffusion] feat: add community LoRA recipes and Kohya mapping (#35857)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 18:22:56 +08:00