Commit Graph
13948 Commits
Author SHA1 Message Date
Chunan Zeng 3c74f68a9c [Fix] Initialize BF16 GEMM dispatch in the one-batch benchmark (#43702) 2026-10-12 02:53:02 +00:00
WenhaoZhangandMick Qian d0a098b2e0 [diffusion] perf: split and batch LTX-2.3 one-stage guidance passes under CFG parallel (#43684)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-12 09:36:01 +08:00
WenhaoZhang a954b395e6 [diffusion] perf: layerwise offload for the LTX-2.5 Gemma-4 text encoder (#43683) 2026-10-12 09:34:35 +08:00
WenhaoZhang a67228aa43 [diffusion] fix: shard Qwen-Image adaLN modulation and text FFN under TP (#43691) 2026-10-12 09:32:52 +08:00
Liangsheng Yin e6072935bf [DSpark] Apply SGLANG_SIMULATE_ACC_LEN inside the accept instead of switching paths (#43623) 2026-10-11 15:33:24 -07:00
Liangsheng Yin a65b776963 [DSpark] Add SGLANG_DSPARK_USE_GREEDY_DRAFT, an argmax draft accepted as one-hot (#43670) 2026-10-11 15:18:59 -07:00
Liangsheng Yin 3cc23b3b86 [DSpark] Merge the draft TP sync sites into dspark-draft (#43669) 2026-10-11 15:17:47 -07:00
Liangsheng Yin 00ba90fd1a [DSpark] Run the same markov block in the draft graph tail; drop SGLANG_DSPARK_FOLDED_SAMPLING (#43668) 2026-10-11 15:15:59 -07:00
Liangsheng Yin 48abbdb845 [DSpark] Draft the eager markov block through MarkovSampleStep (#43622) 2026-10-11 15:13:02 -07:00
Liangsheng Yin 467209e838 [DSpark] Add MarkovSampleStep, one op for a markov draft step's add and token pick (#43621) 2026-10-11 15:10:58 -07:00
Liangsheng Yin 9943cf8eef [DSpark] Run every markov head through one step interface (#43620) 2026-10-11 15:07:51 -07:00
Banruo LiuandShangming Cai d62b9c2480 [KV Events] Publish LoRA adapter names and namespaced block hashes (#42455)
Signed-off-by: Banruo Liu <lichangxinlivingshade@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-11 23:23:30 +08:00
97bfa5cc53 [diffusion] fix: select VSA-H3 for FastH3 when no transformer backend is given (#43690)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 23:05:25 +08:00
Ke Bao 46a97e5540 Preserve serialized page dtype in NIXL copy fallback (#43593) 2026-10-11 22:39:14 +08:00
Ke Bao b0a75c8196 Share MLA host capacity initialization (#43595) 2026-10-11 22:36:29 +08:00
Ke Bao c938b6e454 Build Mamba host pools from device buffer infos (#43596) 2026-10-11 22:35:52 +08:00
Shuwen Wang ef3e5c83c5 [HiCache] Keep storage workers alive on backend exceptions (#43550) 2026-10-11 22:26:56 +08:00
MickandMick Qian 11bfd868ac [diffusion] perf: encode LTX video/audio through the shared bounded MP4 path (#43656)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-11 21:15:49 +08:00
Shuwen Wang 0923bcd258 [Unified Radix] Invalidate lazy Mamba checkpoints before in-place tracking (#43567) 2026-10-11 21:12:51 +08:00
FeiHong Guo cf88ed4352 [BugFix][DP] Prevent health checks from perturbing user request routing (#35721)
Signed-off-by: Phoenix3334 <Phoenix3334@users.noreply.github.com>
2026-10-11 21:08:55 +08:00
Shuwen Wang d26b6a5a9c fix: default Inkling to fa4 on Hopper (#35292) 2026-10-11 20:57:42 +08:00
trebladevandMick Qian 586d98cc15 [Diffusion] Add ModelOpt FP8 checkpoint quantization for Pi0.5 (#43062)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-11 20:55:59 +08:00
MickandMick Qian 04f740580c [VLM] fix: repair multimodal VMM lease cleanup and source-stream ordering (#43475)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-11 19:13:39 +08:00
efd14cfb66 [DeepSeek-V4.1] Use num_stages=1 for the hc_mix stats partial kernel (#43070)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yuan Luo <4908075+yuan-luo@users.noreply.github.com>
2026-10-11 19:03:19 +08:00
Sage 53295c6972 [kvevents] fix missing topics in replayed kv events (#43386)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-10-11 17:25:43 +08:00
Liangsheng Yin 0a21a3b798 [Scheduler] Keep a DP-converted decode batch as the running batch (#43283) 2026-10-11 01:23:51 -07:00
jiaqiang-dot-liu 41652225d0 [Sampler] Sort only the max(top_k) leading columns in the torch sampler (#43346) 2026-10-11 01:00:59 -07:00
Liangsheng Yin dab108b9f3 [Scheduler] Hold back decode rows on a mixed step when they do not fit the KV pool (#43290) 2026-10-11 00:18:27 -07:00
Liangsheng Yin 89e24e7a20 [KV canary] Expect sweep counters on the target runner only (#43286) 2026-10-10 23:52:17 -07:00
Liangsheng Yin ad8b1e1f85 [Test] Do not hang scripted-runtime teardown when the server died (#43285) 2026-10-10 23:13:56 -07:00
Liangsheng Yin 448759b235 [Scheduler] Requeue preempted requests when admission admits nothing (#43298) 2026-10-10 22:46:55 -07:00
Qiaolin Yu 047405f534 [qwen 3.8 next] Fuse QSA prefill KV gathering and dtype conversion (#41933) 2026-10-10 22:40:23 -07:00
paulzhang-tm 5678b71b6c [Spec] Allow Qwen3.5 backends to opt into packed target verification (#43037) 2026-10-10 22:39:17 -07:00
Nikolai 22d63f5e43 [AMD]Qwen add Sparse attention to capturing hip graphs (#43383) 2026-10-10 22:03:54 -07:00
Jzz1943 260551ebe9 [KDA] Support Helion MTP verification and harden prefill, decode (#42857) 2026-10-11 12:47:57 +08:00
SunskyXHandXiaoyu Zhang 65e6bb6be7 [GDN] Fix CuTe DSL decode to read the [N, HV, V, K] state layout (#43332)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-11 12:43:16 +08:00
a1500b10e3 [diffusion] Don't report video jobs completed after their outputs are deleted (#43084)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-11 12:42:38 +08:00
Chunan ZengandClaude Opus 5.5 aa5c969dc3 [Perf] Fuse BF16 writes to native HND KV cache storage (#43237)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 12:41:18 +08:00
Shuwen Wang 58cb1a2be6 [Scheduler] Keep waiting-prefix LRU refresh consistent across TP ranks (#43479) 2026-10-10 21:18:41 -07:00
Avaya Aggarwalandniehen6174 3458c94fad [diffusion] comfyui: consolidate executor conditioning-cache fixes (#43492)
Co-authored-by: niehen6174 <1639206518@qq.com>
2026-10-11 11:42:00 +08:00
Avaya Aggarwalandniehen6174 638330d975 [diffusion] comfyui: consolidate FluxAdapter correctness fixes (#43490)
Co-authored-by: niehen6174 <1639206518@qq.com>
2026-10-11 11:41:36 +08:00
Khoa Pham 6576e50cd5 [1/N][DSv41] Enable DP attention with MegaMoE (#43228) 2026-10-10 20:36:35 -07:00
b931b2c8bd [diffusion] perf: run the attention section eager under torch.compile for MiniMax-H3 (#43634)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 11:02:54 +08:00
b21826e609 [diffusion] fix: replay Qwen-Image-2.1 BCG graphs across prompt lengths (#43633)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:55:01 +08:00
b237afa547 [diffusion] fix: Qwen-Image BCG prompt padding misses every graph and attends the pad (#43632)
Co-authored-by: Mick <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:54:18 +08:00
b3a65efe7e [diffusion] perf: keep Cosmos3's fused kernels in the graph (#43577)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:53:43 +08:00
d45ef0f2d2 [diffusion] perf: keep Qwen-Image-2.1 and Ulysses graphs whole (#43586)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:52:43 +08:00
Shangming CaiandKevin Flansburg e1f43c9a61 [PD][HiCache] Fold the decode restore outcome into the MIN-reduced KV poll (#43562)
Co-authored-by: Kevin Flansburg <kflansburg@cloudflare.com>
2026-10-11 10:12:34 +08:00
Richard Wang d60e0c8570 [diffusion] Support LLaDA-Image BF16 generation and editing (#37907) 2026-10-11 02:10:51 +00:00
e4b423256e [diffusion] fix: serve whole graphs after offload-during-compile (#43631)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 10:03:47 +08:00