 
|
a297cd3da1
|
[Fix] scheduler: stop latching batch_is_full when nothing can run (#41872)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-11 21:56:19 -07:00 |
|
 
|
d434ea444d
|
[DSV4.1] Reduce eager Engram extend preparation (#42159)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 21:31:55 -07:00 |
|
Liangsheng Yin
|
a1001bcf3a
|
[PD] Retract transferred decode requests on a retract pause (#43757)
|
2026-10-11 21:29:39 -07:00 |
|
ChengYM
|
0d0be8fc98
|
[AMD][MORI] Add MORI EP V2 support (#40666)
|
2026-10-11 20:54:13 -07:00 |
|
Shunkangz
|
20c49f12c9
|
Support kv cache sharding for DSA indexer (#40925)
|
2026-10-12 11:50:23 +08:00 |
|
 
|
37d2e5c34f
|
[AMD][V4.1][*/N] Fix DP attention + TP MoE decode NaN and support bounded replay (#43077)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-10-11 20:47:13 -07:00 |
|
weireweire
|
296774da37
|
[Tokenizer] Require fastokens>=0.3.2 and include it in the all extra (#43104)
|
2026-10-11 20:41:53 -07:00 |
|
adenzhou1350
|
cd8ed1bb55
|
[Bugfix] Preserve available host memory for integrated MUSA devices (#43398)
Signed-off-by: Xucheng Zhou <aden1350@outlook.com>
|
2026-10-11 20:34:58 -07:00 |
|
 
|
77a15cf4e2
|
[MemCache] Add shared component size and path APIs to the tree core interface (#43722)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-11 20:14:07 -07:00 |
|
 
|
e4cfc0c42a
|
[MemCache] Split the SWA mapping move out of locked-full recovery as RecoverEvictedSWA (#43721)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-11 20:11:52 -07:00 |
|
WangHemeng
|
0c52cb1519
|
[MoE] Skip block-padding rows in the TMA down activation and quant (#42212)
|
2026-10-12 11:10:30 +08:00 |
|
Alison Shao
|
1a7af3290d
|
Fix Mistral-native format detection when the Hub is unreachable (#43446)
|
2026-10-11 19:59:19 -07:00 |
|
Chunan Zeng
|
3c74f68a9c
|
[Fix] Initialize BF16 GEMM dispatch in the one-batch benchmark (#43702)
|
2026-10-12 02:53:02 +00:00 |
|
 WenhaoZhangandMick Qian
|
d0a098b2e0
|
[diffusion] perf: split and batch LTX-2.3 one-stage guidance passes under CFG parallel (#43684)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-12 09:36:01 +08:00 |
|
WenhaoZhang
|
a954b395e6
|
[diffusion] perf: layerwise offload for the LTX-2.5 Gemma-4 text encoder (#43683)
|
2026-10-12 09:34:35 +08:00 |
|
WenhaoZhang
|
a67228aa43
|
[diffusion] fix: shard Qwen-Image adaLN modulation and text FFN under TP (#43691)
|
2026-10-12 09:32:52 +08:00 |
|
Liangsheng Yin
|
e6072935bf
|
[DSpark] Apply SGLANG_SIMULATE_ACC_LEN inside the accept instead of switching paths (#43623)
|
2026-10-11 15:33:24 -07:00 |
|
Liangsheng Yin
|
a65b776963
|
[DSpark] Add SGLANG_DSPARK_USE_GREEDY_DRAFT, an argmax draft accepted as one-hot (#43670)
|
2026-10-11 15:18:59 -07:00 |
|
Liangsheng Yin
|
3cc23b3b86
|
[DSpark] Merge the draft TP sync sites into dspark-draft (#43669)
|
2026-10-11 15:17:47 -07:00 |
|
Liangsheng Yin
|
00ba90fd1a
|
[DSpark] Run the same markov block in the draft graph tail; drop SGLANG_DSPARK_FOLDED_SAMPLING (#43668)
|
2026-10-11 15:15:59 -07:00 |
|
Liangsheng Yin
|
48abbdb845
|
[DSpark] Draft the eager markov block through MarkovSampleStep (#43622)
|
2026-10-11 15:13:02 -07:00 |
|
Liangsheng Yin
|
467209e838
|
[DSpark] Add MarkovSampleStep, one op for a markov draft step's add and token pick (#43621)
|
2026-10-11 15:10:58 -07:00 |
|
Liangsheng Yin
|
9943cf8eef
|
[DSpark] Run every markov head through one step interface (#43620)
|
2026-10-11 15:07:51 -07:00 |
|
 Banruo LiuandShangming Cai
|
d62b9c2480
|
[KV Events] Publish LoRA adapter names and namespaced block hashes (#42455)
Signed-off-by: Banruo Liu <lichangxinlivingshade@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-11 23:23:30 +08:00 |
|
 
|
97bfa5cc53
|
[diffusion] fix: select VSA-H3 for FastH3 when no transformer backend is given (#43690)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 23:05:25 +08:00 |
|
Ke Bao
|
46a97e5540
|
Preserve serialized page dtype in NIXL copy fallback (#43593)
|
2026-10-11 22:39:14 +08:00 |
|
Ke Bao
|
b0a75c8196
|
Share MLA host capacity initialization (#43595)
|
2026-10-11 22:36:29 +08:00 |
|
Ke Bao
|
c938b6e454
|
Build Mamba host pools from device buffer infos (#43596)
|
2026-10-11 22:35:52 +08:00 |
|
Shuwen Wang
|
ef3e5c83c5
|
[HiCache] Keep storage workers alive on backend exceptions (#43550)
|
2026-10-11 22:26:56 +08:00 |
|
 MickandMick Qian
|
11bfd868ac
|
[diffusion] perf: encode LTX video/audio through the shared bounded MP4 path (#43656)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-11 21:15:49 +08:00 |
|
Shuwen Wang
|
0923bcd258
|
[Unified Radix] Invalidate lazy Mamba checkpoints before in-place tracking (#43567)
|
2026-10-11 21:12:51 +08:00 |
|
FeiHong Guo
|
cf88ed4352
|
[BugFix][DP] Prevent health checks from perturbing user request routing (#35721)
Signed-off-by: Phoenix3334 <Phoenix3334@users.noreply.github.com>
|
2026-10-11 21:08:55 +08:00 |
|
Shuwen Wang
|
d26b6a5a9c
|
fix: default Inkling to fa4 on Hopper (#35292)
|
2026-10-11 20:57:42 +08:00 |
|
 trebladevandMick Qian
|
586d98cc15
|
[Diffusion] Add ModelOpt FP8 checkpoint quantization for Pi0.5 (#43062)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-11 20:55:59 +08:00 |
|
 MickandMick Qian
|
04f740580c
|
[VLM] fix: repair multimodal VMM lease cleanup and source-stream ordering (#43475)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-11 19:13:39 +08:00 |
|
 
|
efd14cfb66
|
[DeepSeek-V4.1] Use num_stages=1 for the hc_mix stats partial kernel (#43070)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yuan Luo <4908075+yuan-luo@users.noreply.github.com>
|
2026-10-11 19:03:19 +08:00 |
|
Sage
|
53295c6972
|
[kvevents] fix missing topics in replayed kv events (#43386)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-11 17:25:43 +08:00 |
|
Liangsheng Yin
|
0a21a3b798
|
[Scheduler] Keep a DP-converted decode batch as the running batch (#43283)
|
2026-10-11 01:23:51 -07:00 |
|
jiaqiang-dot-liu
|
41652225d0
|
[Sampler] Sort only the max(top_k) leading columns in the torch sampler (#43346)
|
2026-10-11 01:00:59 -07:00 |
|
Liangsheng Yin
|
dab108b9f3
|
[Scheduler] Hold back decode rows on a mixed step when they do not fit the KV pool (#43290)
|
2026-10-11 00:18:27 -07:00 |
|
Liangsheng Yin
|
89e24e7a20
|
[KV canary] Expect sweep counters on the target runner only (#43286)
|
2026-10-10 23:52:17 -07:00 |
|
Liangsheng Yin
|
ad8b1e1f85
|
[Test] Do not hang scripted-runtime teardown when the server died (#43285)
|
2026-10-10 23:13:56 -07:00 |
|
Liangsheng Yin
|
448759b235
|
[Scheduler] Requeue preempted requests when admission admits nothing (#43298)
|
2026-10-10 22:46:55 -07:00 |
|
Qiaolin Yu
|
047405f534
|
[qwen 3.8 next] Fuse QSA prefill KV gathering and dtype conversion (#41933)
|
2026-10-10 22:40:23 -07:00 |
|
paulzhang-tm
|
5678b71b6c
|
[Spec] Allow Qwen3.5 backends to opt into packed target verification (#43037)
|
2026-10-10 22:39:17 -07:00 |
|
Nikolai
|
22d63f5e43
|
[AMD]Qwen add Sparse attention to capturing hip graphs (#43383)
|
2026-10-10 22:03:54 -07:00 |
|
Jzz1943
|
260551ebe9
|
[KDA] Support Helion MTP verification and harden prefill, decode (#42857)
|
2026-10-11 12:47:57 +08:00 |
|
 SunskyXHandXiaoyu Zhang
|
65e6bb6be7
|
[GDN] Fix CuTe DSL decode to read the [N, HV, V, K] state layout (#43332)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 12:43:16 +08:00 |
|
 
|
a1500b10e3
|
[diffusion] Don't report video jobs completed after their outputs are deleted (#43084)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-11 12:42:38 +08:00 |
|
 Chunan ZengandClaude Opus 5.5
|
aa5c969dc3
|
[Perf] Fuse BF16 writes to native HND KV cache storage (#43237)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 12:41:18 +08:00 |
|