 YAMYandOasis-Git
|
c82f7141ad
|
[Perf] [NVIDIA] dspark: Move the host work between DSv4.1 decode graphs into the graphs for the megakernel path (#45450)
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2026-10-22 19:08:06 -07:00 |
|
Liangsheng Yin
|
d61f618276
|
[Perf] spec: Let DSPARK prefill publish read-done by placing its draft KV inject before the target forward (#45682)
|
2026-10-21 18:40:44 -07:00 |
|
Liangsheng Yin
|
3438ed660d
|
[Test] cpu: prune mirror and tautology cases from the per-commit CPU suite (#45672)
|
2026-10-21 16:02:47 -07:00 |
|
Liangsheng Yin
|
f7d4f06242
|
[Perf] dsv4: Compute request-window history rows once per batch (#45579)
|
2026-10-21 14:01:19 -07:00 |
|
Liangsheng Yin
|
6efdd33d07
|
[Refactor] spec: Move platform dispatch and Triton kernels into kernels/ops (#45504)
|
2026-10-21 01:22:16 -07:00 |
|
 Cheng WanandAditya Suresh
|
299a75ac5d
|
[Refactor] moe: Derive routing inputs from the layer and active forward (#44994)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
|
2026-10-20 16:26:15 -07:00 |
|
    
|
bf145750a6
|
[Perf] prefill-cuda-graph: Make prefill shared-read completion explicit and default-on (#37958)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-20 16:12:55 -07:00 |
|
Jensen
|
3bf4cbc6cf
|
[Perf] [NPU] mem_cache: Increase GLM-5.2-W4A8C8 KV cache capacity with compact DSA indexer allocation (#44436)
|
2026-10-20 16:30:01 +03:00 |
|
Liangsheng Yin
|
5e630fa571
|
[Perf] deepseek-v4.1: Drop host syncs from encoder-replay folding and tail metadata (#45275)
|
2026-10-19 19:39:39 -07:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
693d333306
|
[Refactor] kernels: Regroup operators by computation and dissolve ops/muse_spark (#45112)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-20 08:47:57 +08:00 |
|
  
|
33dd8f6a2e
|
[Fix] hybrid-SSM: DP attention failures at low concurrency (#34535)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-19 16:24:41 +08:00 |
|
Khoa Pham
|
a7fd2e1158
|
[Feat] dsv4.1: Return prompt logprobs under encoder SWA bounded replay (#45050)
|
2026-10-18 19:08:20 -07:00 |
|
Yuwei An
|
df078cc729
|
[Fix] DSv4.1: Support CUDA image requests with encoder bounded replay and CI Test (#45048)
|
2026-10-18 18:47:17 -07:00 |
|
Liangsheng Yin
|
59fec011dd
|
[Fix] deepseek-v4.1: Reject encoder replay on a chunk too small for a hit or on other models (#45051)
|
2026-10-18 17:55:35 -07:00 |
|
 
|
3edb156dec
|
[Feat] unified-memory: Fuse drafts with sliding-window and recurrent-state layers (#43326)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-18 05:39:09 -07:00 |
|
Liangsheng Yin
|
df966f2345
|
[Feat] deepseek-v4.1: Run encoder SWA bounded replay on PD prefill workers (#44952)
|
2026-10-18 00:07:55 -07:00 |
|
Liangsheng Yin
|
d20d010574
|
[Fix] deepseek-v4.1: Exchange late-layer DP row counts before the forward (#44948)
|
2026-10-17 21:46:46 -07:00 |
|
 Liangsheng YinandVincent Zhong
|
ff73d63121
|
[Perf] deepseek-v4.1: Run encoder SWA bounded replay in the breakable prefill graph (#44930)
Co-authored-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
|
2026-10-17 20:51:18 -07:00 |
|
Richard Wang
|
01f3cba70e
|
[Fix] dLLM: Size decode graphs to the default max running requests (#40941)
|
2026-10-17 20:22:39 -07:00 |
|
Yuwei An
|
b234b5c32e
|
[Refactor] TCPCG: Consolidate attention eager regions and isolate Inkling policy (4/9) (#42288)
|
2026-10-17 16:06:24 -07:00 |
|
Liangsheng Yin
|
563cd60345
|
[Fix] [AMD] deepseek-v4.1: Reject attention DP with encoder SWA bounded replay on ROCm (#44934)
|
2026-10-17 15:47:41 -07:00 |
|
Shuwen Wang
|
ae28306a74
|
[Fix] cuda_graph: Wait for in-flight layer-wise cache loads before prefill graph replay (#44220)
|
2026-10-17 19:13:57 +08:00 |
|
 
|
a2953d7b7f
|
[Fix] deepseek-v4.1: Serve prompt-logprob requests under decoder SWA bounded replay (#44850)
Co-authored-by: Pedram Ghazi <pedram.ghazi@amd.com>
Co-authored-by: David Orman <ormandj@corenode.com>
|
2026-10-17 01:25:33 -07:00 |
|
Liangsheng Yin
|
ef26f6ad49
|
[Fix] deepseek-v4.1: Keep the cached KV of folded encoder replay rows (#44857)
|
2026-10-17 00:56:18 -07:00 |
|
 
|
3603824541
|
[Perf] DSv4.1: Enable decoder bounded replay by default (#44403)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-16 19:52:02 -07:00 |
|
 
|
36cf028346
|
[Perf] unified-memory: Prewarm the compaction move at startup and copy whole page envelopes by page id (#44592)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: ZYHowell <ZYHowell@users.noreply.github.com>
|
2026-10-16 16:47:50 -07:00 |
|
 Khoa PhamandClaude Fable 5.1
|
aaf5f397a5
|
[Feat] dsv4.1: Support encoder SWA bounded replay with CUDA DP attention (#43813)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-16 15:38:33 -07:00 |
|
Liangsheng Yin
|
fad7d95a7f
|
[Fix] deepseek-v4.1: Keep the DSpark draft SWA out of the radix tree (#44673)
|
2026-10-16 01:18:58 -07:00 |
|
Yuwei An
|
06934575b9
|
[Fix] DSv4.1: Fix BCG image handling and add multimodal bounded replay coverage (#44131)
|
2026-10-15 22:32:55 -07:00 |
|
 
|
ed8c3139f1
|
[Fix] deepseek-v4.1: Keep the full SWA window for short bounded-replay extends (#41303)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-15 17:32:50 -07:00 |
|
 
|
33618d4f00
|
[Feat] runtime: Include FlashInfer’s default tactic in startup tuning. (#43927)
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 15:30:45 +08:00 |
|
   
|
1d809bbbbd
|
[Fix] DSv4.1: Size the encoder-replay SWA pool by the DSpark draft's stages, and keep more prefix tails (#43502)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-10-14 22:04:58 -07:00 |
|
Yuwei An
|
64a0a08f0a
|
[DSv4.1] Support TRT-LLM decoder bounded replay with BCG (#44326)
|
2026-10-14 17:39:52 -07:00 |
|
 YAMYandYuwei An
|
c891c5c7ca
|
[DSv4.1] Fold encoder-SWA replay into the extend forward (#43166)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-10-14 17:27:07 -07:00 |
|
huangtingwei
|
18210ed849
|
[HiSparse] Add speculative decoding support with multi-step KV cache swapping (#37771)
|
2026-10-13 13:38:31 -07:00 |
|
 
|
5bcaf0f8ed
|
[Core] Add request-level customized_info keys and mark Full prefill capture batches (#43772)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: jiayisuse <jiayisuse@users.noreply.github.com>
|
2026-10-13 11:45:52 -07:00 |
|
Ziang Li
|
01f6840693
|
[FlashInfer] Add startup autotuning for MegaMoE (#43789)
|
2026-10-13 02:30:31 -07:00 |
|
 Shu WangandAnish Shanbhag
|
e0c957e222
|
[HiCache][PD] Allow DSA index-K elision under HiCache and disaggregation (#41769)
Co-authored-by: Anish Shanbhag <ashanbhag@nvidia.com>
|
2026-10-13 02:07:54 -07:00 |
|
Shunkangz
|
de487f8039
|
[kv-shard 3/4] Enable Control Plane C (#40102)
|
2026-10-10 22:53:58 +08:00 |
|
Liangsheng Yin
|
c55790d38b
|
[CI] Drop CPU tests with no bug-catching signal and run Rust workspace tests in their own workflow (#43503)
|
2026-10-10 02:13:53 -07:00 |
|
  ![github-actions[bot]](/assets/img/avatar_default.png)
|
d7d22e8a30
|
[AMD] Resolving bug in per batch size graph capture due to multiple capture runs per batch size (#39840)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-10-10 00:47:13 -07:00 |
|
Yuwei An
|
8b2aaf7060
|
[Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287)
|
2026-10-09 22:42:35 -07:00 |
|
 Benjamin TruongandXiaoyu Zhang
|
37678784c6
|
[Gemma4][Attention] Enable Gemma4 FA4 on SM90 with head-dim 512 support (#42019)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-10 10:40:19 +08:00 |
|
 
|
5f94a45896
|
[srt] Allow mixed chunk prefill on the Full prefill CUDA graph backend (#43461)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-09 18:21:22 -07:00 |
|
Cheng Wan
|
58f6976ce7
|
[Fix] Unblock CUDA graph startup for hybrid parallelism (#43211)
|
2026-10-09 15:39:59 -07:00 |
|
 
|
66d840a8ef
|
[cuda_graph] Size dp-local decode graphs by the runner's own gather requirement (#43303)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: charlotte12l <charlotte12l@users.noreply.github.com>
|
2026-10-09 15:21:23 -07:00 |
|
 
|
3bffe69b74
|
[moe] Fill num_token_non_padded for the customized A2A backend at EP 1 (#43245)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: cctry <cctry@users.noreply.github.com>
|
2026-10-09 10:55:02 -07:00 |
|
Cheng Wan
|
125f88cb75
|
[Refactor] Run Kimi K3 through stage boundaries (#42894)
|
2026-10-09 01:25:51 -07:00 |
|
 
|
cba1d07a94
|
[Memory] Share one full prefill graph output buffer across shapes for tuple and list outputs (#43176)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-08 23:05:29 -07:00 |
|
 ormandjandkpham-sgl
|
438df9a2a4
|
[Spec] Fix wrong tokens from compact-verify CUDA graphs when a token tier is captured more than once (#42709)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
|
2026-10-08 19:49:23 -07:00 |
|