   
|
7c9a78efbe
|
[Feat] nemotron: Port Nemotron 3.5 Super serving changes (#44518)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 13:27:22 +08:00 |
|
Yuwei An
|
834bfe4ef0
|
[Fix] attention: Opt FlashMLA scheduler into dynamic shared memory (#44580)
|
2026-10-18 20:31:39 -07:00 |
|
Duyi-Wang
|
8d3eee46a7
|
[Perf] [AMD] deepseek-v4: Skip top-k refinement for proven positive-zero ties (#44927)
|
2026-10-19 11:27:47 +08:00 |
|
Kotthagattu Meher Sai
|
7f96dc6874
|
[Perf] [XPU] server_args: Enable fused QK-norm + RoPE by default (#43345)
|
2026-10-19 10:19:52 +08:00 |
|
Khoa Pham
|
a7fd2e1158
|
[Feat] dsv4.1: Return prompt logprobs under encoder SWA bounded replay (#45050)
|
2026-10-18 19:08:20 -07:00 |
|
 Wuhen DuanandEven Zhou
|
69076b9f9e
|
[CI] [NPU] tests: Reduce HiCache sizes and enable expandable pinned memory in focused tests (#41675)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2026-10-19 10:06:35 +08:00 |
|
  
|
fea48754de
|
[Feat] rust/grpc: Add ListModels, Detokenize, and Abort to api.v1 (#42118)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-10-19 09:53:56 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
377cd867fd
|
[Perf] dsa: Route the k-pool indexer top-k through the top-k v2 kernel (#43775)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-19 09:49:39 +08:00 |
|
Yuwei An
|
df078cc729
|
[Fix] DSv4.1: Support CUDA image requests with encoder bounded replay and CI Test (#45048)
|
2026-10-18 18:47:17 -07:00 |
|
A&W
|
cff88d6eac
|
[Fix] diffusion: Invalidate merged LoRA cache after adapter rewrites (#44204)
|
2026-10-19 01:08:57 +00:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
329072d99a
|
[Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 08:55:47 +08:00 |
|
Liangsheng Yin
|
59fec011dd
|
[Fix] deepseek-v4.1: Reject encoder replay on a chunk too small for a hit or on other models (#45051)
|
2026-10-18 17:55:35 -07:00 |
|
Liangsheng Yin
|
3c560089e1
|
[Refactor] scheduler: Bill encoder replay rows in _update_prefill_budget (#45047)
|
2026-10-18 17:17:38 -07:00 |
|
Liangsheng Yin
|
1637a4e305
|
[Fix] scheduler: Clear stale encoder_swa_reset in convert_decode_to_extend (#45042)
|
2026-10-18 17:09:19 -07:00 |
|
Liangsheng Yin
|
6708426728
|
[Fix] spec: Remove --speculative-skip-dp-mlp-sync (#45043)
|
2026-10-18 16:41:21 -07:00 |
|
Liangsheng Yin
|
1461152cb0
|
[Fix] deepseek-v4.1: Leave room for encoder replay rows when sizing a prefill chunk (#45040)
|
2026-10-18 15:43:08 -07:00 |
|
Liangsheng Yin
|
fe89a7c890
|
[Fix] deepseek-v4.1: Start the PD decode draft SWA window at the prefill draft valid-from (#45037)
|
2026-10-18 15:06:20 -07:00 |
|
Liangsheng Yin
|
da414adda7
|
[Fix] engram: Clamp multimodal pad ids in host-built history rows (#45038)
|
2026-10-18 12:24:05 -07:00 |
|
Ke Bao
|
4ec19ca27f
|
[Refactor] memory-pool: Build KV host pools from buffer info (#40917)
|
2026-10-18 23:21:16 +08:00 |
|
Ke Bao
|
bb1d4cddd9
|
[Refactor] hicache: Route Mamba host transfers from pool info (#44968)
|
2026-10-18 23:02:46 +08:00 |
|
Xinyuan Tong
|
d4e3c163c9
|
[CI] radix-cache: Register the Inkling cache linker KL test to extra-b (#45004)
|
2026-10-18 22:23:34 +08:00 |
|
  
|
e9b22a0818
|
[Perf] [AMD] monokernels: Let a plugin skip per-step attention metadata (#44601)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
Co-authored-by: kkHuang-amd <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 14:04:57 +00:00 |
|
Cheng Wan
|
57db5089c2
|
[Perf] attention: Capture translated FA4 verify metadata for DSPARK (#44973)
|
2026-10-18 05:42:16 -07:00 |
|
Cheng Wan
|
2e9b2cacda
|
[Perf] speculative: Fuse draft write-window gathering and KV translation (#44972)
|
2026-10-18 05:41:34 -07:00 |
|
Cheng Wan
|
2a83471676
|
[Perf] mamba: Fuse strided state updates and replay index translation (#44971)
|
2026-10-18 05:40:57 -07:00 |
|
Cheng Wan
|
d318a546da
|
[Perf] unified-memory: Reduce allocation and SWA retirement overhead (#44970)
|
2026-10-18 05:40:25 -07:00 |
|
Cheng Wan
|
a5b21145e1
|
[Refactor] attention: Separate decode metadata from pool ownership (#44969)
|
2026-10-18 05:39:44 -07:00 |
|
 
|
3edb156dec
|
[Feat] unified-memory: Fuse drafts with sliding-window and recurrent-state layers (#43326)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-18 05:39:09 -07:00 |
|
caihuali95
|
19cb24f1e1
|
[Feat] unified-memory: Support asymmetric KV rows (#43325)
|
2026-10-18 05:37:50 -07:00 |
|
 caihuali95andCaihua Li
|
1d17066bad
|
[Perf] gdn: Select FlashInfer prefill for page-major pools (#43171)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
|
2026-10-18 05:37:24 -07:00 |
|
 caihuali95andCaihua Li
|
ba50ea3d77
|
[Perf] unified-memory: Free SWA segments without a host sync (#43170)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
|
2026-10-18 05:36:56 -07:00 |
|
 caihuali95andCaihua Li
|
47eeddcd18
|
[Fix] swa: Retain a whole window behind insertion pages (#43168)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
|
2026-10-18 05:36:02 -07:00 |
|
 WenhaoZhangandMick
|
1fd46ddd56
|
[Perf] diffusion: fused indexed modulation for FP32 AdaLN tables (#44180)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-18 20:31:36 +08:00 |
|
Shuwen Wang
|
8dee3f6bdb
|
[Fix] [H200] ci: Split GLM-5.3-Flash serving recipes into separate tests (#44892)
|
2026-10-18 19:26:40 +08:00 |
|
Shuwen Wang
|
f8e32706fc
|
[CI] radix-cache: Re-enable Inkling unified cache linker KL test (#44938)
|
2026-10-18 19:26:22 +08:00 |
|
   
|
3b932cde26
|
[Fix] VLM: harden Kimi image cache identity across preprocessing and radix hashing (#43043)
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-18 17:39:37 +08:00 |
|
 
|
5a930cfd88
|
[Fix] glm4v: Clamp request video budgets to the deployment limit (#43871)
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 17:31:33 +08:00 |
|
 Ilia Yastrebovandishandhanani
|
6c3db0f520
|
[Perf] NIXL: prepared dlists for hybrid-model state transfer (#44740)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-10-18 16:59:18 +08:00 |
|
Xinyuan Tong
|
80fef63786
|
[Fix] Inkling: frame constrained output in native message tokens (#44716)
|
2026-10-18 16:47:56 +08:00 |
|
Huang Long
|
889658a5be
|
[Fix] disaggregation: Reuse startup decode graphs across PD role switches (#43760)
|
2026-10-18 16:16:46 +08:00 |
|
+14        
|
d33dd0566a
|
[Feat] srt: Add muse spark runtime, multimodal support and tests (3/5) (#44666)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-10-18 01:00:24 -07:00 |
|
Zhaoyi Li
|
f1cf2e1005
|
[Fix] [AMD] mori: Look up elided DSA state entries by the paired dst index (#44412)
|
2026-10-18 00:29:22 -07:00 |
|
Shuwen Wang
|
ba3fc9441d
|
[Fix] mamba: Release consumed lazy Mamba prefix locks before donation retry (#43559)
|
2026-10-18 15:16:31 +08:00 |
|
Shuwen Wang
|
a11fa06be7
|
[Fix] hicache: Key MLA Mamba state per TP rank in the file backend (#41907)
|
2026-10-18 15:10:50 +08:00 |
|
Shuwen Wang
|
ffc4573c98
|
[Fix] hicache: Key MLA Mamba state per TP rank in the SeaweedFS backend (#43816)
|
2026-10-18 15:09:58 +08:00 |
|
Shuwen Wang
|
e6c2cd47a9
|
[Fix] hicache: Keep unified memory off the direct page_first_direct copies (#43333)
|
2026-10-18 15:09:26 +08:00 |
|
Liangsheng Yin
|
df966f2345
|
[Feat] deepseek-v4.1: Run encoder SWA bounded replay on PD prefill workers (#44952)
|
2026-10-18 00:07:55 -07:00 |
|
Ziang Li
|
520df8a491
|
[Perf] weight-sync: Allocate packed receive buffers from metadata (#39264)
|
2026-10-18 00:04:10 -07:00 |
|
Michael
|
00f6cdcd1b
|
[Fix] [AMD] kda: Reject match_cutedsl_decode on ROCm and skip its parity tests (#44089)
|
2026-10-18 00:01:40 -07:00 |
|
Bowen Wang
|
3671503e44
|
[Feat] bench: report goodput and SLO attainment in bench_serving (#43967)
|
2026-10-18 13:31:48 +08:00 |
|