 Xiaoyu Zhang
|
36aa8479ef
|
[Test] Fix fusion-group mocks after runtime context migration (#40290)
|
2026-09-19 14:45:16 +08:00 |
|
|
Lianmin Zheng
|
5d703de9e4
|
[HiCache] Size MHA host pools from device row width (#40304)
|
2026-09-18 23:37:58 -07:00 |
|
|
Xiaozhu Mengandmxz
|
111aeedd37
|
[Runtime] Add decode CUDA graph hooks for eager logits processing (#40222)
Co-authored-by: mxz <mxz@fb.com>
|
2026-09-18 23:27:03 -07:00 |
|
|
|
677c1cbdc9
|
[Metrics] Propagate idle gaps across all scheduler loops (#40004)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
|
2026-09-18 22:42:00 -07:00 |
|
|
|
8189e3896b
|
[PD] Skip singleton transfer-status all-reduces (#40003)
Co-authored-by: Pranjal Shankhdhar <pranjalssh@users.noreply.github.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
|
2026-09-18 22:41:50 -07:00 |
|
|
|
5e9342d16f
|
[PP][DeepSeek V4] Overlap communication and optimize SM120 prefill (#38792)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
|
2026-09-18 21:18:04 -07:00 |
|
|
|
929230a6f0
|
Fix GLM-OCR MTP multimodal embeddings and positions (#39088)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-18 21:10:04 -07:00 |
|
|
Vincent Liu
|
090263eff6
|
[VLM] avoid CUDA placement on non-CUDA platforms (#38750)
|
2026-09-19 11:13:22 +08:00 |
|
|
Xiaoyu Zhang
|
986959e3c4
|
[Refactor] Deduplicate kernel helpers and remove unused code (#40197)
|
2026-09-19 09:27:30 +08:00 |
|
|
Khoa PhamandCursor
|
10b0bcfd18
|
[PD] Allow decode radix cache and HiCache L1/L2 with DCP (#40263)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-18 17:54:35 -07:00 |
|
|
Liangsheng Yin
|
d507accadc
|
[Test] Drop dead and strictly-subsumed CI test registrations (#40264)
|
2026-09-18 17:49:13 -07:00 |
|
|
Cheng Wan
|
fa7e83fd09
|
Name the two widths of the WORLD group (#40070)
|
2026-09-18 17:47:02 -07:00 |
|
|
Cheng Wan
|
81421b91e9
|
One read path for every parallel name (#40069)
|
2026-09-18 17:43:56 -07:00 |
|
|
Cheng Wan
|
afe71f4b9e
|
Read process groups through the runtime context (#40068)
|
2026-09-18 17:40:32 -07:00 |
|
|
|
5931fd60ee
|
Support unified memory page-envelope transfers in PD (#39477)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yonghao Zhuang <yhzhuang@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-09-18 17:39:50 -07:00 |
|
|
Cheng Wan
|
d0730a0e8b
|
Give the attention-DP width and rank one home (#40067)
|
2026-09-18 17:34:33 -07:00 |
|
|
Lifan Shen
|
8ea0ee300d
|
perf(sampling): avoid GPU syncs when applying custom logit processors (#39234)
|
2026-09-18 17:09:30 -07:00 |
|
|
Alison ShaoandXinyuan Tong
|
21e6c98ccb
|
Fix corrupted chat prompts on mistral_common tokenizers (tool_choice auto never fires) (#39773)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-18 16:12:06 -07:00 |
|
|
|
2394b231c2
|
Fix Mistral3 retaining every vision-tower layer to read one (#39185)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-09-18 16:11:54 -07:00 |
|
|
Zhiqiang Xieandcctry
|
ceb1d2e580
|
[PD] Enable optimistic prefill with buffer-only L3 write-through HiCache (#40043)
Co-authored-by: cctry <csycfl@gmail.com>
|
2026-09-18 16:04:15 -07:00 |
|
|
|
5e4b94b134
|
[MM] Skip VMM error gathers for text-only requests (#40005)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-09-18 16:00:43 -07:00 |
|
|
Jialin Ouyang
|
f3851486cb
|
[Perf] Fuse SWA page lookup and mapping clear (#38948)
|
2026-09-18 15:51:07 -07:00 |
|
|
|
81a199f56a
|
[HiCache] Read the in-flight buffer backup's node id from its snapshot in sanity_check (#40013)
Co-authored-by: Pranjal Shankhdhar <pranjalssh@meta.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
|
2026-09-18 15:47:56 -07:00 |
|
|
|
0e5347db82
|
Support MXFP8 and deferred route weighting in DeepEP v2 (#40030)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: pranjalssh <14260275+pranjalssh@users.noreply.github.com>
|
2026-09-18 15:40:38 -07:00 |
|
|
Liangsheng Yin
|
6cc9090d1f
|
[mem_cache] Release up to owned_kv_len on radix cache insert (#40075)
|
2026-09-18 15:37:52 -07:00 |
|
|
Zhiqiang Xie
|
a0534f8cca
|
[HiCache] Stop arming a prefetch retry for a too-short storage span (#40042)
|
2026-09-18 15:33:58 -07:00 |
|
|
Sam (Kesen Li)
|
d346b214fb
|
feat(kv-cache): support SM100 NVFP4 GenMHA and speculative decoding (#36340)
|
2026-09-18 14:50:46 -07:00 |
|
|
metamergebotandcctry
|
6a9c7001d3
|
[Logprob] Borrow graph-pool memory for input logprob logits construction (#40007)
Co-authored-by: cctry <csycfl@gmail.com>
|
2026-09-18 13:18:01 -07:00 |
|
|
Jialin Ouyang
|
da2f434951
|
[Spec] Add explicit prefill shared-read capability for plugins (#39502)
|
2026-09-18 13:11:01 -07:00 |
|
|
Lianmin Zhengandraghotham
|
248c202b46
|
Use runtime token widths for Triton speculative verification (#39859)
Co-authored-by: raghotham <853234+raghotham@users.noreply.github.com>
|
2026-09-18 11:07:55 -07:00 |
|
|
Lianmin Zheng
|
6bd1a0af1d
|
Add registration for external model configurations (#39452)
|
2026-09-18 10:06:24 -07:00 |
|
|
|
81363bf8cb
|
[kernel] Share the warp vectorized copy and enforce its alignment (#36176)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-18 22:40:54 +08:00 |
|
|
|
a6cf05817f
|
dsv4.1: remaining model and runtime integration (#38798)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <xiaoyu.zhang@radixark.ai>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Zhichen Zeng <zczeng@uw.edu>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-09-18 02:55:30 -07:00 |
|
|
Liangsheng Yin
|
1b200ffaaa
|
[Quant] Serve 32-wide-K ue8m0 block-FP8 linears through the FlashInfer MXFP8 GEMMs (#40039)
|
2026-09-18 02:51:12 -07:00 |
|
|
Shu Wang
|
1e8699fda3
|
[NVIDIA][comm] Merge EP+MoE-TP post-experts all-reduces into one _TP reduction (#32963)
|
2026-09-18 01:35:10 -07:00 |
|
|
zhaozx-cn
|
8ac39c66d8
|
[NPU] support kimi k3 on A5 and improve performance (#39589)
|
2026-09-18 16:33:54 +08:00 |
|
|
Rumit DesaiandXiaoyu Zhang
|
1fdd6c8921
|
[Runtime] Let out-of-tree platforms provide full graph backends (#37969)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-18 15:42:46 +08:00 |
|
|
iridiumine
|
f86f60081d
|
[NPU] Adapt hicache for K3 hybrid models (#39415)
|
2026-09-18 14:48:20 +08:00 |
|
|
Jensen
|
3ce3b4969f
|
[NPU] Avoid repeated BF16 wo_a weight transposes in DeepSeek-V4 decode (#39919)
|
2026-09-18 09:10:43 +03:00 |
|
|
maithilijoshi20
|
0dad91d50f
|
Fix int4 MoE tuner config filename (#35260)
Signed-off-by: maithilijoshi20 <maithilij2003@gmail.com>
|
2026-09-18 13:56:38 +08:00 |
|
|
Yuwei An
|
65ef55e2a8
|
[Scheduler] Add shortest-prefill-first scheduling (#40024)
|
2026-09-17 21:18:58 -07:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
c055dc6ff6
|
[CI] Check B200 NUMA mapping against sysfs numa_node (#40055)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-17 21:14:47 -07:00 |
|
|
|
db39b7f961
|
[Fix] Guard conditional top-logprob keys in the completions echo path (#34776)
Co-authored-by: James Liu <jamesl@modal.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-17 19:47:26 -07:00 |
|
|
Nan Jiang
|
740f57a02c
|
[Spec] Fix CDF boundary handling in TreeSpeculativeSamplingTargetOnly (#35798)
|
2026-09-17 19:41:52 -07:00 |
|
|
William Arnoldandishandhanani
|
0214954f26
|
[gRPC] Stream engine state changes (#39915)
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-09-17 19:17:25 -07:00 |
|
|
Liangsheng Yin
|
f65c70bb7d
|
[Kernel] Move CUDA and ROCm speculative kernels to JIT (#40033)
|
2026-09-17 17:27:26 -07:00 |
|
|
Nan Jiang
|
20518d8518
|
[Scheduler] Align RadixCache no-insert cleanup with kv_len_to_handle (#35204)
|
2026-09-17 17:00:59 -07:00 |
|
|
Xiaoyu Zhang
|
7bc9152447
|
[Test] Consolidate kernel tests under plural kernels tree (#39966)
|
2026-09-18 07:37:48 +08:00 |
|
|
Liangsheng Yin
|
1f0c73e9bd
|
[DSV4] Generalize attention metadata, sparse prefill, and KV pool over compress ratios (#39921)
|
2026-09-17 15:55:19 -07:00 |
|
|
Thomas Wang
|
6c73368c32
|
[AMD][DSV4] Enable hicache on deepseek-v4 fp8 unified attn (#37778)
|
2026-09-17 11:29:23 -07:00 |
|