 chaijiacheng888
|
2d216a11f8
|
[Model] Serve DeepSeek-OCR-2 with its official 768px local-crop geometry (#38996)
|
2026-09-20 14:17:21 +08:00 |
|
|
Sasha Sidorov
|
59dd2fc734
|
[2/N] [Kernel] Fuse padding-preserving HiSparse slot translation (#39837)
|
2026-09-20 12:04:03 +08:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
df0dc44931
|
[Fix] Forward SWA prealloc reclaim through the DSV4 HiSparse allocator (#40354)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-19 20:27:51 -07:00 |
|
|
huangtingweiandChao Shi
|
020703923d
|
[PP + HiCache] Add PP Prefetch Tickets for eager cross-stage storage prefetch (#36700)
Co-authored-by: Chao Shi <stepinto@live.com>
|
2026-09-20 11:19:31 +08:00 |
|
|
Tri Dao
|
d82d653f96
|
Enable optimistic prefill for Mamba radix-cache models (#40184)
|
2026-09-19 19:28:11 -07:00 |
|
|
huangtingweiandZhangheng
|
e9300f643e
|
[Unified Cache][9/N] add opt-in MLA load deduplication for Mooncake Linker (#39565)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-09-20 09:56:56 +08:00 |
|
|
AndyLi429andAndyLi429
|
d903351a66
|
[NPU][bugfix] update low latency quantization input and update MXFP8 tests (#38831)
Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
|
2026-09-20 09:55:30 +08:00 |
|
|
|
f9c2791460
|
[diffusion] model: support qwen-image-2.1 (#39983)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-20 09:46:09 +08:00 |
|
|
BourneSun0527andEven Zhou
|
d2f291c934
|
[NPU][DSV4]dsv4 enable cpp (#39820)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2026-09-20 09:17:27 +08:00 |
|
|
YAMY
|
9cc7da2ab0
|
[MegaMoE] Wire Qwen MoE blocks to DeepGEMM MegaMoE (MXFP4 and NVFP4 experts) (#38080)
|
2026-09-19 16:00:38 -07:00 |
|
|
|
3a64faa1f2
|
Fix disagg PP MTP for GLM-5.2 (#39378)
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
|
2026-09-19 13:55:07 -07:00 |
|
|
Zhiqiang Xie
|
7a6c652c77
|
[HiCache] Auto-size the host pool to fit available host memory (#40135)
|
2026-09-19 12:50:43 -07:00 |
|
|
metamergebotandcctry
|
9e5a62a767
|
[Logprob] Serve input-logprob temporaries from CUDA-graph-pool dead space (#40038)
Co-authored-by: cctry <csycfl@gmail.com>
|
2026-09-19 12:03:52 -07:00 |
|
|
|
7b67a96640
|
[DSV4] Chunk the indexer MQA logits by query rows under a free-memory budget (#39095)
Signed-off-by: Shiki Wu <shikiw@nvidia.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-09-19 11:53:20 -07:00 |
|
|
|
993d1fccba
|
[ROCm] Widen the HiCache JIT copy rounds and enable the K-only host pool (#37152)
Co-authored-by: Xiaobo Chen <xiaobche@smci355-ccs-aus-n05-33.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-09-19 08:58:10 -07:00 |
|
|
Xiaoyu Zhang
|
7fac84b639
|
[DSV4.1] Reduce mHC, metadata and small-batch router overhead (#39704)
|
2026-09-19 19:51:21 +08:00 |
|
|
DarkSharpnessandBBuf
|
d1acbe0746
|
[DSV4.1] Big fused wo_a quant (#39957)
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-09-19 19:46:53 +08:00 |
|
|
Xiaoyu Zhang
|
cb22f2451e
|
[Cleanup] Deduplicate kernel tests, diffusion fixtures and benchmark helpers (#40265)
|
2026-09-19 19:45:38 +08:00 |
|
|
Xiaoyu Zhang
|
0b0d2c257a
|
[Fix] Repair CI fixtures and ROCm speculative tree device checks (#40325)
|
2026-09-19 18:16:05 +08:00 |
|
|
Cheng Wan
|
567d5925fe
|
Fix mxfp4 padding test stubbing an accessor the module no longer imports (#40308)
|
2026-09-19 00:43:56 -07:00 |
|
|
Cheng Wan
|
3a5f52e144
|
Record a process's placement at publish, not at group build (#40071)
|
2026-09-18 23:52:37 -07:00 |
|
|
Xiaoyu Zhang
|
36aa8479ef
|
[Test] Fix fusion-group mocks after runtime context migration (#40290)
|
2026-09-19 14:45:16 +08:00 |
|
|
Lianmin Zheng
|
5d703de9e4
|
[HiCache] Size MHA host pools from device row width (#40304)
|
2026-09-18 23:37:58 -07:00 |
|
|
Xiaozhu Mengandmxz
|
111aeedd37
|
[Runtime] Add decode CUDA graph hooks for eager logits processing (#40222)
Co-authored-by: mxz <mxz@fb.com>
|
2026-09-18 23:27:03 -07:00 |
|
|
|
677c1cbdc9
|
[Metrics] Propagate idle gaps across all scheduler loops (#40004)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
|
2026-09-18 22:42:00 -07:00 |
|
|
|
8189e3896b
|
[PD] Skip singleton transfer-status all-reduces (#40003)
Co-authored-by: Pranjal Shankhdhar <pranjalssh@users.noreply.github.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
|
2026-09-18 22:41:50 -07:00 |
|
|
|
5e9342d16f
|
[PP][DeepSeek V4] Overlap communication and optimize SM120 prefill (#38792)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
|
2026-09-18 21:18:04 -07:00 |
|
|
|
929230a6f0
|
Fix GLM-OCR MTP multimodal embeddings and positions (#39088)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-18 21:10:04 -07:00 |
|
|
Vincent Liu
|
090263eff6
|
[VLM] avoid CUDA placement on non-CUDA platforms (#38750)
|
2026-09-19 11:13:22 +08:00 |
|
|
Xiaoyu Zhang
|
986959e3c4
|
[Refactor] Deduplicate kernel helpers and remove unused code (#40197)
|
2026-09-19 09:27:30 +08:00 |
|
|
Khoa PhamandCursor
|
10b0bcfd18
|
[PD] Allow decode radix cache and HiCache L1/L2 with DCP (#40263)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-18 17:54:35 -07:00 |
|
|
Liangsheng Yin
|
d507accadc
|
[Test] Drop dead and strictly-subsumed CI test registrations (#40264)
|
2026-09-18 17:49:13 -07:00 |
|
|
Cheng Wan
|
fa7e83fd09
|
Name the two widths of the WORLD group (#40070)
|
2026-09-18 17:47:02 -07:00 |
|
|
Cheng Wan
|
81421b91e9
|
One read path for every parallel name (#40069)
|
2026-09-18 17:43:56 -07:00 |
|
|
Cheng Wan
|
afe71f4b9e
|
Read process groups through the runtime context (#40068)
|
2026-09-18 17:40:32 -07:00 |
|
|
|
5931fd60ee
|
Support unified memory page-envelope transfers in PD (#39477)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yonghao Zhuang <yhzhuang@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-09-18 17:39:50 -07:00 |
|
|
Cheng Wan
|
d0730a0e8b
|
Give the attention-DP width and rank one home (#40067)
|
2026-09-18 17:34:33 -07:00 |
|
|
Lifan Shen
|
8ea0ee300d
|
perf(sampling): avoid GPU syncs when applying custom logit processors (#39234)
|
2026-09-18 17:09:30 -07:00 |
|
|
Alison ShaoandXinyuan Tong
|
21e6c98ccb
|
Fix corrupted chat prompts on mistral_common tokenizers (tool_choice auto never fires) (#39773)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-18 16:12:06 -07:00 |
|
|
|
2394b231c2
|
Fix Mistral3 retaining every vision-tower layer to read one (#39185)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-09-18 16:11:54 -07:00 |
|
|
Zhiqiang Xieandcctry
|
ceb1d2e580
|
[PD] Enable optimistic prefill with buffer-only L3 write-through HiCache (#40043)
Co-authored-by: cctry <csycfl@gmail.com>
|
2026-09-18 16:04:15 -07:00 |
|
|
|
5e4b94b134
|
[MM] Skip VMM error gathers for text-only requests (#40005)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-09-18 16:00:43 -07:00 |
|
|
Jialin Ouyang
|
f3851486cb
|
[Perf] Fuse SWA page lookup and mapping clear (#38948)
|
2026-09-18 15:51:07 -07:00 |
|
|
|
81a199f56a
|
[HiCache] Read the in-flight buffer backup's node id from its snapshot in sanity_check (#40013)
Co-authored-by: Pranjal Shankhdhar <pranjalssh@meta.com>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
|
2026-09-18 15:47:56 -07:00 |
|
|
|
0e5347db82
|
Support MXFP8 and deferred route weighting in DeepEP v2 (#40030)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: pranjalssh <14260275+pranjalssh@users.noreply.github.com>
|
2026-09-18 15:40:38 -07:00 |
|
|
Liangsheng Yin
|
6cc9090d1f
|
[mem_cache] Release up to owned_kv_len on radix cache insert (#40075)
|
2026-09-18 15:37:52 -07:00 |
|
|
Zhiqiang Xie
|
a0534f8cca
|
[HiCache] Stop arming a prefetch retry for a too-short storage span (#40042)
|
2026-09-18 15:33:58 -07:00 |
|
|
Sam (Kesen Li)
|
d346b214fb
|
feat(kv-cache): support SM100 NVFP4 GenMHA and speculative decoding (#36340)
|
2026-09-18 14:50:46 -07:00 |
|
|
metamergebotandcctry
|
6a9c7001d3
|
[Logprob] Borrow graph-pool memory for input logprob logits construction (#40007)
Co-authored-by: cctry <csycfl@gmail.com>
|
2026-09-18 13:18:01 -07:00 |
|
|
Jialin Ouyang
|
da2f434951
|
[Spec] Add explicit prefill shared-read capability for plugins (#39502)
|
2026-09-18 13:11:01 -07:00 |
|