Commit Graph
6246 Commits
Author SHA1 Message Date
vikram singh shekhawat 3f36fc0833 [Fix] [XPU] runtime: Fix XPU rotary embeddings and tokenizer padding (#41213) 2026-10-23 14:09:59 +08:00
Pinjie Xu 7c680a0d45 [Perf] diffusion/cosmos3: optimize v2v preprocess performance (#45398)
Signed-off-by: pinjie <pinjiex@nvidia.com>
2026-10-23 13:57:38 +08:00
Khoa Pham c7994e7076 [Fix] dsv41: Keep MegaGate out of prefill graphs by gating on the forward mode (#45969) 2026-10-22 22:11:18 -07:00
Khoa Phamandhnyls2002 5bdbec0d48 [Perf] dsv41: Drop the MegaGate padded-row copy on sgl-deep-gemm 0.2.3.post2 (#45933)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-10-22 22:10:57 -07:00
e83f585ae6 [Perf] dsv41: Serve token-interleaved V4.1 KV caches with sgl-flash-mla (#45893)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 22:02:49 -07:00
Baizhou Zhang 698651acd0 [Feat] HiCache: Support fused DFLASH KV in unified hybrid SWA pools (#45700) 2026-10-22 20:00:28 -07:00
Liangsheng Yin a4838160b3 [Perf] dsv4: Write V4.1 K rows with one warp per token in the fused k-norm-rope store (#45934) 2026-10-22 19:50:50 -07:00
Lianmin Zheng 5daa1352ba [CI] tests: Retire test/srt and reject legacy test paths (#42567) 2026-10-22 19:15:55 -07:00
Khoa PhamandClaude Opus 5.5 e5dc0c363a [Perf] dsv41: Integrate DeepGEMM MegaGate routing (#43262)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-22 19:08:39 -07:00
YAMYandOasis-Git c82f7141ad [Perf] [NVIDIA] dspark: Move the host work between DSv4.1 decode graphs into the graphs for the megakernel path (#45450)
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
2026-10-22 19:08:06 -07:00
metamergebotandJialin 94e4611eac [Refactor] unified-cache: Factor match validators and match completion into helpers (#45714)
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
2026-10-22 18:58:15 -07:00
Xinyuan Tong 92e57d5de7 [Perf] request_logger: skip per-token watermark redaction walk (#44692) 2026-10-22 18:57:19 -07:00
26396bf566 [Fix] [NVIDIA] deepseek-v4.1: Fix the breakable prefill CUDA graph in the late-layer tail on SM90 (#45407)
Co-authored-by: JohnZhao01 <325926370+JohnZhao01@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-10-22 17:57:16 -07:00
Liangsheng Yin 9c7dd3c45f [Perf] dsv4: Dequantize each shared sparse-prefill KV source once per forward (#45909) 2026-10-22 17:08:40 -07:00
Liangsheng Yin ae4258715c [Perf] dsv4: Keep V4.1 image rows inside the Engram gate kernel (#45904) 2026-10-22 17:05:01 -07:00
HEJIAN SANGandClaude Opus 5.5 77f90ade97 [Fix] weight_checker: Make the checksum device-agnostic (#45918)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 16:57:49 -07:00
bb9e9d5632 [Perf] mlp: Fuse dense SwiGLU with block-FP8 quantization on decode (#45219)
Co-authored-by: Jayden Yu <jaydenyu@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-23 07:49:39 +08:00
3b0003dac1 [Fix] HiCache: stale host KV from write-through copies racing the in-flight forward (#42701)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2026-10-22 14:46:51 -07:00
Liangsheng Yin 840a6313c9 [Perf] dsv4: Score the V4.1 index logits in bf16 on SM100 (#45880) 2026-10-22 14:29:08 -07:00
25ad569ff9 [Feat] speculative: Seed rejection-sampling draft proposals for deterministic inference (#33395)
Co-authored-by: Ajit Mistry <ajmistry@nvidia.com>
Co-authored-by: Ajit Mistry <ajmistry@amistry.nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
2026-10-22 14:04:32 -07:00
AlexandJimmy Shong e5db41b329 [Fix] nemotron_vl: Pad visual spans using processor offsets (#44581)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
2026-10-22 13:58:47 -07:00
786cdfc040 [Fix] nccl: Disable graph buffer registration whenever a captured graph can hold a collective (#43216)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
2026-10-22 13:56:19 -07:00
Yanbin Jiang 13999673ef [Feat] lora: Add plan-driven dense and MoE LoRA engines (#45892) 2026-10-22 13:40:56 -07:00
Shunkangz 154e29c1ec [Perf] CP: QSA Context Parallel Optimization (#43792) 2026-10-22 13:33:04 -07:00
aae2145eb2 [Feat] radix-tree: Report the last visited node and a shorter FULL device match in match results (#45703)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
2026-10-22 13:11:33 -07:00
Liangsheng Yin 4f96807ea8 [CI] radix-cache: Build unified radix cache test states through production paths (#45334) 2026-10-22 13:04:23 -07:00
YAMY d67d1ae02c [Fix] logits: Preserve lm_head precision with shared buffers (#45855) 2026-10-22 12:46:27 -07:00
Zhangheng 913e91ed51 [Fix] CI: add missing entry point to Muse Spark router test (#45845) 2026-10-23 00:45:41 +08:00
Aarne Talman c80285ca9a [Fix] [AMD] deterministic: Refuse RCCL all-reduce in deterministic mode above TP2 (#43809)
Signed-off-by: Aarne Talman <aarne.talman@amd.com>
2026-10-22 09:31:25 -07:00
ShunkangzandClaude Opus 5.5 cc811ff0c3 [Feat] KVShard: Add attention and indexer support for page-sharded DSA caches (#44280)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 00:16:35 +08:00
Shuwen Wang 8cd3c494a3 [Fix] mem_cache: Skip linker L3 lookup on PD decode (#45538) 2026-10-22 22:36:32 +08:00
trebladev 698fa949ec [Perf] diffusion: fuse FLUX3 SwiGLU with rowwise FP8 quantization (#42758) 2026-10-22 21:17:56 +08:00
gjsheu a9902f47e3 [Fix] [NPU] qwen: adapt pcp-v2 (#41564) 2026-10-22 20:54:11 +08:00
Song Bianandkernel-design-agents 851419717a [Perf] [KDA] muse_spark: Run the one-token router GEMV on CuTe DSL (#45508)
Co-authored-by: kernel-design-agents <kernel-design-agents@users.noreply.github.com>
2026-10-22 20:49:29 +08:00
MonishverandXiaoyu Zhang 178febef5d [Perf] qknorm: run head_dim-128 rows two per warp with 16B lanes, bit-identical (#45214)
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-22 20:34:16 +08:00
81841d6bdc [Fix] hicache: Fail fast on a null pointer from the Mooncake host allocator (#40565)
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
2026-10-22 20:12:25 +08:00
Jzz1943 8a6770d566 [Fix] NIXL: Preserve explicit UCX network device selection (#45722) 2026-10-22 20:07:27 +08:00
ashwini rathi 5c2cb60790 [Fix] [Intel] diffusion: Restore copy offload for FLUX.2-dev nightly (#45725) 2026-10-22 16:24:41 +08:00
Michael 0a87f163dc [Test] [AMD] deepseek-v4.1: Fix the HIP breakable-graph unit tests for the default prefill context limit and the DSpark draft ring (#45507) 2026-10-22 01:14:14 -07:00
kangwangamd 1c967f5043 [Fix] [AMD] test: Recalibrate MiniMax-M2.7 GSM8K threshold 0.93->0.91 for MI300 runners (#34241) 2026-10-22 01:08:54 -07:00
jacky.cheng b5137693a5 [Fix] [AMD] diffusion: Enable --quantization fp8 on gfx1250 (torch.compile lowering + per-channel weight scales) (#45304) 2026-10-22 01:05:36 -07:00
WenhaoZhangandMick Qian 24e45961c6 [Perf] diffusion: fuse QKV norm + RoPE, cached RoPE tables for FLUX 3 video VAE (#41894)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 15:44:54 +08:00
f68e82e7bc [Fix] epd: Accept tokens-in requests on scheduler-side transfer backends (#41376)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 14:45:38 +08:00
Shangming Cai 9569a36561 [Feat] scheduler: Gate --prefill-decode-interval on running batch size (#44001) 2026-10-22 14:30:12 +08:00
Richard Wang ce66b3ab59 [Feat] systemone: serve Kev pointer head decision models (#45413) 2026-10-22 14:16:52 +08:00
Shangming Cai a6a6beffac [Refactor] disaggregation: Share the flag all-reduce and host-destination predicate in the decode transfer queue (#45641) 2026-10-22 13:42:55 +08:00
ApeiriaandRain Jiang 8d7df07a56 [Feat] rust-server: Add HiCache storage management endpoints (#44726)
Signed-off-by: 0130w <1157374677@qq.com>
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
2026-10-22 04:01:35 +00:00
Khoa Pham f1e26dc658 [Perf] logits: Write lm_head logits straight into the fp32 logits buffer (#45631) 2026-10-21 20:32:16 -07:00
Shuwen Wang 6929afb528 [Fix] hisparse: Keep PD destination host pages until the decode KV release (#45108) 2026-10-22 11:19:21 +08:00
8dc7f98005 [Perf] pd: Send prefill KV chunks without a host sync on the scheduler thread (#45492)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
2026-10-21 20:11:16 -07:00