Commit Graph
14550 Commits
Author SHA1 Message Date
Michael 035ed73b9d [Fix] [AMD] kernels: Import the HIP launch helpers from jit.utils.hipcc in smallm_fp8_blockscale_gfx950 (#45676) 2026-10-22 16:19:34 -07:00
Alex Nails c394a90c2b [Perf] gemma4: Capture single-step frozen-KV drafts (#45771) 2026-10-22 15:37:19 -07:00
Liangsheng Yin f9b7225f2e [Perf] dsv4: Use the fused MXFP8 producers in eager prefill (#45903) 2026-10-22 15:29:09 -07:00
Liangsheng Yin 9c0f6d6a61 [Perf] dsv4: Write the MegaAttention output straight into the prefill graph buffer (#45901) 2026-10-22 14:56:08 -07:00
Liangsheng Yin 818d7932d7 [Perf] dsv4: Drop local references that keep residual-stream tensors alive through the prefill step (#45900) 2026-10-22 14:55:49 -07:00
3b0003dac1 [Fix] HiCache: stale host KV from write-through copies racing the in-flight forward (#42701)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2026-10-22 14:46:51 -07:00
Liangsheng Yin 840a6313c9 [Perf] dsv4: Score the V4.1 index logits in bf16 on SM100 (#45880) 2026-10-22 14:29:08 -07:00
25ad569ff9 [Feat] speculative: Seed rejection-sampling draft proposals for deterministic inference (#33395)
Co-authored-by: Ajit Mistry <ajmistry@nvidia.com>
Co-authored-by: Ajit Mistry <ajmistry@amistry.nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
2026-10-22 14:04:32 -07:00
AlexandJimmy Shong e5db41b329 [Fix] nemotron_vl: Pad visual spans using processor offsets (#44581)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
2026-10-22 13:58:47 -07:00
786cdfc040 [Fix] nccl: Disable graph buffer registration whenever a captured graph can hold a collective (#43216)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
2026-10-22 13:56:19 -07:00
Yanbin Jiang 13999673ef [Feat] lora: Add plan-driven dense and MoE LoRA engines (#45892) 2026-10-22 13:40:56 -07:00
Shunkangz 154e29c1ec [Perf] CP: QSA Context Parallel Optimization (#43792) 2026-10-22 13:33:04 -07:00
Liangsheng Yin ba83415eea [Perf] engram: Read host-table rows in address order on GPUs without host page tables (#45879) 2026-10-22 13:13:43 -07:00
bf0e193bfd [Refactor] radix-tree: Move insert overlap handling into a resumable OVERLAP phase (#45702)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
2026-10-22 13:12:37 -07:00
aae2145eb2 [Feat] radix-tree: Report the last visited node and a shorter FULL device match in match results (#45703)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
2026-10-22 13:11:33 -07:00
357323e912 [Refactor] hicache: Route buffer-mode backup admission keys and FULL transfers through pipeline hooks (#45701)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
2026-10-22 13:10:18 -07:00
Liangsheng Yin 4f96807ea8 [CI] radix-cache: Build unified radix cache test states through production paths (#45334) 2026-10-22 13:04:23 -07:00
YAMY d67d1ae02c [Fix] logits: Preserve lm_head precision with shared buffers (#45855) 2026-10-22 12:46:27 -07:00
Liangsheng Yin 0d6b283d7e [Refactor] dsv4: Keep only the two-level V4.1 indexer in the prefill graph (#45783) 2026-10-22 12:26:43 -07:00
Aarne Talman c80285ca9a [Fix] [AMD] deterministic: Refuse RCCL all-reduce in deterministic mode above TP2 (#43809)
Signed-off-by: Aarne Talman <aarne.talman@amd.com>
2026-10-22 09:31:25 -07:00
ShunkangzandClaude Opus 5.5 cc811ff0c3 [Feat] KVShard: Add attention and indexer support for page-sharded DSA caches (#44280)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 00:16:35 +08:00
Shuwen Wang 8cd3c494a3 [Fix] mem_cache: Skip linker L3 lookup on PD decode (#45538) 2026-10-22 22:36:32 +08:00
Wenbo Ji 嵇文博 afd0d7b47b [Fix] diffusion/flux: use true_cfg_scale as the FLUX CFG weight (#44260) 2026-10-22 21:30:45 +08:00
Mick 0f7d3a0451 [CI] diffusion: target thirty-minute CI shards (#45761) 2026-10-22 21:19:42 +08:00
SunandMick dcf05724f7 [Perf] diffusion: accumulate chunked LoRA merges with addmm (#37620)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-22 21:18:39 +08:00
trebladev 698fa949ec [Perf] diffusion: fuse FLUX3 SwiGLU with rowwise FP8 quantization (#42758) 2026-10-22 21:17:56 +08:00
Song Bianandkernel-design-agents 635836129b [Perf] [KDA] muse_spark: use BLOCK_M 240 for BF16 MegaMoE prefill shards (#45637)
Co-authored-by: kernel-design-agents <kernel-design-agents@users.noreply.github.com>
2026-10-22 20:57:30 +08:00
gjsheu a9902f47e3 [Fix] [NPU] qwen: adapt pcp-v2 (#41564) 2026-10-22 20:54:11 +08:00
Song Bianandkernel-design-agents 851419717a [Perf] [KDA] muse_spark: Run the one-token router GEMV on CuTe DSL (#45508)
Co-authored-by: kernel-design-agents <kernel-design-agents@users.noreply.github.com>
2026-10-22 20:49:29 +08:00
Jzz1943 f4ccfd4183 [Perf] moe: Add H200 block-FP8 Triton configurations (#45591) 2026-10-22 20:37:54 +08:00
MonishverandXiaoyu Zhang 178febef5d [Perf] qknorm: run head_dim-128 rows two per warp with 16B lanes, bit-identical (#45214)
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-22 20:34:16 +08:00
81841d6bdc [Fix] hicache: Fail fast on a null pointer from the Mooncake host allocator (#40565)
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
2026-10-22 20:12:25 +08:00
Jzz1943 8a6770d566 [Fix] NIXL: Preserve explicit UCX network device selection (#45722) 2026-10-22 20:07:27 +08:00
Alex NailsandClaude Opus 5.5 d0a7565436 [Fix] diffusion: Drop stale mismatch_msg from FLUX 3 video VAE gate call (#45778)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 01:31:54 -07:00
Liangsheng Yin 3f6c313389 [Fix] diffusion: Restore the kernel registry import after #41894 (#45775) 2026-10-22 01:25:13 -07:00
jacky.cheng b5137693a5 [Fix] [AMD] diffusion: Enable --quantization fp8 on gfx1250 (torch.compile lowering + per-channel weight scales) (#45304) 2026-10-22 01:05:36 -07:00
WenhaoZhangandMick Qian 24e45961c6 [Perf] diffusion: fuse QKV norm + RoPE, cached RoPE tables for FLUX 3 video VAE (#41894)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 15:44:54 +08:00
James XuandCursor c64886f9e3 [Perf] diffusion: fuse Wan VAE DupUp3D shortcut add (#32860)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-22 15:38:51 +08:00
Ankit DhallandAnkit Dhall f727076ed0 [Feat] diffusion: support wan-animate-2 distilled model (#44085)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
2026-10-22 15:37:08 +08:00
Shuwen Wang 9d5386fd13 [Perf] dsv41: Fuse request-window layout construction (#45726) 2026-10-22 00:13:33 -07:00
shun8686 33a0734ca1 [CI] [NPU] precise-test: collect multimodal_gen coverage per test case (#45553) 2026-10-22 15:11:47 +08:00
Baizhou Zhang 779adb4b82 [Perf] cuda-graph: Raise MLA prefill capture default to chunked size capped at 8192 (#45565) 2026-10-21 23:49:25 -07:00
f68e82e7bc [Fix] epd: Accept tokens-in requests on scheduler-side transfer backends (#41376)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 14:45:38 +08:00
Liangsheng Yin 82f7249ce6 [Perf] dsv4: Gather V4.1 index-K slots once per prefill graph replay (#45741) 2026-10-21 23:34:17 -07:00
Shangming Cai 9569a36561 [Feat] scheduler: Gate --prefill-decode-interval on running batch size (#44001) 2026-10-22 14:30:12 +08:00
Richard Wang ce66b3ab59 [Feat] systemone: serve Kev pointer head decision models (#45413) 2026-10-22 14:16:52 +08:00
Shangming Cai a6a6beffac [Refactor] disaggregation: Share the flag all-reduce and host-destination predicate in the decode transfer queue (#45641) 2026-10-22 13:42:55 +08:00
WenhaoZhangandMick d9ce511646 [Feat] diffusion: support FastH3 Omni (Ref2VA 8-step PDD) (#45530)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-22 13:07:13 +08:00
MickandMick Qian 3472e16f96 [Refactor] diffusion: remove the deprecated kitchen_int8 alias (#45706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 13:06:07 +08:00
ApeiriaandRain Jiang 8d7df07a56 [Feat] rust-server: Add HiCache storage management endpoints (#44726)
Signed-off-by: 0130w <1157374677@qq.com>
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
2026-10-22 04:01:35 +00:00