Commit Graph
14585 Commits
Author SHA1 Message Date
4f47c48b33 [Fix] diffusion: Keep the N-rank IPC all-to-all's flags and staging out of expandable segments (#45948)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 15:31:19 +08:00
1cd0ebb3d3 [Perf] diffusion: Remove per-step and per-request host syncs in Cosmos3 and Qwen-Image-2.1 (#45967)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 15:30:09 +08:00
Avaya Aggarwal 4da6f585f3 [Fix] diffusion: OpenAI API hardening (#43585) 2026-10-23 15:22:00 +08:00
ShunkangzandZhangheng 79ab8f6d7c [Feat] KVShard: Support kv cache sharding for MTP (#40929)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-10-23 15:20:19 +08:00
Banruo LiuandClaude Opus 5.5 6e667c4310 [Fix] disaggregation: Poison the deferred abort ack when a NIXL or Mori write fails (#45973)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 14:47:59 +08:00
Liangsheng Yin 6c844eb12e [Perf] dsv4: Replay the V4.1 prefill graph past 16K contexts on SM90 (#45941) 2026-10-22 23:47:17 -07:00
Chetan Kumar VermaandClaude Opus 5.5 76c382e80f [Perf] [XPU] diffusion: Use the AOT SYCL fused residual-norm-scale-shift kernel (#41401)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-23 14:32:25 +08:00
ZiruandNiu Ziru 904691e0b5 [Feat] [CPU] model: Support Cosmos3 series models on CPU (#45478)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
2026-10-23 14:24:28 +08:00
vikram singh shekhawat 3f36fc0833 [Fix] [XPU] runtime: Fix XPU rotary embeddings and tokenizer padding (#41213) 2026-10-23 14:09:59 +08:00
Liangsheng Yin 0e338777b0 [Perf] dsv4: Let the fused MXFP8 producers run inside the breakable prefill graph (#45980) 2026-10-22 23:00:10 -07:00
Pinjie Xu 7c680a0d45 [Perf] diffusion/cosmos3: optimize v2v preprocess performance (#45398)
Signed-off-by: pinjie <pinjiex@nvidia.com>
2026-10-23 13:57:38 +08:00
Khoa Pham c7994e7076 [Fix] dsv41: Keep MegaGate out of prefill graphs by gating on the forward mode (#45969) 2026-10-22 22:11:18 -07:00
Khoa Phamandhnyls2002 5bdbec0d48 [Perf] dsv41: Drop the MegaGate padded-row copy on sgl-deep-gemm 0.2.3.post2 (#45933)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-10-22 22:10:57 -07:00
e83f585ae6 [Perf] dsv41: Serve token-interleaved V4.1 KV caches with sgl-flash-mla (#45893)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 22:02:49 -07:00
Liangsheng Yin 49933325cc [Perf] dspark: Combine the draft's mHC streams from bf16 without an fp32 copy (#45964) 2026-10-22 21:44:01 -07:00
Mick f4a2df3dac [CI] diffusion: Calibrate single-GPU shard scheduling from CI (#45831) 2026-10-23 12:03:24 +08:00
Avaya Aggarwalandniehen6174 fa628c5359 [Fix] comfyui: Fix GGUF detection, import guard and VRAM accounting in SGLDiffusion plugin (#43536)
Co-authored-by: niehen6174 <1639206518@qq.com>
2026-10-23 11:58:23 +08:00
Wookje Han f2873f1613 [Perf] [NVIDIA] muse-spark-open: Fuse pre-expert RMSNorm with static-scale NVFP4 quantization (#44554) 2026-10-22 20:00:37 -07:00
Baizhou Zhang 698651acd0 [Feat] HiCache: Support fused DFLASH KV in unified hybrid SWA pools (#45700) 2026-10-22 20:00:28 -07:00
Liangsheng Yin a4838160b3 [Perf] dsv4: Write V4.1 K rows with one warp per token in the fused k-norm-rope store (#45934) 2026-10-22 19:50:50 -07:00
Liangsheng Yin c4fa35b829 [Perf] dsv4: Map V4.1 prefill index selections to pool slots in one kernel (#45938) 2026-10-22 19:50:31 -07:00
Liangsheng Yin 2da6c0c237 [Perf] dsv4: Combine the final mHC streams from bf16 without an fp32 copy (#45940) 2026-10-22 19:43:46 -07:00
MickandMick Qian 363e6c6b4d [Feat] diffusion/disaggregation: split FLUX.3 prompt and image encoders (#45309)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-23 10:35:41 +08:00
Khoa PhamandClaude Opus 5.5 e5dc0c363a [Perf] dsv41: Integrate DeepGEMM MegaGate routing (#43262)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-22 19:08:39 -07:00
YAMYandOasis-Git c82f7141ad [Perf] [NVIDIA] dspark: Move the host work between DSv4.1 decode graphs into the graphs for the megakernel path (#45450)
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
2026-10-22 19:08:06 -07:00
metamergebotandJialin 94e4611eac [Refactor] unified-cache: Factor match validators and match completion into helpers (#45714)
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
2026-10-22 18:58:15 -07:00
Xinyuan Tong 92e57d5de7 [Perf] request_logger: skip per-token watermark redaction walk (#44692) 2026-10-22 18:57:19 -07:00
Liangsheng Yin b588aa39e9 [Perf] dsv4: Optionally stage V4.1 engram rows from the shared host table on the scheduler (#45921) 2026-10-22 18:35:55 -07:00
26396bf566 [Fix] [NVIDIA] deepseek-v4.1: Fix the breakable prefill CUDA graph in the late-layer tail on SM90 (#45407)
Co-authored-by: JohnZhao01 <325926370+JohnZhao01@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-10-22 17:57:16 -07:00
Liangsheng Yin 97b79f0796 [Fix] prefill-graph: Keep every DP rank eager when the replay tail captures behind rank barriers (#45881) 2026-10-22 17:36:00 -07:00
Liangsheng Yin 9c7dd3c45f [Perf] dsv4: Dequantize each shared sparse-prefill KV source once per forward (#45909) 2026-10-22 17:08:40 -07:00
Liangsheng Yin ae4258715c [Perf] dsv4: Keep V4.1 image rows inside the Engram gate kernel (#45904) 2026-10-22 17:05:01 -07:00
HEJIAN SANGandClaude Opus 5.5 77f90ade97 [Fix] weight_checker: Make the checksum device-agnostic (#45918)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 16:57:49 -07:00
bb9e9d5632 [Perf] mlp: Fuse dense SwiGLU with block-FP8 quantization on decode (#45219)
Co-authored-by: Jayden Yu <jaydenyu@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-23 07:49:39 +08:00
Chunan ZengandClaude Opus 5.5 5849ff5337 [Fix] [NVIDIA] jit: Build sm_100f on CC 10.7 until the bundled CUTLASS supports SM107 (#45911)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 16:42:00 -07:00
Michael 035ed73b9d [Fix] [AMD] kernels: Import the HIP launch helpers from jit.utils.hipcc in smallm_fp8_blockscale_gfx950 (#45676) 2026-10-22 16:19:34 -07:00
Alex Nails c394a90c2b [Perf] gemma4: Capture single-step frozen-KV drafts (#45771) 2026-10-22 15:37:19 -07:00
Liangsheng Yin f9b7225f2e [Perf] dsv4: Use the fused MXFP8 producers in eager prefill (#45903) 2026-10-22 15:29:09 -07:00
Liangsheng Yin 9c0f6d6a61 [Perf] dsv4: Write the MegaAttention output straight into the prefill graph buffer (#45901) 2026-10-22 14:56:08 -07:00
Liangsheng Yin 818d7932d7 [Perf] dsv4: Drop local references that keep residual-stream tensors alive through the prefill step (#45900) 2026-10-22 14:55:49 -07:00
3b0003dac1 [Fix] HiCache: stale host KV from write-through copies racing the in-flight forward (#42701)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2026-10-22 14:46:51 -07:00
Liangsheng Yin 840a6313c9 [Perf] dsv4: Score the V4.1 index logits in bf16 on SM100 (#45880) 2026-10-22 14:29:08 -07:00
25ad569ff9 [Feat] speculative: Seed rejection-sampling draft proposals for deterministic inference (#33395)
Co-authored-by: Ajit Mistry <ajmistry@nvidia.com>
Co-authored-by: Ajit Mistry <ajmistry@amistry.nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
2026-10-22 14:04:32 -07:00
AlexandJimmy Shong e5db41b329 [Fix] nemotron_vl: Pad visual spans using processor offsets (#44581)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
2026-10-22 13:58:47 -07:00
786cdfc040 [Fix] nccl: Disable graph buffer registration whenever a captured graph can hold a collective (#43216)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
2026-10-22 13:56:19 -07:00
Yanbin Jiang 13999673ef [Feat] lora: Add plan-driven dense and MoE LoRA engines (#45892) 2026-10-22 13:40:56 -07:00
Shunkangz 154e29c1ec [Perf] CP: QSA Context Parallel Optimization (#43792) 2026-10-22 13:33:04 -07:00
Liangsheng Yin ba83415eea [Perf] engram: Read host-table rows in address order on GPUs without host page tables (#45879) 2026-10-22 13:13:43 -07:00
bf0e193bfd [Refactor] radix-tree: Move insert overlap handling into a resumable OVERLAP phase (#45702)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
2026-10-22 13:12:37 -07:00
aae2145eb2 [Feat] radix-tree: Report the last visited node and a shorter FULL device match in match results (#45703)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
2026-10-22 13:11:33 -07:00