Commit Graph
20763 Commits
Author SHA1 Message Date
Avaya Aggarwal efd2ce8a9d [Feat] comfyui: video-to-video input and prompt enhancement for server-mode nodes (#43673) 2026-10-23 23:09:30 +08:00
c677171c1d [Feat] hicache: Support MLA DCP with HiCache L3(file/mooncake) (#41187)
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Venkat Raman <venkat.raman@verda.com>
2026-10-23 23:09:04 +08:00
02b983603d [Fix] diffusion: Keep dynamic LoRA deltas on fused linear-GELU sites (#45943)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 21:19:53 +08:00
0e34962884 [Perf] diffusion: Cut LTX-2 denoising-step host overhead (#45966)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 21:18:57 +08:00
82ff16dad0 [Perf] diffusion: Skip the residency calibration probe in auto mode until a planner consumes it (#45979)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 21:18:06 +08:00
3e5f5505ed [Perf] diffusion: Serve image responses from in-memory encoded bytes (#45987)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 21:16:44 +08:00
2fbd094a8c [Fix] diffusion: Offset LTX-2.3 BCG video RoPE by the SP shard start (#45995)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 21:14:37 +08:00
pllimax 9b46f27090 [Fix] [NPU] tests: Restore evalscope GSM8K baseline via NPUGSM8KMixin backend (#45732) 2026-10-23 21:06:21 +08:00
shun8686 2a46e32fbc [CI] [NPU] precise-test: skip recommend-tests-from-coverage when no NPU paths changed (#46055) 2026-10-23 21:01:42 +08:00
86933b1f33 [Fix] deps: Pin python-dateutil<3 to keep botocore resolvable (#45857)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
2026-10-23 20:57:44 +08:00
shun8686 0347b2bb4e [CI] [NPU] precise-test: gate precision on PR judgeability, not bucket count (#46042) 2026-10-23 20:41:22 +08:00
Jimmy Shong 4b1941e889 [CI] diffusion: Run the FLUX.2 XPU norm-fusion test on the XPU suite only (#46040) 2026-10-23 19:54:03 +08:00
chuyehandCursor f967418a35 [Doc] cookbook: Qwen3.5 MI355X FP8 agentic adds scheduler/tokenizer tuning from the InferenceX recipe (#46032)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-23 19:12:05 +08:00
shun8686 535aeae2a7 [CI] [NPU] precise-test: run only the recommended multimodal_gen cases (#46014) 2026-10-23 18:06:58 +08:00
chuyehandCursor 69f830756e [Doc] cookbook: Qwen3.5 MI355X FP8 agentic uses HiCache write_through on the v0.5.22 image (#46017)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-23 17:47:52 +08:00
Sage 611a703061 [Chore] api: add fields to generate request (#45164)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-10-23 17:10:23 +08:00
494eeecb6c [Fix] diffusion: Keep the linear-GELU verdict cache out of torch.compile traces (#45944)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 17:01:51 +08:00
f9129915a3 [Fix] diffusion: Give every SP rank the same Wan TI2V timestep (#45994)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 17:00:40 +08:00
Xinyuan Tong 8b9f72417f [Feat] Inkling: render and parse chat via tml-renderers (#45340) 2026-10-23 16:43:38 +08:00
Michael bb72b47daf [Test] [AMD] deepseek-v4.1: Give the encoder-replay test's request window a zero_row (#45728) 2026-10-23 01:38:54 -07:00
Shuwen Wang 77bc8cab18 [Fix] hicache/pd: Promise prefill only the L3 span the decode prefetch takes (#43548) 2026-10-23 16:32:41 +08:00
Michael 7d1a16d3eb [CI] [AMD] diffusion: Skip the LTX-2.5 diffusion decoder case on the 2-GPU lane (#45861) 2026-10-23 01:28:12 -07:00
2b8e4cde95 [Doc] [CPU] Cookbook: Update to the cookbook for models supported by Intel Xeon CPUs (#40092)
Co-authored-by: Niu Ziru <niuziru@a4bf018d3341.jf.intel.com>
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
2026-10-23 16:22:50 +08:00
Avaya Aggarwal 4b273537de [Fix] diffusion: runtime utils bug fixes (#44887) 2026-10-23 16:08:13 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 02d2445138 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with seven open InferenceX PRs (#46005)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 16:04:01 +08:00
shun8686 472208fec0 [CI] [NPU] precise-test: recommend multimodal_gen cases at test-case granularity (#45955) 2026-10-23 15:57:31 +08:00
Yao MatrixandAlex Nails 6d6c9cd4ae [Fix] offloader: Preserve cached weights during CPU offload (#44139)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-10-23 00:50:24 -07:00
Yihao WangandClaude Opus 5 6f466f655a [Perf] [XPU] diffusion/flux2: Fuse bit-exact LayerNorm and gated residual norm (#41942)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-10-23 15:38:12 +08:00
8708d2ee99 [Fix] diffusion/ltx: Keep tiled VAE decode off the sharded convs under parallel decode (#45942)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 15:32:03 +08:00
4f47c48b33 [Fix] diffusion: Keep the N-rank IPC all-to-all's flags and staging out of expandable segments (#45948)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 15:31:19 +08:00
1cd0ebb3d3 [Perf] diffusion: Remove per-step and per-request host syncs in Cosmos3 and Qwen-Image-2.1 (#45967)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 15:30:09 +08:00
Avaya Aggarwal 4da6f585f3 [Fix] diffusion: OpenAI API hardening (#43585) 2026-10-23 15:22:00 +08:00
ShunkangzandZhangheng 79ab8f6d7c [Feat] KVShard: Support kv cache sharding for MTP (#40929)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-10-23 15:20:19 +08:00
Banruo LiuandClaude Opus 5.5 6e667c4310 [Fix] disaggregation: Poison the deferred abort ack when a NIXL or Mori write fails (#45973)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 14:47:59 +08:00
Liangsheng Yin 6c844eb12e [Perf] dsv4: Replay the V4.1 prefill graph past 16K contexts on SM90 (#45941) 2026-10-22 23:47:17 -07:00
ashwini rathi 6dd0dfabf0 [CI] [Intel] docker/xpu: Tag nightly images with main-whl and main-main kernel variant (#45854) 2026-10-23 14:44:55 +08:00
Jimmy Shong 2be6577ba9 [Doc] beam: Offer Python and Docker commands in the cookbook (#45991) 2026-10-22 23:39:10 -07:00
Chetan Kumar VermaandClaude Opus 5.5 76c382e80f [Perf] [XPU] diffusion: Use the AOT SYCL fused residual-norm-scale-shift kernel (#41401)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-23 14:32:25 +08:00
ZiruandNiu Ziru 904691e0b5 [Feat] [CPU] model: Support Cosmos3 series models on CPU (#45478)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
2026-10-23 14:24:28 +08:00
vikram singh shekhawat 3f36fc0833 [Fix] [XPU] runtime: Fix XPU rotary embeddings and tokenizer padding (#41213) 2026-10-23 14:09:59 +08:00
Liangsheng Yin 0e338777b0 [Perf] dsv4: Let the fused MXFP8 producers run inside the breakable prefill graph (#45980) 2026-10-22 23:00:10 -07:00
Pinjie Xu 7c680a0d45 [Perf] diffusion/cosmos3: optimize v2v preprocess performance (#45398)
Signed-off-by: pinjie <pinjiex@nvidia.com>
2026-10-23 13:57:38 +08:00
Michael 7baacd1d1b [CI] [AMD] docker: Add a build-only dispatch option to the ROCm nightly image workflows (#45882) 2026-10-23 13:41:02 +08:00
Khoa Pham c7994e7076 [Fix] dsv41: Keep MegaGate out of prefill graphs by gating on the forward mode (#45969) 2026-10-22 22:11:18 -07:00
Khoa Phamandhnyls2002 5bdbec0d48 [Perf] dsv41: Drop the MegaGate padded-row copy on sgl-deep-gemm 0.2.3.post2 (#45933)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-10-22 22:10:57 -07:00
e83f585ae6 [Perf] dsv41: Serve token-interleaved V4.1 KV caches with sgl-flash-mla (#45893)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 22:02:49 -07:00
Liangsheng Yin 49933325cc [Perf] dspark: Combine the draft's mHC streams from bf16 without an fp32 copy (#45964) 2026-10-22 21:44:01 -07:00
Mick f4a2df3dac [CI] diffusion: Calibrate single-GPU shard scheduling from CI (#45831) 2026-10-23 12:03:24 +08:00
Avaya Aggarwalandniehen6174 fa628c5359 [Fix] comfyui: Fix GGUF detection, import guard and VRAM accounting in SGLDiffusion plugin (#43536)
Co-authored-by: niehen6174 <1639206518@qq.com>
2026-10-23 11:58:23 +08:00
em-dreyerandClaude Opus 5.5 79eb10e182 [CI] [NVIDIA] gb300: Restore the aarch64 rust-ext cache on ARM runners (#45920)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 20:01:42 -07:00