 Yihao WangandClaude Opus 5
|
5bef70c0a2
|
[Perf] flux2: Build the single-block output projection without a cat (#41943)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-24 09:33:26 +08:00 |
|
 MickandMick Qian
|
1d4dcc81cc
|
[Perf] diffusion/registry: Reduce model discovery work at startup (#46043)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-24 09:30:04 +08:00 |
|
 
|
47c0791ad1
|
[Perf] diffusion: Write uncompressed PNG responses without Pillow's row filters (#46099)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:28:55 +08:00 |
|
 
|
bbc77e7db4
|
[Perf] diffusion: Cut LTX-2.3 per-block elementwise work (contiguous AdaLN values, gate-folded masks, vectorized head gate) (#46110)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:27:39 +08:00 |
|
 
|
4e2d5b17ad
|
[Perf] diffusion: Keep every component resident in auto mode when memory allows (#45978)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:26:13 +08:00 |
|
 
|
be8600d02d
|
[Fix] diffusion: Step MOVA latents outside the serial-CFG branch (#45993)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:23:54 +08:00 |
|
 
|
a08bb0ec9e
|
[Perf] diffusion: Run LTX-2 stage 2 on a premerged resident DiT (#46108)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:23:08 +08:00 |
|
 
|
e66c9e981d
|
[Perf] diffusion: Turn on breakable CUDA graphs by default for LTX-2/LTX-2.3 two-stage serving (#45977)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:22:06 +08:00 |
|
 
|
2e6d87e2ca
|
[Perf] diffusion: Serve FA4 head sizes on Blackwell instead of falling back to sm80 SDPA (#46102)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:20:32 +08:00 |
|
 
|
386fa9ecfd
|
[Perf] diffusion: Drop LTX-2's all-valid prompt mask under lossless quality (#46106)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:19:12 +08:00 |
|
 
|
5b8955e70f
|
[Perf] diffusion: Shard LTX-2 stage 2 over the CFG ranks as Ulysses (#45965)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:17:41 +08:00 |
|
 
|
738e4535ea
|
[Perf] diffusion/qwen-image-2.1: Keep an image prefix's K/V in the packed buffer across steps (#46101)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:14:10 +08:00 |
|
 
|
3712b5944d
|
[Perf] diffusion: Patchify Wan latents straight into tokens (#46148)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:12:49 +08:00 |
|
 MickandMick Qian
|
2d5ad3243f
|
[Fix] diffusion/http: Allow bounded graceful shutdown (#46169)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-24 09:11:15 +08:00 |
|
 Jackey Huaandhnyls2002
|
e22a530859
|
[Feat] openai: Render DeepSeek-V4/V4.1 chat prompts with deepseek-recipe (#45315)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-23 18:05:35 -07:00 |
|
 Khoa PhamandClaude Fable 5.1
|
ee2dd727a3
|
[Perf] dsv41: Let Mega-mHC write the MegaMoE input under MegaGate (#46163)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-23 17:54:03 -07:00 |
|
Liangsheng Yin
|
79e5c4bb9b
|
[Perf] dsv41: Trim per-step DSpark decode overhead (#46176)
|
2026-10-23 17:24:06 -07:00 |
|
Qiaolin Yu
|
5994c5597d
|
[Perf] spec-decoding: fuse simulated speculative acceptance tensor preparation (#41169)
|
2026-10-23 17:15:21 -07:00 |
|
 Baizhou Zhangandsid-rp
|
6a319e7b34
|
[Fix] muse: Support Responses namespace tools and defer_loading (#44685)
Co-authored-by: sid-rp <sidrp@meta.com>
|
2026-10-23 16:48:08 -07:00 |
|
 
|
0d592c475b
|
[Fix] rust-server: Keep a transfer backend's own bootstrap port on prefill (#46066)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-23 16:47:14 -07:00 |
|
Cheng Wan
|
855c092deb
|
[Fix] inkling: Keep BF16 LM-head operands with FP32 output (#45335)
|
2026-10-23 15:51:44 -07:00 |
|
Liangsheng Yin
|
f05ad5ec01
|
[Perf] logits: Cast bf16 logits into the fp32 buffer with a Triton kernel (#46167)
|
2026-10-23 15:06:09 -07:00 |
|
 Rohan VarmaandJun Wan
|
15dc838f9b
|
[Fix] http_server: Apply SGLANG_TIMEOUT_KEEP_ALIVE to Granian HTTP/1.1 connections (#45760)
Signed-off-by: Rohan Varma <rohanv@nvidia.com>
Co-authored-by: Jun Wan <8323392+junwan01@users.noreply.github.com>
|
2026-10-23 14:43:54 -07:00 |
|
Baizhou Zhang
|
ea226cf782
|
[Feat] glm5.3flash: Support padded CP BCG and prefix replay with PD/DFlash2 (#43774)
|
2026-10-23 14:21:31 -07:00 |
|
 Yuhao YangandClaude Opus 5.5
|
5f7542d762
|
[Perf] dsv41: Build the MegaGate row masks once per forward (#46071)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-23 14:15:01 -07:00 |
|
  
|
27ac614f05
|
[Feat] parser: Add checkpoint-driven response-template adapters (#40479)
Signed-off-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-23 14:05:54 -07:00 |
|
em-dreyer
|
4542fc8f59
|
[Fix] mistral3: Subclass LlavaForConditionalGeneration instead of wrapping it (#45656)
|
2026-10-23 14:05:32 -07:00 |
|
Michael
|
194abb8e54
|
[CI] [AMD] diffusion: Drain the Cosmos Dreams decode stream after freeing its outputs (#45983)
|
2026-10-23 13:26:56 -07:00 |
|
Cheng Wan
|
d0022e1df3
|
[Fix] lora: Preserve MoE projection identity and routing lifetimes (#45681)
|
2026-10-23 12:32:55 -07:00 |
|
Cheng Wan
|
ac3db731b3
|
[Fix] moe: Preserve CUTLASS routing metadata and execution budgets (#45917)
|
2026-10-23 12:32:05 -07:00 |
|
Cheng Wan
|
8b9b992e41
|
[Perf] moe: Preserve Marlin workspace and route-count budgets (#45462)
|
2026-10-23 12:31:17 -07:00 |
|
 
|
0931dfedc9
|
[Fix] [AMD] dsa: Fix AITER prefill with an FP8 KV cache (#39083)
Co-authored-by: Pawel Kowalski <pawel.kowalski@silo.ai>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-10-23 12:30:42 -07:00 |
|
Cheng Wan
|
e6451c1a95
|
[Fix] gguf: Preserve MoE routing, weighting and allocation budgets (#45916)
|
2026-10-23 12:29:51 -07:00 |
|
Cheng Wan
|
1340044e97
|
[Fix] deepseek-v4: Preserve decoder-tail token-count ownership (#45915)
|
2026-10-23 12:28:43 -07:00 |
|
   
|
9d7ad308bd
|
[Fix] [AMD] Quark: fix Quark block-FP8 loading in DeepSeek loader (#40776)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
|
2026-10-23 12:11:21 -07:00 |
|
 Alex NailsandClaude Opus 5.5
|
baf80c61b7
|
[Feat] platforms: Let out-of-tree platforms bind group devices and custom ops (#45897)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 12:02:42 -07:00 |
|
 Peng WuandClaude Opus 5.5
|
16aa816060
|
[Fix] disaggregation: Restart a lost prefill's heartbeat miss count (#45922)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 01:26:10 +08:00 |
|
 
|
30dc2f9430
|
[Feat] benchmark: Add --input-len-list to bench_one_batch_server for per-request input lengths (#45982)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: wpc <wpc@users.noreply.github.com>
|
2026-10-23 09:04:59 -07:00 |
|
 
|
5a86d6ee17
|
[Fix] rust-server: Deliver scheduler-side aborts to Rust frontend clients (#45899)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-23 09:04:54 -07:00 |
|
Avaya Aggarwal
|
efd2ce8a9d
|
[Feat] comfyui: video-to-video input and prompt enhancement for server-mode nodes (#43673)
|
2026-10-23 23:09:30 +08:00 |
|
   
|
c677171c1d
|
[Feat] hicache: Support MLA DCP with HiCache L3(file/mooncake) (#41187)
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Venkat Raman <venkat.raman@verda.com>
|
2026-10-23 23:09:04 +08:00 |
|
 
|
02b983603d
|
[Fix] diffusion: Keep dynamic LoRA deltas on fused linear-GELU sites (#45943)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:19:53 +08:00 |
|
 
|
0e34962884
|
[Perf] diffusion: Cut LTX-2 denoising-step host overhead (#45966)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:18:57 +08:00 |
|
 
|
82ff16dad0
|
[Perf] diffusion: Skip the residency calibration probe in auto mode until a planner consumes it (#45979)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:18:06 +08:00 |
|
 
|
3e5f5505ed
|
[Perf] diffusion: Serve image responses from in-memory encoded bytes (#45987)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:16:44 +08:00 |
|
 
|
2fbd094a8c
|
[Fix] diffusion: Offset LTX-2.3 BCG video RoPE by the SP shard start (#45995)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:14:37 +08:00 |
|
pllimax
|
9b46f27090
|
[Fix] [NPU] tests: Restore evalscope GSM8K baseline via NPUGSM8KMixin backend (#45732)
|
2026-10-23 21:06:21 +08:00 |
|
 
|
86933b1f33
|
[Fix] deps: Pin python-dateutil<3 to keep botocore resolvable (#45857)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
|
2026-10-23 20:57:44 +08:00 |
|
Sage
|
611a703061
|
[Chore] api: add fields to generate request (#45164)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-23 17:10:23 +08:00 |
|
 
|
494eeecb6c
|
[Fix] diffusion: Keep the linear-GELU verdict cache out of torch.compile traces (#45944)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 17:01:51 +08:00 |
|