Liangsheng Yin
|
3c6a6c8068
|
[Perf] dsv41: Run MegaGate routing in prefill (#46232)
|
2026-10-23 20:31:50 -07:00 |
|
Liangsheng Yin
|
17d92ea671
|
[Feat] openai: Parse DeepSeek text for the native endpoints through deepseek-recipe (#46219)
|
2026-10-23 20:17:37 -07:00 |
|
 Richard WangandMick Qian
|
7cefa60765
|
[Perf] diffusion: Wait on the socket when the scheduler is idle (#46007)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-24 11:02:24 +08:00 |
|
 
|
25ba24e9a7
|
[Perf] diffusion: Build one LTX-2.3 AdaLN row per sample when every token shares the sigma (#46109)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 11:00:14 +08:00 |
|
 
|
42ac81c655
|
[Perf] diffusion: Route dense attention with a sub-tile side to FA4 on Blackwell (#46107)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 10:59:25 +08:00 |
|
 jambow0320andShangming Cai
|
de7055f596
|
[Refactor] pd: Consolidate sender and receiver implementations (#41140)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-24 10:50:10 +08:00 |
|
jacky.cheng
|
88ac7c02a6
|
[Fix] [AMD] diffusion: Fix the first-step denoise regression from compiling ENABLE_CK=0 BF16 attention (#45838)
|
2026-10-23 19:42:54 -07:00 |
|
 Jackey Huaandhnyls2002
|
a77998e157
|
[Feat] openai: parse DeepSeek output through deepseek-recipe (#45907)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-23 19:23:22 -07:00 |
|
 Liangsheng Yinandkpham-sgl
|
79701a2549
|
[Perf] dsv41: Read Engram rows from peer device shards (#46180)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
|
2026-10-23 19:01:26 -07:00 |
|
 Yihao WangandClaude Opus 5
|
327c906764
|
[Perf] [XPU] diffusion: Avoid QKV copies in flash attention (#41944)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-24 09:33:26 +08:00 |
|
 Yihao WangandClaude Opus 5
|
5bef70c0a2
|
[Perf] flux2: Build the single-block output projection without a cat (#41943)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-24 09:33:26 +08:00 |
|
 MickandMick Qian
|
1d4dcc81cc
|
[Perf] diffusion/registry: Reduce model discovery work at startup (#46043)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-24 09:30:04 +08:00 |
|
 
|
47c0791ad1
|
[Perf] diffusion: Write uncompressed PNG responses without Pillow's row filters (#46099)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:28:55 +08:00 |
|
 
|
bbc77e7db4
|
[Perf] diffusion: Cut LTX-2.3 per-block elementwise work (contiguous AdaLN values, gate-folded masks, vectorized head gate) (#46110)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:27:39 +08:00 |
|
 
|
4e2d5b17ad
|
[Perf] diffusion: Keep every component resident in auto mode when memory allows (#45978)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:26:13 +08:00 |
|
 
|
be8600d02d
|
[Fix] diffusion: Step MOVA latents outside the serial-CFG branch (#45993)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:23:54 +08:00 |
|
 
|
a08bb0ec9e
|
[Perf] diffusion: Run LTX-2 stage 2 on a premerged resident DiT (#46108)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:23:08 +08:00 |
|
 
|
e66c9e981d
|
[Perf] diffusion: Turn on breakable CUDA graphs by default for LTX-2/LTX-2.3 two-stage serving (#45977)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:22:06 +08:00 |
|
 
|
2e6d87e2ca
|
[Perf] diffusion: Serve FA4 head sizes on Blackwell instead of falling back to sm80 SDPA (#46102)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:20:32 +08:00 |
|
 
|
386fa9ecfd
|
[Perf] diffusion: Drop LTX-2's all-valid prompt mask under lossless quality (#46106)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:19:12 +08:00 |
|
 
|
5b8955e70f
|
[Perf] diffusion: Shard LTX-2 stage 2 over the CFG ranks as Ulysses (#45965)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:17:41 +08:00 |
|
 
|
738e4535ea
|
[Perf] diffusion/qwen-image-2.1: Keep an image prefix's K/V in the packed buffer across steps (#46101)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:14:10 +08:00 |
|
 
|
3712b5944d
|
[Perf] diffusion: Patchify Wan latents straight into tokens (#46148)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:12:49 +08:00 |
|
 MickandMick Qian
|
2d5ad3243f
|
[Fix] diffusion/http: Allow bounded graceful shutdown (#46169)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-24 09:11:15 +08:00 |
|
 Jackey Huaandhnyls2002
|
e22a530859
|
[Feat] openai: Render DeepSeek-V4/V4.1 chat prompts with deepseek-recipe (#45315)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-23 18:05:35 -07:00 |
|
 Khoa PhamandClaude Fable 5.1
|
ee2dd727a3
|
[Perf] dsv41: Let Mega-mHC write the MegaMoE input under MegaGate (#46163)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-23 17:54:03 -07:00 |
|
Liangsheng Yin
|
79e5c4bb9b
|
[Perf] dsv41: Trim per-step DSpark decode overhead (#46176)
|
2026-10-23 17:24:06 -07:00 |
|
Qiaolin Yu
|
5994c5597d
|
[Perf] spec-decoding: fuse simulated speculative acceptance tensor preparation (#41169)
|
2026-10-23 17:15:21 -07:00 |
|
 Baizhou Zhangandsid-rp
|
6a319e7b34
|
[Fix] muse: Support Responses namespace tools and defer_loading (#44685)
Co-authored-by: sid-rp <sidrp@meta.com>
|
2026-10-23 16:48:08 -07:00 |
|
 
|
0d592c475b
|
[Fix] rust-server: Keep a transfer backend's own bootstrap port on prefill (#46066)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-23 16:47:14 -07:00 |
|
Cheng Wan
|
855c092deb
|
[Fix] inkling: Keep BF16 LM-head operands with FP32 output (#45335)
|
2026-10-23 15:51:44 -07:00 |
|
Liangsheng Yin
|
f05ad5ec01
|
[Perf] logits: Cast bf16 logits into the fp32 buffer with a Triton kernel (#46167)
|
2026-10-23 15:06:09 -07:00 |
|
 Rohan VarmaandJun Wan
|
15dc838f9b
|
[Fix] http_server: Apply SGLANG_TIMEOUT_KEEP_ALIVE to Granian HTTP/1.1 connections (#45760)
Signed-off-by: Rohan Varma <rohanv@nvidia.com>
Co-authored-by: Jun Wan <8323392+junwan01@users.noreply.github.com>
|
2026-10-23 14:43:54 -07:00 |
|
Baizhou Zhang
|
ea226cf782
|
[Feat] glm5.3flash: Support padded CP BCG and prefix replay with PD/DFlash2 (#43774)
|
2026-10-23 14:21:31 -07:00 |
|
 Yuhao YangandClaude Opus 5.5
|
5f7542d762
|
[Perf] dsv41: Build the MegaGate row masks once per forward (#46071)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-23 14:15:01 -07:00 |
|
  
|
27ac614f05
|
[Feat] parser: Add checkpoint-driven response-template adapters (#40479)
Signed-off-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-23 14:05:54 -07:00 |
|
em-dreyer
|
4542fc8f59
|
[Fix] mistral3: Subclass LlavaForConditionalGeneration instead of wrapping it (#45656)
|
2026-10-23 14:05:32 -07:00 |
|
Michael
|
194abb8e54
|
[CI] [AMD] diffusion: Drain the Cosmos Dreams decode stream after freeing its outputs (#45983)
|
2026-10-23 13:26:56 -07:00 |
|
Cheng Wan
|
d0022e1df3
|
[Fix] lora: Preserve MoE projection identity and routing lifetimes (#45681)
|
2026-10-23 12:32:55 -07:00 |
|
Cheng Wan
|
ac3db731b3
|
[Fix] moe: Preserve CUTLASS routing metadata and execution budgets (#45917)
|
2026-10-23 12:32:05 -07:00 |
|
Cheng Wan
|
8b9b992e41
|
[Perf] moe: Preserve Marlin workspace and route-count budgets (#45462)
|
2026-10-23 12:31:17 -07:00 |
|
 
|
0931dfedc9
|
[Fix] [AMD] dsa: Fix AITER prefill with an FP8 KV cache (#39083)
Co-authored-by: Pawel Kowalski <pawel.kowalski@silo.ai>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-10-23 12:30:42 -07:00 |
|
Cheng Wan
|
e6451c1a95
|
[Fix] gguf: Preserve MoE routing, weighting and allocation budgets (#45916)
|
2026-10-23 12:29:51 -07:00 |
|
Cheng Wan
|
1340044e97
|
[Fix] deepseek-v4: Preserve decoder-tail token-count ownership (#45915)
|
2026-10-23 12:28:43 -07:00 |
|
   
|
9d7ad308bd
|
[Fix] [AMD] Quark: fix Quark block-FP8 loading in DeepSeek loader (#40776)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
|
2026-10-23 12:11:21 -07:00 |
|
 Alex NailsandClaude Opus 5.5
|
baf80c61b7
|
[Feat] platforms: Let out-of-tree platforms bind group devices and custom ops (#45897)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 12:02:42 -07:00 |
|
 Peng WuandClaude Opus 5.5
|
16aa816060
|
[Fix] disaggregation: Restart a lost prefill's heartbeat miss count (#45922)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 01:26:10 +08:00 |
|
 
|
30dc2f9430
|
[Feat] benchmark: Add --input-len-list to bench_one_batch_server for per-request input lengths (#45982)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: wpc <wpc@users.noreply.github.com>
|
2026-10-23 09:04:59 -07:00 |
|
 
|
5a86d6ee17
|
[Fix] rust-server: Deliver scheduler-side aborts to Rust frontend clients (#45899)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-23 09:04:54 -07:00 |
|
Avaya Aggarwal
|
efd2ce8a9d
|
[Feat] comfyui: video-to-video input and prompt enhancement for server-mode nodes (#43673)
|
2026-10-23 23:09:30 +08:00 |
|