 
|
bbc77e7db4
|
[Perf] diffusion: Cut LTX-2.3 per-block elementwise work (contiguous AdaLN values, gate-folded masks, vectorized head gate) (#46110)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 09:27:39 +08:00 |
|
 Jackey Huaandhnyls2002
|
e22a530859
|
[Feat] openai: Render DeepSeek-V4/V4.1 chat prompts with deepseek-recipe (#45315)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-23 18:05:35 -07:00 |
|
Liangsheng Yin
|
79e5c4bb9b
|
[Perf] dsv41: Trim per-step DSpark decode overhead (#46176)
|
2026-10-23 17:24:06 -07:00 |
|
 Baizhou Zhangandsid-rp
|
6a319e7b34
|
[Fix] muse: Support Responses namespace tools and defer_loading (#44685)
Co-authored-by: sid-rp <sidrp@meta.com>
|
2026-10-23 16:48:08 -07:00 |
|
 
|
0d592c475b
|
[Fix] rust-server: Keep a transfer backend's own bootstrap port on prefill (#46066)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-23 16:47:14 -07:00 |
|
Cheng Wan
|
855c092deb
|
[Fix] inkling: Keep BF16 LM-head operands with FP32 output (#45335)
|
2026-10-23 15:51:44 -07:00 |
|
Baizhou Zhang
|
ea226cf782
|
[Feat] glm5.3flash: Support padded CP BCG and prefix replay with PD/DFlash2 (#43774)
|
2026-10-23 14:21:31 -07:00 |
|
  
|
27ac614f05
|
[Feat] parser: Add checkpoint-driven response-template adapters (#40479)
Signed-off-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-23 14:05:54 -07:00 |
|
em-dreyer
|
4542fc8f59
|
[Fix] mistral3: Subclass LlavaForConditionalGeneration instead of wrapping it (#45656)
|
2026-10-23 14:05:32 -07:00 |
|
 
|
1d605b7ece
|
[CI] vlm: Harden fixture cleanup after setup and shutdown failures (#45461)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
|
2026-10-23 13:20:06 -07:00 |
|
 
|
005333d029
|
[Refactor] radix-tree: Make each cache action a typed CacheAction implementation (#45444)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-23 12:49:30 -07:00 |
|
Cheng Wan
|
d0022e1df3
|
[Fix] lora: Preserve MoE projection identity and routing lifetimes (#45681)
|
2026-10-23 12:32:55 -07:00 |
|
Cheng Wan
|
ac3db731b3
|
[Fix] moe: Preserve CUTLASS routing metadata and execution budgets (#45917)
|
2026-10-23 12:32:05 -07:00 |
|
Cheng Wan
|
8b9b992e41
|
[Perf] moe: Preserve Marlin workspace and route-count budgets (#45462)
|
2026-10-23 12:31:17 -07:00 |
|
Cheng Wan
|
e6451c1a95
|
[Fix] gguf: Preserve MoE routing, weighting and allocation budgets (#45916)
|
2026-10-23 12:29:51 -07:00 |
|
Cheng Wan
|
1340044e97
|
[Fix] deepseek-v4: Preserve decoder-tail token-count ownership (#45915)
|
2026-10-23 12:28:43 -07:00 |
|
   
|
9d7ad308bd
|
[Fix] [AMD] Quark: fix Quark block-FP8 loading in DeepSeek loader (#40776)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
|
2026-10-23 12:11:21 -07:00 |
|
 Alex NailsandClaude Opus 5.5
|
baf80c61b7
|
[Feat] platforms: Let out-of-tree platforms bind group devices and custom ops (#45897)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 12:02:42 -07:00 |
|
Shangming Cai
|
1e894eb92d
|
[CI] disaggregation: Run the SWA decode radix cache test on Mooncake (#46126)
|
2026-10-24 01:41:39 +08:00 |
|
 Peng WuandClaude Opus 5.5
|
16aa816060
|
[Fix] disaggregation: Restart a lost prefill's heartbeat miss count (#45922)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 01:26:10 +08:00 |
|
 
|
5a86d6ee17
|
[Fix] rust-server: Deliver scheduler-side aborts to Rust frontend clients (#45899)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-23 09:04:54 -07:00 |
|
   
|
c677171c1d
|
[Feat] hicache: Support MLA DCP with HiCache L3(file/mooncake) (#41187)
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Venkat Raman <venkat.raman@verda.com>
|
2026-10-23 23:09:04 +08:00 |
|
pllimax
|
9b46f27090
|
[Fix] [NPU] tests: Restore evalscope GSM8K baseline via NPUGSM8KMixin backend (#45732)
|
2026-10-23 21:06:21 +08:00 |
|
Jimmy Shong
|
4b1941e889
|
[CI] diffusion: Run the FLUX.2 XPU norm-fusion test on the XPU suite only (#46040)
|
2026-10-23 19:54:03 +08:00 |
|
Sage
|
611a703061
|
[Chore] api: add fields to generate request (#45164)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-23 17:10:23 +08:00 |
|
 
|
494eeecb6c
|
[Fix] diffusion: Keep the linear-GELU verdict cache out of torch.compile traces (#45944)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 17:01:51 +08:00 |
|
Xinyuan Tong
|
8b9f72417f
|
[Feat] Inkling: render and parse chat via tml-renderers (#45340)
|
2026-10-23 16:43:38 +08:00 |
|
Michael
|
bb72b47daf
|
[Test] [AMD] deepseek-v4.1: Give the encoder-replay test's request window a zero_row (#45728)
|
2026-10-23 01:38:54 -07:00 |
|
Shuwen Wang
|
77bc8cab18
|
[Fix] hicache/pd: Promise prefill only the L3 span the decode prefetch takes (#43548)
|
2026-10-23 16:32:41 +08:00 |
|
 Yao MatrixandAlex Nails
|
6d6c9cd4ae
|
[Fix] offloader: Preserve cached weights during CPU offload (#44139)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-23 00:50:24 -07:00 |
|
 Yihao WangandClaude Opus 5
|
6f466f655a
|
[Perf] [XPU] diffusion/flux2: Fuse bit-exact LayerNorm and gated residual norm (#41942)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-23 15:38:12 +08:00 |
|
 ShunkangzandZhangheng
|
79ab8f6d7c
|
[Feat] KVShard: Support kv cache sharding for MTP (#40929)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-10-23 15:20:19 +08:00 |
|
 Banruo LiuandClaude Opus 5.5
|
6e667c4310
|
[Fix] disaggregation: Poison the deferred abort ack when a NIXL or Mori write fails (#45973)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 14:47:59 +08:00 |
|
Liangsheng Yin
|
6c844eb12e
|
[Perf] dsv4: Replay the V4.1 prefill graph past 16K contexts on SM90 (#45941)
|
2026-10-22 23:47:17 -07:00 |
|
vikram singh shekhawat
|
3f36fc0833
|
[Fix] [XPU] runtime: Fix XPU rotary embeddings and tokenizer padding (#41213)
|
2026-10-23 14:09:59 +08:00 |
|
Pinjie Xu
|
7c680a0d45
|
[Perf] diffusion/cosmos3: optimize v2v preprocess performance (#45398)
Signed-off-by: pinjie <pinjiex@nvidia.com>
|
2026-10-23 13:57:38 +08:00 |
|
Khoa Pham
|
c7994e7076
|
[Fix] dsv41: Keep MegaGate out of prefill graphs by gating on the forward mode (#45969)
|
2026-10-22 22:11:18 -07:00 |
|
 Khoa Phamandhnyls2002
|
5bdbec0d48
|
[Perf] dsv41: Drop the MegaGate padded-row copy on sgl-deep-gemm 0.2.3.post2 (#45933)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-22 22:10:57 -07:00 |
|
 
|
e83f585ae6
|
[Perf] dsv41: Serve token-interleaved V4.1 KV caches with sgl-flash-mla (#45893)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-22 22:02:49 -07:00 |
|
Baizhou Zhang
|
698651acd0
|
[Feat] HiCache: Support fused DFLASH KV in unified hybrid SWA pools (#45700)
|
2026-10-22 20:00:28 -07:00 |
|
Liangsheng Yin
|
a4838160b3
|
[Perf] dsv4: Write V4.1 K rows with one warp per token in the fused k-norm-rope store (#45934)
|
2026-10-22 19:50:50 -07:00 |
|
Lianmin Zheng
|
5daa1352ba
|
[CI] tests: Retire test/srt and reject legacy test paths (#42567)
|
2026-10-22 19:15:55 -07:00 |
|
 Khoa PhamandClaude Opus 5.5
|
e5dc0c363a
|
[Perf] dsv41: Integrate DeepGEMM MegaGate routing (#43262)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-22 19:08:39 -07:00 |
|
 YAMYandOasis-Git
|
c82f7141ad
|
[Perf] [NVIDIA] dspark: Move the host work between DSv4.1 decode graphs into the graphs for the megakernel path (#45450)
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2026-10-22 19:08:06 -07:00 |
|
 metamergebotandJialin
|
94e4611eac
|
[Refactor] unified-cache: Factor match validators and match completion into helpers (#45714)
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-22 18:58:15 -07:00 |
|
Xinyuan Tong
|
92e57d5de7
|
[Perf] request_logger: skip per-token watermark redaction walk (#44692)
|
2026-10-22 18:57:19 -07:00 |
|
  
|
26396bf566
|
[Fix] [NVIDIA] deepseek-v4.1: Fix the breakable prefill CUDA graph in the late-layer tail on SM90 (#45407)
Co-authored-by: JohnZhao01 <325926370+JohnZhao01@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-22 17:57:16 -07:00 |
|
Liangsheng Yin
|
9c7dd3c45f
|
[Perf] dsv4: Dequantize each shared sparse-prefill KV source once per forward (#45909)
|
2026-10-22 17:08:40 -07:00 |
|
Liangsheng Yin
|
ae4258715c
|
[Perf] dsv4: Keep V4.1 image rows inside the Engram gate kernel (#45904)
|
2026-10-22 17:05:01 -07:00 |
|
 HEJIAN SANGandClaude Opus 5.5
|
77f90ade97
|
[Fix] weight_checker: Make the checksum device-agnostic (#45918)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-22 16:57:49 -07:00 |
|