 
|
0d592c475b
|
[Fix] rust-server: Keep a transfer backend's own bootstrap port on prefill (#46066)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-23 16:47:14 -07:00 |
|
Cheng Wan
|
855c092deb
|
[Fix] inkling: Keep BF16 LM-head operands with FP32 output (#45335)
|
2026-10-23 15:51:44 -07:00 |
|
Liangsheng Yin
|
f05ad5ec01
|
[Perf] logits: Cast bf16 logits into the fp32 buffer with a Triton kernel (#46167)
|
2026-10-23 15:06:09 -07:00 |
|
 Rohan VarmaandJun Wan
|
15dc838f9b
|
[Fix] http_server: Apply SGLANG_TIMEOUT_KEEP_ALIVE to Granian HTTP/1.1 connections (#45760)
Signed-off-by: Rohan Varma <rohanv@nvidia.com>
Co-authored-by: Jun Wan <8323392+junwan01@users.noreply.github.com>
|
2026-10-23 14:43:54 -07:00 |
|
Baizhou Zhang
|
ea226cf782
|
[Feat] glm5.3flash: Support padded CP BCG and prefix replay with PD/DFlash2 (#43774)
|
2026-10-23 14:21:31 -07:00 |
|
 Yuhao YangandClaude Opus 5.5
|
5f7542d762
|
[Perf] dsv41: Build the MegaGate row masks once per forward (#46071)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-23 14:15:01 -07:00 |
|
  
|
27ac614f05
|
[Feat] parser: Add checkpoint-driven response-template adapters (#40479)
Signed-off-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-23 14:05:54 -07:00 |
|
em-dreyer
|
4542fc8f59
|
[Fix] mistral3: Subclass LlavaForConditionalGeneration instead of wrapping it (#45656)
|
2026-10-23 14:05:32 -07:00 |
|
Michael
|
194abb8e54
|
[CI] [AMD] diffusion: Drain the Cosmos Dreams decode stream after freeing its outputs (#45983)
|
2026-10-23 13:26:56 -07:00 |
|
Cheng Wan
|
d0022e1df3
|
[Fix] lora: Preserve MoE projection identity and routing lifetimes (#45681)
|
2026-10-23 12:32:55 -07:00 |
|
Cheng Wan
|
ac3db731b3
|
[Fix] moe: Preserve CUTLASS routing metadata and execution budgets (#45917)
|
2026-10-23 12:32:05 -07:00 |
|
Cheng Wan
|
8b9b992e41
|
[Perf] moe: Preserve Marlin workspace and route-count budgets (#45462)
|
2026-10-23 12:31:17 -07:00 |
|
 
|
0931dfedc9
|
[Fix] [AMD] dsa: Fix AITER prefill with an FP8 KV cache (#39083)
Co-authored-by: Pawel Kowalski <pawel.kowalski@silo.ai>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-10-23 12:30:42 -07:00 |
|
Cheng Wan
|
e6451c1a95
|
[Fix] gguf: Preserve MoE routing, weighting and allocation budgets (#45916)
|
2026-10-23 12:29:51 -07:00 |
|
Cheng Wan
|
1340044e97
|
[Fix] deepseek-v4: Preserve decoder-tail token-count ownership (#45915)
|
2026-10-23 12:28:43 -07:00 |
|
   
|
9d7ad308bd
|
[Fix] [AMD] Quark: fix Quark block-FP8 loading in DeepSeek loader (#40776)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
|
2026-10-23 12:11:21 -07:00 |
|
 Alex NailsandClaude Opus 5.5
|
baf80c61b7
|
[Feat] platforms: Let out-of-tree platforms bind group devices and custom ops (#45897)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 12:02:42 -07:00 |
|
 Peng WuandClaude Opus 5.5
|
16aa816060
|
[Fix] disaggregation: Restart a lost prefill's heartbeat miss count (#45922)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-24 01:26:10 +08:00 |
|
 
|
30dc2f9430
|
[Feat] benchmark: Add --input-len-list to bench_one_batch_server for per-request input lengths (#45982)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: wpc <wpc@users.noreply.github.com>
|
2026-10-23 09:04:59 -07:00 |
|
 
|
5a86d6ee17
|
[Fix] rust-server: Deliver scheduler-side aborts to Rust frontend clients (#45899)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-23 09:04:54 -07:00 |
|
Avaya Aggarwal
|
efd2ce8a9d
|
[Feat] comfyui: video-to-video input and prompt enhancement for server-mode nodes (#43673)
|
2026-10-23 23:09:30 +08:00 |
|
   
|
c677171c1d
|
[Feat] hicache: Support MLA DCP with HiCache L3(file/mooncake) (#41187)
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Venkat Raman <venkat.raman@verda.com>
|
2026-10-23 23:09:04 +08:00 |
|
 
|
02b983603d
|
[Fix] diffusion: Keep dynamic LoRA deltas on fused linear-GELU sites (#45943)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:19:53 +08:00 |
|
 
|
0e34962884
|
[Perf] diffusion: Cut LTX-2 denoising-step host overhead (#45966)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:18:57 +08:00 |
|
 
|
82ff16dad0
|
[Perf] diffusion: Skip the residency calibration probe in auto mode until a planner consumes it (#45979)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:18:06 +08:00 |
|
 
|
3e5f5505ed
|
[Perf] diffusion: Serve image responses from in-memory encoded bytes (#45987)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:16:44 +08:00 |
|
 
|
2fbd094a8c
|
[Fix] diffusion: Offset LTX-2.3 BCG video RoPE by the SP shard start (#45995)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:14:37 +08:00 |
|
pllimax
|
9b46f27090
|
[Fix] [NPU] tests: Restore evalscope GSM8K baseline via NPUGSM8KMixin backend (#45732)
|
2026-10-23 21:06:21 +08:00 |
|
 
|
86933b1f33
|
[Fix] deps: Pin python-dateutil<3 to keep botocore resolvable (#45857)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
|
2026-10-23 20:57:44 +08:00 |
|
Sage
|
611a703061
|
[Chore] api: add fields to generate request (#45164)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-10-23 17:10:23 +08:00 |
|
 
|
494eeecb6c
|
[Fix] diffusion: Keep the linear-GELU verdict cache out of torch.compile traces (#45944)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 17:01:51 +08:00 |
|
 
|
f9129915a3
|
[Fix] diffusion: Give every SP rank the same Wan TI2V timestep (#45994)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 17:00:40 +08:00 |
|
Xinyuan Tong
|
8b9f72417f
|
[Feat] Inkling: render and parse chat via tml-renderers (#45340)
|
2026-10-23 16:43:38 +08:00 |
|
Shuwen Wang
|
77bc8cab18
|
[Fix] hicache/pd: Promise prefill only the L3 span the decode prefetch takes (#43548)
|
2026-10-23 16:32:41 +08:00 |
|
Avaya Aggarwal
|
4b273537de
|
[Fix] diffusion: runtime utils bug fixes (#44887)
|
2026-10-23 16:08:13 +08:00 |
|
 Yao MatrixandAlex Nails
|
6d6c9cd4ae
|
[Fix] offloader: Preserve cached weights during CPU offload (#44139)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-23 00:50:24 -07:00 |
|
 Yihao WangandClaude Opus 5
|
6f466f655a
|
[Perf] [XPU] diffusion/flux2: Fuse bit-exact LayerNorm and gated residual norm (#41942)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-23 15:38:12 +08:00 |
|
 
|
8708d2ee99
|
[Fix] diffusion/ltx: Keep tiled VAE decode off the sharded convs under parallel decode (#45942)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 15:32:03 +08:00 |
|
 
|
4f47c48b33
|
[Fix] diffusion: Keep the N-rank IPC all-to-all's flags and staging out of expandable segments (#45948)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 15:31:19 +08:00 |
|
 
|
1cd0ebb3d3
|
[Perf] diffusion: Remove per-step and per-request host syncs in Cosmos3 and Qwen-Image-2.1 (#45967)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 15:30:09 +08:00 |
|
Avaya Aggarwal
|
4da6f585f3
|
[Fix] diffusion: OpenAI API hardening (#43585)
|
2026-10-23 15:22:00 +08:00 |
|
 ShunkangzandZhangheng
|
79ab8f6d7c
|
[Feat] KVShard: Support kv cache sharding for MTP (#40929)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-10-23 15:20:19 +08:00 |
|
 Banruo LiuandClaude Opus 5.5
|
6e667c4310
|
[Fix] disaggregation: Poison the deferred abort ack when a NIXL or Mori write fails (#45973)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 14:47:59 +08:00 |
|
Liangsheng Yin
|
6c844eb12e
|
[Perf] dsv4: Replay the V4.1 prefill graph past 16K contexts on SM90 (#45941)
|
2026-10-22 23:47:17 -07:00 |
|
 Chetan Kumar VermaandClaude Opus 5.5
|
76c382e80f
|
[Perf] [XPU] diffusion: Use the AOT SYCL fused residual-norm-scale-shift kernel (#41401)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-23 14:32:25 +08:00 |
|
 ZiruandNiu Ziru
|
904691e0b5
|
[Feat] [CPU] model: Support Cosmos3 series models on CPU (#45478)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
|
2026-10-23 14:24:28 +08:00 |
|
vikram singh shekhawat
|
3f36fc0833
|
[Fix] [XPU] runtime: Fix XPU rotary embeddings and tokenizer padding (#41213)
|
2026-10-23 14:09:59 +08:00 |
|
Liangsheng Yin
|
0e338777b0
|
[Perf] dsv4: Let the fused MXFP8 producers run inside the breakable prefill graph (#45980)
|
2026-10-22 23:00:10 -07:00 |
|
Pinjie Xu
|
7c680a0d45
|
[Perf] diffusion/cosmos3: optimize v2v preprocess performance (#45398)
Signed-off-by: pinjie <pinjiex@nvidia.com>
|
2026-10-23 13:57:38 +08:00 |
|
Khoa Pham
|
c7994e7076
|
[Fix] dsv41: Keep MegaGate out of prefill graphs by gating on the forward mode (#45969)
|
2026-10-22 22:11:18 -07:00 |
|