 Jeremy Zhang
|
f69d6fc28a
|
[OpenAI] Propagate PD routing metadata through /v1/responses (#35503)
|
2026-09-12 01:33:38 +08:00 |
|
|
Vignesh Sethuraman
|
ddf02a4f58
|
[AMD] aiter: resolve SWA KV pool for draft workers + guard paged decode (#38756)
|
2026-09-11 10:13:48 -07:00 |
|
|
Xiaoyu Zhang
|
d6b5dca90c
|
[Diffusion] Optimize SANA-WM convolution post-processing and streaming GDN (#38529)
|
2026-09-11 23:30:17 +08:00 |
|
|
|
2a46cf2ca0
|
[PD] Share the prefill->decode failure notification across backends (#36612)
Co-authored-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-11 23:16:17 +08:00 |
|
|
MickandMick Qian
|
e016de462c
|
[diffusion] CI: expose nightly server telemetry coverage (#38782)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-11 23:07:37 +08:00 |
|
|
Xiaoyu Zhang
|
7f09fbcd25
|
[Diffusion] Preserve BF16 rounding in Hopper LTX QKNorm and RoPE fusion (#38533)
|
2026-09-11 23:02:54 +08:00 |
|
|
MickandMick Qian
|
dd67a42634
|
[diffusion] UX: quiet request-path cache diagnostics (#38783)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-11 22:45:21 +08:00 |
|
|
|
593c7a900d
|
Add granite_thinking_parser reasoning parser for Granite 4.2 (#38693)
Signed-off-by: Yousaf Shah <yousaf.shah@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-09-11 07:18:35 -07:00 |
|
|
|
335f6aab27
|
[DSV4] Support raw-index output in TopK v2 (#33672)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-09-11 07:17:36 -07:00 |
|
|
MickandClaude Opus 5
|
ab9750fb35
|
[diffusion] optimization: pin layerwise host stores in place at their exact size (#39021)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-11 22:04:40 +08:00 |
|
|
Xinyuan Tong
|
e8a36d339c
|
Auto-detect GLM-5.3 chat templates as glm45/glm47 parsers (#38297)
|
2026-09-11 09:02:44 -04:00 |
|
|
MickandMick Qian
|
358c163250
|
[diffusion] fix: recover ipc jit initialization after interrupted builds (#39034)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-11 19:34:09 +08:00 |
|
|
James
|
165d8dd177
|
[NPU][Hicache] Add Ascend Memcache Hicache L3 storage backend (#38827)
|
2026-09-11 18:54:00 +08:00 |
|
|
Liwansi
|
747734dce4
|
[NPU]glm5.2 fp8 memory opt (#38807)
|
2026-09-11 18:48:45 +08:00 |
|
|
|
822e73ccdd
|
[Unified Cache][AMD] Support DeepSeek-V4 unified KV in direct external linkers (#38269)
Co-authored-by: amd-danli103 <danli103@amd.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
Co-authored-by: TianDi101 <tiandi920722@gmail.com>
|
2026-09-11 01:49:29 -07:00 |
|
|
Liangsheng Yin
|
17fa5ad327
|
[Refactor] Generalize attention graph variants in the decode runner (#38993)
|
2026-09-11 00:45:58 -07:00 |
|
|
AMD-yanfeiwang
|
69aa46b2fa
|
[ROCm] Raise HiCache JIT block quota for mapped-host throughput (#39036)
|
2026-09-11 00:12:24 -07:00 |
|
|
Shuwen Wang
|
a713349faf
|
[HiCache] fix: preserve SWA host lock boundaries across splits (#38835)
|
2026-09-11 14:58:26 +08:00 |
|
|
Vignesh Sethuraman
|
76ef679cb1
|
[AMD] aiter: fail loudly on cross-layer KV sharing in target_verify (#38755)
|
2026-09-10 23:37:03 -07:00 |
|
|
Bingxu Chen
|
2465ee3948
|
[AMD] Fix DeepSeek block-FP8 loading on gfx94x (#38446)
Signed-off-by: Bingxu Chen <bingxche@amd.com>
|
2026-09-10 23:00:29 -07:00 |
|
|
Shunkangz
|
40a84d6dfc
|
[kv-shard 1/4] Logical-page placement with UnifiedRadixCache (#38356)
|
2026-09-10 22:06:42 -07:00 |
|
|
Liangsheng Yin
|
94ce940ff8
|
[Bug] Include DSA variant in exact-bucket graph admission (#38992)
|
2026-09-10 21:03:03 -07:00 |
|
|
yuchengliu1andMa Mingfei
|
480b14edad
|
[xpu] install xpu-kernel by released wheel (#37394)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-11 10:47:27 +08:00 |
|
|
ANSHUMAN TRIPATHYandMa Mingfei
|
0fadad8933
|
DFLASH support added for XPU (#32798)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-11 10:39:37 +08:00 |
|
|
Miaomiao Jiang
|
690428b470
|
[XPU] Add xpu forward in Gemma3RMSNorm & Add test and benchmark for Gemma3RMSNorm (#36278)
|
2026-09-11 10:32:25 +08:00 |
|
|
Vignesh Sethuraman
|
7e3ae15f73
|
[AMD] aiter: honor per-layer softmax scale (#38754)
|
2026-09-10 19:27:09 -07:00 |
|
|
ANSHUMAN TRIPATHY
|
3716e496ea
|
Speculative Decoding support for intel_xpu attention backend on XPU target (#30548)
|
2026-09-11 10:25:25 +08:00 |
|
|
ANSHUMAN TRIPATHYandmingfeima
|
2adb2e8485
|
[XPU] Adapt device agnostic API usage (#32093)
Co-authored-by: mingfeima <mingfei.ma@intel.com>
|
2026-09-11 10:03:12 +08:00 |
|
|
Siju Samuel
|
67d3a2ea57
|
[XPU] Make checkpoint_engine worker device-agnostic (#32382)
|
2026-09-11 09:56:39 +08:00 |
|
|
|
ad7f57c9ea
|
[Responses] Fix empty-prompt routing for token-first chat encoders (kimi_k3, inkling) (#35486)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-11 01:06:20 +00:00 |
|
|
jasonjk-park
|
9df72e8f5a
|
Fix custom logit processor params when num_tokens_in_batch is used (#38730)
|
2026-09-10 17:52:08 -07:00 |
|
|
Alexandrandronnie_zheng
|
d0035da34e
|
[Diffusion][Refactor] Refactor and unify RoPE execution for DiT models using RotaryEmbedding based on CustomOp (#33555)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-09-11 08:31:05 +08:00 |
|
|
Liangsheng Yin
|
41da06adca
|
[Refactor] Generalize DeepSeek V4 compressed pool management (#38954)
|
2026-09-10 17:29:03 -07:00 |
|
|
Mohammad Miadh AngkadandMohammad Angkad
|
52c191da52
|
[Deps] Retire the CUDA 12 lane (#38404)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-10 16:58:09 -07:00 |
|
|
|
fae8cd84cb
|
Support NemotronH_Omni_Reasoning_V3 in SGLang (#35599)
Signed-off-by: Ryan Stewart <rystewart@nvidia.com>
Signed-off-by: rystewart-nvidia <rystewart@nvidia.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-09-10 16:57:22 -07:00 |
|
|
cctry
|
203d7e812c
|
Fix KV-canary workspace accounting after graph capture (#38596)
|
2026-09-10 16:10:12 -07:00 |
|
|
cctry
|
42bbaac259
|
[metrics] Report logical prefill token counts (#38566)
|
2026-09-10 16:09:21 -07:00 |
|
|
Liangsheng Yin
|
dc5f59c3a2
|
[Refactor] Clarify DeepSeek V4 metadata names for V4.1 (#38947)
|
2026-09-10 15:42:52 -07:00 |
|
|
Pengyun Lin
|
d076eec427
|
[SM120] Use exact query-head widths for DeepSeek-V4 sparse MLA decode (#36655)
|
2026-09-10 15:40:17 -07:00 |
|
|
paulzhang-tmandQiaolin-Yu
|
bb15be6d79
|
[Spec] Stage Inkling MTP draft metadata before verify (#38169)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2026-09-10 15:32:19 -07:00 |
|
|
paulzhang-tm
|
a63efd9056
|
[Spec] Support large MTP batches in short-convolution metadata (#38558)
|
2026-09-10 15:13:17 -07:00 |
|
|
|
fd7743e0e1
|
[Sampling] Support sampling masks with overlap scheduling (#36631)
Co-authored-by: ByronHsu <ByronHsu@users.noreply.github.com>
Co-authored-by: root <root@slurm-h200-208-179.slurm-compute.tenant-slurm.svc.cluster.local>
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
|
2026-09-10 14:52:44 -07:00 |
|
|
YAMY
|
55b45cb45a
|
fix(qsa): dequantize FP8 cached prefixes in the sparse prefill kernels (#38855)
|
2026-09-10 14:07:39 -07:00 |
|
|
|
06dfe05d65
|
[Deps] Raise smg-grpc-servicer floor to >=0.9.0 to unbreak SMG E2E CI (#38801)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-10 13:55:36 -07:00 |
|
|
|
a26273d668
|
[AMD] Quantize the bf16 MTP draft experts online to MXFP4 for Qwen3.5 (#38748)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-10 13:00:41 -07:00 |
|
|
James
|
209654c420
|
[NPU][Hicache] Optimize HiCache L2 IO with Memfabric acc_offload (#38826)
|
2026-09-11 00:23:36 +08:00 |
|
|
Shuwen Wang
|
19b83b4b9d
|
[Radix Cache] Fix PureSWA tail release without insertion (#38349)
|
2026-09-10 23:55:48 +08:00 |
|
|
Shuwen Wang
|
cc7e43ad22
|
[HiCache] Account for newly pinned ancestors in load-back quota (#38481)
|
2026-09-10 23:54:08 +08:00 |
|
|
pllimax
|
92dffebe16
|
[NPU] Set DEEPEP_HYBRID_DEPLOYMENT for new DeepEP tests; switch glm5_2 to w8a8; tune nightly timeouts (#38775)
|
2026-09-10 23:32:54 +08:00 |
|
|
Chengze Fan
|
12771786f2
|
[AMD] Restore AITER verify runtime sizing reverted by #34647 (#38575)
|
2026-09-10 05:57:47 -07:00 |
|