 jasonjk-park
|
0db2c53dec
|
Fix overlap prebuilt row reuse race (#35748)
|
2026-08-21 02:00:13 -07:00 |
|
|
Liangsheng Yin
|
896acc8860
|
[Fix] Clear full-to-SWA mapping with index_fill_ to avoid a blocking H2D copy (#35773)
|
2026-08-21 01:23:26 -07:00 |
|
|
Shuwen Wang
|
8ff9c2b227
|
[mem_cache][9/N] refactor: move DSAIndexerPoolHost to pool_host.dsa (#35306)
|
2026-08-21 15:59:15 +08:00 |
|
|
|
8a123cbd0e
|
[Refactor] New EPD (#30398)
Co-authored-by: Yuang Chen <1131578721@qq.com>
Co-authored-by: Yuang Chen <cya539102@antgroup.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
|
2026-08-21 15:22:48 +08:00 |
|
|
|
a688682f4b
|
[AMD][CI] Fix ROCm 7.0's dead apt index fail the MORI dependency install (#35764)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
|
2026-08-20 22:13:09 -07:00 |
|
|
Ke Bao
|
73a2c117c6
|
Support mxfp8 KV cache in PD transfer (#35718)
|
2026-08-21 13:05:06 +08:00 |
|
|
|
bda9952377
|
[AMD] DeepSeek-V4 MI355X: eliminate bpreshuffle fp8-scale copies at producer sites (MoE down, MLA o_proj bmm) (#33166)
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-08-20 21:46:23 -07:00 |
|
|
Zhangheng
|
44806dc507
|
Using unified radix tree by default for all case (#35081)
|
2026-08-21 10:45:46 +08:00 |
|
|
Xiaoyu Zhang
|
7e80e889a2
|
[diffusion] Fuse LTX-2.5 decoder 3D RoPE (#35698)
|
2026-08-21 10:13:09 +08:00 |
|
|
ishandhananiandShangming Cai
|
978244d671
|
[P/D disagg] Decode-side radix cache for SWA hybrid models (unified radix tree) (#27770)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-08-21 09:25:06 +08:00 |
|
|
Nan Jiang
|
f825d72936
|
[Sampling] Restore finite top-k requirement for sampling masks (#35205)
|
2026-08-20 16:55:25 -07:00 |
|
|
ethcheandEthan Che
|
67f6ad61d9
|
fix(kernel) Fix Helion small-token prefill bug (#35197)
Co-authored-by: Ethan Che <eche@meta.com>
|
2026-08-20 16:41:59 -07:00 |
|
|
Shenxiu LiuandQiaolin Yu
|
779e593bd1
|
Fix _GenerationStreamAccumulator logprob_end off-by-one under retract (#26510)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-08-20 16:03:13 -07:00 |
|
|
Jiajun Li
|
a4ef828207
|
fix(openai): avoid duplicate routed expert in response when return_meta_info = True (#35323)
|
2026-08-20 15:21:58 -07:00 |
|
|
Liangsheng Yin
|
0149f56e84
|
[CI] Gate /rerun-test on commenter trust and remove /rerun-stage (#35750)
|
2026-08-20 15:05:52 -07:00 |
|
|
ishandhananiandAlex Nails
|
0f744b6848
|
feat: make mm_inputs msgpack-native (#29656)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-20 14:30:07 -07:00 |
|
|
|
eac91ac362
|
[Fix] Land the decode mamba checkpoint depth on the tree page under DCP (#35412)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-08-20 12:15:42 -07:00 |
|
|
Chao Shi
|
2ef0fe4669
|
TP/PP Consensus checker (#34406)
|
2026-08-21 01:36:03 +08:00 |
|
|
Ke Bao
|
ba97cc6397
|
Skip empty linear-attention state buffers in PD transfer (#35689)
|
2026-08-21 01:00:50 +08:00 |
|
|
Shuwen Wang
|
9b249a25a1
|
test: switch the Inkling-Small NVFP4 deterministic suite to DSPARK (#35293)
|
2026-08-20 21:54:52 +08:00 |
|
|
Mohammad Miadh Angkad
|
a4ffb996db
|
[Fix] Keep deterministic GDN prefill on Triton (#35632)
|
2026-08-20 19:38:53 +08:00 |
|
|
Jimmy Shong
|
710267dc4c
|
[Quant] Load compressed-tensors kv_cache_scheme scales (#35455)
|
2026-08-20 19:17:59 +08:00 |
|
|
|
21c88f8625
|
[diffusion] quant: support gguf (#35370)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-20 15:46:34 +08:00 |
|
|
YAMY
|
ae23423b46
|
Split TRTLLM MHA decode batches by KV sequence length (#34888)
|
2026-08-20 00:44:26 -07:00 |
|
|
Baizhou Zhang
|
d287880a7a
|
Update deepep for SBO feature (#35450)
|
2026-08-19 23:37:13 -07:00 |
|
|
|
0bda0b168a
|
[Fix]: exclude SM120 from attn-res TMA dispatch (#35361)
Co-authored-by: 1BIN4 <1741738350@qq.com>
Co-authored-by: L-Ark <fliangae@connect.ust.hk>
Co-authored-by: Chikati <jxudn@connect.ust.hk>
Co-authored-by: mengzili <zilim@ust.hk>
|
2026-08-20 14:32:31 +08:00 |
|
|
cctryandcctry
|
32d98aad13
|
[HiCache] Allow a retraction host pool smaller than the device pool (#35543)
Co-authored-by: cctry <cctry@fb.com>
|
2026-08-19 22:59:57 -07:00 |
|
|
|
50dae2d99d
|
Amd/dsv4 shared experts fusion top6 (#32340)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-08-19 22:57:58 -07:00 |
|
|
Michael
|
02b93e7e01
|
[AMD] Add GLM-5.2 MI35x nightly accuracy and perf benchmark (#32570)
|
2026-08-19 22:49:43 -07:00 |
|
|
Alex NailsandClaude Opus 5
|
b6dcd393d6
|
[Fix] Support 128-aligned hidden sizes in the W4AFP8 DeepEP low-latency requant kernel (#35593)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-19 22:18:17 -07:00 |
|
|
|
9db4ba8da1
|
[DeepSeek-V4] Add Q8KV8 sparse MLA prefill runtime backend (#32327)
Co-authored-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-20 10:23:49 +08:00 |
|
|
|
dc175b3ad2
|
[CI][AMD] Run the profiling suite without CUDA graphs on ROCm (#34452)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
|
2026-08-20 09:41:28 +08:00 |
|
|
Mick
|
ab203663c4
|
[diffusion] fix: reject unsupported modelopt checkpoint algorithms (#35182)
|
2026-08-20 09:13:24 +08:00 |
|
|
Jimmy ShongandLING ZHI
|
1cf2b8c54d
|
[Spec] Support quantized target lm_head in the DFlash2 selector (#35496)
Co-authored-by: LING ZHI <1747985437lz@gmail.com>
|
2026-08-19 18:06:41 -07:00 |
|
|
MichaelandCursor Agent
|
e805a8f98e
|
[AMD] Keep the PTX-inline-asm diffusion norm fusions off on ROCm (fix FLUX warmup crash) (#34481)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-08-20 08:55:28 +08:00 |
|
|
Jimmy Shong
|
5375babbac
|
[Quant] Load compressed-tensors quantized lm_head instead of value-casting it (#35228)
|
2026-08-19 15:37:45 -07:00 |
|
|
|
c7e2c08d14
|
fix(constrained): reject NUL bytes in grammar specs to stop an xgrammar segfault (#34679)
Signed-off-by: Junhao Shen <junshen@nvidia.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
|
2026-08-19 15:31:14 -07:00 |
|
|
milesial
|
082aac8fce
|
[Bugfix] Fix min-new-token EOS handling (#31378)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2026-08-19 15:29:22 -07:00 |
|
|
Liangsheng Yin
|
1270204d2c
|
Revert "[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend" (#35568)
|
2026-08-19 14:14:38 -07:00 |
|
|
elvischenvandBrayden Zhong
|
a6bc0532c9
|
[Fix] Fix Nemotron-H Mamba illegal memory access under DP attention with CUDA graph (#34561)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-19 14:13:40 -07:00 |
|
|
milesial
|
ed12d6827d
|
fix(disagg): allow fake transfer with decode DCP (#35409)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2026-08-19 13:54:37 -07:00 |
|
|
Jason Wiemels
|
defb2a3100
|
feat(openai): Accept the input_audio content part in chat completions (#33606)
|
2026-08-19 13:37:50 -07:00 |
|
|
DarkSharpnessandClaude Opus 5
|
746418a1ec
|
[DSA] Trim top-k v2 output modes and tighten its PDL waits (#35041)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-19 13:09:21 -07:00 |
|
|
cctry
|
1c82955861
|
[HiCache] Split the host-memory budget across co-located ranks (#35540)
|
2026-08-19 13:01:58 -07:00 |
|
|
Po-Han Huang (NVIDIA)
|
6f69f927da
|
[Scheduler] Add configurable decode interval after prefill (#35017)
|
2026-08-19 12:01:36 -07:00 |
|
|
MengYuandmenyu
|
4f8ecf6ae9
|
[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend (#29525)
Co-authored-by: menyu <menyu@nvidia.com>
|
2026-08-19 11:52:45 -07:00 |
|
|
YAMY
|
5f12839591
|
[Fix] Support Kimi-K3 ModelOpt mixed NVFP4/FP8 checkpoint (#35077)
|
2026-08-19 08:13:45 -07:00 |
|
|
Shuwen Wangandhzh0425
|
41c018a9ec
|
[UnifiedTree] feat: support runtime attach/detach (#35269)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-08-19 22:49:08 +08:00 |
|
|
Rohit Kumar SinghandSingh
|
3e5ce26c2d
|
fix: fix transcription & audio-understanding for ASR/audio/speech models (#32611)
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
|
2026-08-19 18:44:23 +08:00 |
|
|
|
f446e853e7
|
[AMD] DeepSeek-V4: route decode wo_a bf16 batched matmul to aiter batched_gemm_bf16 (#33313)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-08-19 03:04:48 -07:00 |
|