 Liangsheng Yin
|
9888b7b42b
|
[misc] Trim dead code in trtllm_mha page-table backend; reuse eager page-table buffer (#28578)
|
2026-06-17 18:36:22 -07:00 |
|
|
zijiexia
|
74e2e48c82
|
Introduce CpuDeviceMixin and CpuSRTPlatform (#26385)
|
2026-06-17 17:41:17 -07:00 |
|
|
cctry
|
cfa4aa988f
|
Revert "revert the head_dim assignment from PR 23862" (#28583)
|
2026-06-17 17:11:05 -07:00 |
|
|
Liangsheng Yin
|
a663500ea9
|
[Test] Fold EAGLE return_hidden_states regression into spec triton suite (#28577)
|
2026-06-17 16:42:02 -07:00 |
|
|
|
5ea0d1d093
|
add dflash gemma4 support (#27471)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-17 16:39:28 -07:00 |
|
|
Jonny Kongandjonnykong
|
cd60c4edd0
|
[attn backend] Make seq_lens_cpu optional in trtllm_mha backend (#28106)
Co-authored-by: jonnykong <jonnykong@fb.com>
|
2026-06-17 16:24:19 -07:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
e4fd613def
|
[Spec] Fix return_hidden_states under spec V2 (issue #26163) (#28496)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-17 16:21:36 -07:00 |
|
|
cctry
|
5d6b35eabb
|
revert the head_dim assignment from PR 23862 (#28571)
|
2026-06-17 15:46:28 -07:00 |
|
|
Lijuan Tang
|
0a28a929dc
|
[MLX] Add Metal profiling hooks to server profiler (#28122)
|
2026-06-17 13:06:20 -07:00 |
|
|
Thomas WangandBingxu Chen
|
f5b041622b
|
[AMD] Fix deepseek-v4 mtp accept length issue (#28520)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
|
2026-06-17 11:13:55 -07:00 |
|
|
Ziang Li
|
3fb65ebabd
|
[RL] Fix FlashInfer TRTLLM MXFP8 dense weight layout (#28459)
|
2026-06-17 10:33:35 +00:00 |
|
|
Ryan Zzzandzhujunyu
|
8fd1694dd2
|
Deepseek v4: support mixed dtype compression states (#27277)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
|
2026-06-17 00:56:41 -07:00 |
|
|
|
7256ee9871
|
[AMD] Update test_aiter_allgather_amd.py data types alignment between benchmark aiter and custom all-reduce kernel (#27815)
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
|
2026-06-17 00:48:15 -07:00 |
|
|
Michael
|
a2aa51c818
|
[AMD] register 4 2-gpu tests to stage-b-test-2-gpu-large-amd (#28344)
|
2026-06-16 21:58:34 -07:00 |
|
|
Yanbin Jiang
|
093908d4c0
|
[LoRA] Fix chunked SGMV (csgmv) CUDA graph segment replay (#28371)
|
2026-06-16 19:19:07 -07:00 |
|
|
|
37ef295c78
|
[AMD] Feat/dp moe reduce scatter (#28216)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Wang, FangYuan <39615225+At1a8@users.noreply.github.com>
|
2026-06-16 18:12:39 -07:00 |
|
|
jasonjk-park
|
d86a7e7018
|
Custom spec algorithm can handle server args (#28162)
|
2026-06-16 17:13:52 -07:00 |
|
|
Qiaolin Yu
|
2ad00faae1
|
[ci] add kimi nvfp4 nightly tests (#28467)
|
2026-06-16 16:49:51 -07:00 |
|
|
huangtingwei
|
9b4432fe18
|
[HiCache]Asymmetric pool support direct backend (#28446)
|
2026-06-16 13:17:57 -07:00 |
|
|
|
13537f8e20
|
Unskip Marlin NVFP4 tests (#27589)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: shaunkotek <shaunkotek@users.noreply.github.com>
|
2026-06-16 11:58:22 -07:00 |
|
|
feliang-gitandxutizhou
|
92b42c8d8a
|
LPLB: linear-programming load balancer for MoE expert parallelism (#24515)
Co-authored-by: xutizhou <xutingz@nvidia.com>
|
2026-06-16 10:19:42 -07:00 |
|
|
|
265202cda2
|
fix(openai): validate assistant tool call arguments before chat template (#28035)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-06-16 12:21:23 +00:00 |
|
|
Yinghai LuandLianmin Zheng
|
fcca4611fa
|
[CAR] Let custom allreduce support VMM based allocation (#27593)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-16 04:49:05 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
25e696aa8d
|
Fix Stage B CUDA CI (#28367)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-16 02:39:17 -07:00 |
|
|
Wang, FangYuanandThomas Wang
|
a362ba9da3
|
[AMD] Feat: Add prefill context parallel support for deepseek v4 unified kv attention (#27928)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-06-16 02:00:51 -07:00 |
|
|
jacky.cheng
|
149fabcca7
|
[AMD] Fuse sigmoid + mul into single Triton kernel for shared expert gating (#27636)
|
2026-06-16 01:16:58 -07:00 |
|
|
Bingxu Chen
|
0fc2bc4a8b
|
[AMD] Test DeepSeek V4 FlashMLA backend variants nightly (#28290)
|
2026-06-16 01:03:26 -07:00 |
|
|
Baizhou Zhang
|
77f327cb6e
|
[2/n] [CP] Add context parallel strategy abstractions (#27313)
|
2026-06-16 00:20:04 -07:00 |
|
|
Michael
|
72d962be88
|
[AMD] Fix jit-kernel-unit-test-amd: activation.cuh ROCm build + per_token CUDA-only (R165) (#27947)
|
2026-06-15 23:44:26 -07:00 |
|
|
Qiaolin Yuandshuwenn
|
e068355831
|
[spec decoding] supports step 0 in adaptive spec decoding (updating draft kv cache without draft decoding) (#23994)
Co-authored-by: shuwenn <2508695655@qq.com>
|
2026-06-15 22:21:26 -07:00 |
|
|
Shu Wang
|
32685874f3
|
Reenable MNNVL backend for FlashInfer allreduce fusion (#23402)
|
2026-06-15 20:19:15 -07:00 |
|
|
zhangxiaolei
|
063ab89ac1
|
DeepSeek-V4 Online Compress support MTP (#26471)
|
2026-06-15 19:56:07 -07:00 |
|
|
huangtingwei
|
b5bcd76a41
|
[HiCache & JIT Kernel] Refactoring HiCache Write-Back Kernel (#21631)
|
2026-06-15 19:44:27 -07:00 |
|
|
Michael
|
c6d9d73fd6
|
[Spec][test] fix(kv_canary): assert draft-extend-v2 oracle tokens in token_oracle test (#28325)
|
2026-06-15 19:14:09 -07:00 |
|
|
Kangyan-ZhouandClaude Fable 5
|
cad43d3212
|
[CI] Reclaim leaked /dev/shm segments on server startup (#28089)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-15 16:14:08 -07:00 |
|
|
Jia Guo
|
4ed698a491
|
fix(fa3): no NaN embeddings with fa_skip_kv_cache under piecewise CUDA graph (#27343)
|
2026-06-15 13:46:22 -07:00 |
|
|
|
33719cfb31
|
[PD] Optimize SWA allocation (#28085)
Co-authored-by: cctry <cctry@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-15 11:01:55 -07:00 |
|
|
Shangming Cai
|
378e66d248
|
[PD] Remove outdated backend whitelist for decode radix cache (#28238)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-15 22:36:05 +08:00 |
|
|
Trevor Morris
|
20f4272109
|
fix: Fix DSR1 perf regression due to unnecessarily falling back to triton gemm (#28073)
|
2026-06-15 09:45:09 -04:00 |
|
|
iridiumine
|
3df6e2f968
|
[NPU] Add MiMo-V2-Flash manual testcases (#28223)
|
2026-06-15 19:57:49 +08:00 |
|
|
Prajjandprajjwal1
|
441b75ee69
|
[quantization] NVFP4 MoE: split fused w13 gate/up global scales (#27588)
Co-authored-by: prajjwal1 <prajjwal1@protonmail.com>
|
2026-06-14 21:18:36 -07:00 |
|
|
|
0417951a86
|
[Bug Fix] Validate tokenizer-dependent features with skip_tokenizer_init (#27882)
Co-authored-by: Randall <randall@iterationlab.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-14 20:07:52 -07:00 |
|
|
Lianmin Zheng
|
f18d38d040
|
Revert "[AMD][Quantization] Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs" (#28213)
|
2026-06-14 13:34:06 -07:00 |
|
|
|
d72314808f
|
[JIT Kernel] Multi-GPU test/bench framework for custom all-reduce + TP QKNorm (#26706)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: ziyi.xu <ziyi.xu@radixark.ai>
|
2026-06-14 17:20:36 +08:00 |
|
|
Humphrey
|
8c334e2224
|
fix(io_struct): index extra_key per sub-request in batched GenerateReqInput (#26971)
|
2026-06-14 00:50:38 -07:00 |
|
|
Jimmy Shongandgithub-actions[bot]
|
54acffc864
|
Eval accuracy gpqa aime25 mixins (#27102)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2026-06-14 00:49:12 -07:00 |
|
|
Qiaolin Yu
|
f293ddf3ce
|
[perf] reduce overhead of fill_ids list reconstruction and decref (#27965)
|
2026-06-14 00:41:11 -07:00 |
|
|
Yongji Wu
|
f2d7d67603
|
numa: bind within allowed CPUs when affinity is already constrained (#26983)
|
2026-06-14 00:38:40 -07:00 |
|
|
|
b796338271
|
Fix prefill delayer wait histograms always observing 0 (#25975)
Co-authored-by: kingjameschan <170807154+kingjameschan@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Humphrey <181440142+humphreysun98@users.noreply.github.com>
|
2026-06-14 00:35:29 -07:00 |
|
|
David Wang
|
8c5320b37e
|
dflash add sliding window attention draft layer support (#27469)
|
2026-06-14 00:32:02 -07:00 |
|