 Yi ZhangandKe Bao
|
66a7fd5c0b
|
refactor: mamba radix cache server args initialize (#28151)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-06-18 13:02:36 -07:00 |
|
|
Liangsheng Yin
|
8f6d9ef9a5
|
[misc] Drop redundant req_pool_indices_cpu guards; fold hisparse into GLM-5.1 e2e (#28607)
|
2026-06-18 12:51:23 -07:00 |
|
|
Lawrence Wu
|
792cb3a5d0
|
fix: add missing guard for use_jit_ep_activation (#27377)
|
2026-06-18 12:51:09 -07:00 |
|
|
Jimmy Shong
|
97e3b8998d
|
Pass quant_config to attention gate projection (#28649)
|
2026-06-18 20:04:25 +08:00 |
|
|
syy-hw
|
bb9d31f22d
|
[NPU] Add head_dim=256 to _can_use_tnd whitelist (#28635)
|
2026-06-18 17:55:50 +08:00 |
|
|
Estrella-xx
|
2a9cce5d27
|
[NPU] Add MTP support for GLM-4.7-Flash (#28516)
|
2026-06-18 17:54:06 +08:00 |
|
|
Xiaoyu Zhang
|
b7d7dfb4ed
|
[Bugfix] Fix Intern-S1 FP8 expert count lookup (#28629)
|
2026-06-18 17:49:59 +08:00 |
|
|
Cheng Wan
|
67db2ac3e7
|
refactor(runner): unify pp_proxy_tensors forward kwarg into one helper (#28382)
|
2026-06-18 02:23:47 -07:00 |
|
|
cctry
|
fa71064147
|
fix: speculative draft worker clobbering target attention backend (#28559)
|
2026-06-18 01:21:14 -07:00 |
|
|
Mohammad Miadh Angkadandshuwenn
|
59001267c3
|
Fix bench serving base-url-only runs (#28617)
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
|
2026-06-18 00:34:00 -07:00 |
|
|
|
9b10821c8e
|
[NPU] Add Ascend NPU support for DeepSeek-V4 (#25144)
Co-authored-by: khalil2ji3mp6 <khalilzhk@gmail.com>
Co-authored-by: randgun <kelonlu@163.com>
Co-authored-by: t00937989 <tanlei33@huawei.com>
|
2026-06-18 15:30:25 +08:00 |
|
|
Vladislav NosivskoyandZhangheng
|
b7ae7149e8
|
[HiCache] Fix SWA L3 cache miss due to a prefetch/hit len mismatch (#27291)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-06-18 14:55:00 +08:00 |
|
|
kangwangamdandkangwangamd
|
6309fb9abb
|
[AMD] Fix Always mask padded topk_ids on HIP to prevent garbage MoE routing (DeepSeek-R1-MXFP4 accuracy regression) (#28378)
Co-authored-by: kangwangamd <kangwangamd@users.noreply.github.com>
|
2026-06-17 23:39:44 -07:00 |
|
|
Mick
|
3b61dc32c9
|
[diffusion] fix: fix fp8 fused tp scale loading (#28546)
|
2026-06-18 14:38:38 +08:00 |
|
|
cctry
|
7976928c57
|
Abort during chunked prefill + PD peer-liveness abort (#28086)
|
2026-06-17 23:13:28 -07:00 |
|
|
Jimmy Shong
|
d2539980b6
|
[Fix] don't force hybrid-SWA when sliding_window is disabled (#28604)
|
2026-06-17 22:11:27 -07:00 |
|
|
Chandrakant KhandelwalandChandrkant Khandelwal
|
4ee7882a46
|
[XPU] fix(deps): upgrade diffusers to fix fresh installs (#28443)
Co-authored-by: Chandrkant Khandelwal <pavan.sivaram.girijala@intel.com>
|
2026-06-18 12:44:11 +08:00 |
|
|
Liangsheng Yin
|
cf93712937
|
[misc] Share bench HTTP-client base-URL resolution with IPv6-compatible formatting (#28598)
|
2026-06-17 20:50:49 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
3b9db3a1f0
|
[Mamba][GDN] Deduplicate spec conv-window intermediate cache via sliding window layout (#28302)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-17 20:42:31 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
3340f4e3da
|
[GDN][KDA][mem_cache] int8 checkpoint pool for the linear-attn prefix cache (#28185)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-17 20:41:46 -07:00 |
|
|
Cheng Wan
|
53318911ca
|
Add get_parallel(): a structured accessor for parallel-topology state (#28567)
|
2026-06-17 20:23:43 -07:00 |
|
|
Dongjun Na
|
462c01ea6b
|
[observability] add Ray metric backend wrappers (#26252)
Signed-off-by: Dongjun Na <kmu5544616@gmail.com>
|
2026-06-17 19:41:53 -07:00 |
|
|
Liangsheng Yin
|
d2b5488392
|
[misc] Centralize bench launch-vs-connect into a reusable acquire_endpoint (#28592)
|
2026-06-17 19:40:43 -07:00 |
|
|
luoroger37
|
c208a96a7d
|
Fix ScheduleBatch req pool CPU metadata (#28514)
|
2026-06-17 19:25:47 -07:00 |
|
|
Mick
|
05b3fd0f44
|
[diffusion] chore: remove ltx2 snapshot mode (#28533)
|
2026-06-18 10:20:21 +08:00 |
|
|
Liangsheng Yin
|
9888b7b42b
|
[misc] Trim dead code in trtllm_mha page-table backend; reuse eager page-table buffer (#28578)
|
2026-06-17 18:36:22 -07:00 |
|
|
zijiexia
|
74e2e48c82
|
Introduce CpuDeviceMixin and CpuSRTPlatform (#26385)
|
2026-06-17 17:41:17 -07:00 |
|
|
cctry
|
cfa4aa988f
|
Revert "revert the head_dim assignment from PR 23862" (#28583)
|
2026-06-17 17:11:05 -07:00 |
|
|
|
343aeeef39
|
[Model] Laguna: support per-element output gating (#28400)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Jimmy Shong <jimmy.shong@radixark.ai>
|
2026-06-17 17:09:04 -07:00 |
|
|
Mohammad Miadh Angkad
|
d773b49e5b
|
Fix MXFP8 FlashInfer CUTLASS scale selection (#28553)
|
2026-06-17 16:44:23 -07:00 |
|
|
Liangsheng Yin
|
a663500ea9
|
[Test] Fold EAGLE return_hidden_states regression into spec triton suite (#28577)
|
2026-06-17 16:42:02 -07:00 |
|
|
Liangsheng Yin
|
b88bada64e
|
[misc] Unify bench seed default to 42 and rename --profile-filename-prefix to --profile-prefix (#28576)
|
2026-06-17 16:41:23 -07:00 |
|
|
|
5ea0d1d093
|
add dflash gemma4 support (#27471)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-17 16:39:28 -07:00 |
|
|
Jonny Kongandjonnykong
|
cd60c4edd0
|
[attn backend] Make seq_lens_cpu optional in trtllm_mha backend (#28106)
Co-authored-by: jonnykong <jonnykong@fb.com>
|
2026-06-17 16:24:19 -07:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
e4fd613def
|
[Spec] Fix return_hidden_states under spec V2 (issue #26163) (#28496)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-17 16:21:36 -07:00 |
|
|
sglang-botandsglang-bot
|
b1d18d562b
|
chore: bump sglang-kernel version to 0.4.4 (#28572)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-06-17 16:13:39 -07:00 |
|
|
Vladislav NosivskoyandZhiqiang Xie
|
bcf298c28c
|
[HiCache & Bench] add cache hit breakdown in bench_serving (#22053)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-06-17 16:02:30 -07:00 |
|
|
cctry
|
5d6b35eabb
|
revert the head_dim assignment from PR 23862 (#28571)
|
2026-06-17 15:46:28 -07:00 |
|
|
Chetan Kumar Verma
|
732b81d5b9
|
[Fix] DeepSeek-OCR-2 bench_serving: fix processor loading (#28483)
|
2026-06-17 15:29:37 -07:00 |
|
|
Liangsheng Yin
|
e053890b6f
|
[Fix] Reuse an already-running server in bench_one_batch_server instead of forking an orphan (#28563)
|
2026-06-17 15:14:44 -07:00 |
|
|
weireweireandweireweire
|
7fd63f4cf2
|
Remove stale load collection from output streaming hot path (#28408)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-06-17 15:02:20 -07:00 |
|
|
YC Yen-Ching Tseng
|
3b5aae278e
|
Fix EagleDraftExtendInput missing kv_indptr crash with triton/DP attention (#28221)
|
2026-06-17 14:54:33 -07:00 |
|
|
Baizhou ZhangandShijin
|
4b817f5d7f
|
Upgrade fa3 hash (#28394)
Co-authored-by: Shijin <dovis.zhang02@gmail.com>
|
2026-06-17 13:32:11 -07:00 |
|
|
Qiaolin Yu
|
753aa89a83
|
[spec decoding] fix mrope_positions in draft extend (#28464)
|
2026-06-17 13:25:31 -07:00 |
|
|
Lijuan Tang
|
0a28a929dc
|
[MLX] Add Metal profiling hooks to server profiler (#28122)
|
2026-06-17 13:06:20 -07:00 |
|
|
Khoa Pham
|
3c4130c741
|
[Kimi K2.5] Fix eagle3 aux capture for tp>1 when AR fusion is enabled (#28343)
|
2026-06-17 12:59:11 -07:00 |
|
|
Thomas WangandBingxu Chen
|
f5b041622b
|
[AMD] Fix deepseek-v4 mtp accept length issue (#28520)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
|
2026-06-17 11:13:55 -07:00 |
|
|
kousakawangandkousakawang
|
8aaca72c21
|
[FIX]Fix Step3-VL multi-image embedding and local patch splitting (#24970)
Co-authored-by: kousakawang <wanghanpei@bytedance.com>
|
2026-06-17 10:31:32 -07:00 |
|
|
Junlin Wu
|
873196f7fa
|
♻️ [llm][npu][quant] Delegate MXFP8 dense scheme to kernel and use torch.ops.npu (#28505)
|
2026-06-17 10:18:26 -07:00 |
|
|
Mick
|
735a256f98
|
[diffusion] feat: use LocalAttention for mistral3 encoder (#28176)
|
2026-06-17 21:18:41 +08:00 |
|