 Rain Jiang
|
ef01618dfb
|
support MPServer and embedded server for granian to enable muti tokenizer worker (#28573)
|
2026-06-18 17:59:12 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
ea407df4b0
|
Use Flashinfer allreduce fusion for MNNVL allreduce for Nemotron (#28346)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-18 17:30:12 -07:00 |
|
|
Michael
|
62ab09a478
|
[AMD] register 2 spec tests to stage-b-test-1-gpu-large-amd (batch-5) (#28558)
|
2026-06-18 16:33:23 -07:00 |
|
|
giang_ng_tr
|
c1067f88d6
|
[AMD][Perf] Tune extend attention block sizes for gfx950 (head_dim > 128) (#27793)
|
2026-06-18 15:16:52 -07:00 |
|
|
Baizhou Zhang
|
e3026ef016
|
[3/N][CP] Implement zigzag CP strategy (#28421)
|
2026-06-18 15:10:30 -07:00 |
|
|
|
9fc9d37f6d
|
Fix spec decoding with grammar in disagg (#24082)
Co-authored-by: jimmy.shong <jimmy.shong@radixark.ai>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Codex <codex@example.com>
|
2026-06-18 14:58:32 -07:00 |
|
|
|
bea282cede
|
[DeepSeek-V4] Fuse UE8M0 scale rounding into FP8 group quantization (#26766)
Co-authored-by: liqichao <liqichao@baidu.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
|
2026-06-18 14:41:56 -07:00 |
|
|
Zhaoyi Li
|
27a374eaef
|
[AMD][CI] Use non-gated Qwen3-8B for MI35x disaggregation tests (#28678)
|
2026-06-18 14:29:35 -07:00 |
|
|
Cheng Wan
|
f83e4d5968
|
refactor(runner): unify eager-forward DP/MLP-sync padding into one helper (#28383)
|
2026-06-18 13:41:30 -07:00 |
|
|
Qiaolin Yu
|
2411737244
|
[spec decoding] fully overlap spec decoding for hybrid linear attention backend (#28579)
|
2026-06-18 13:31:12 -07:00 |
|
|
DovLin
|
cf0afe3223
|
[FA]Add lost params in fa varlen func (#28642)
|
2026-06-18 13:30:20 -07:00 |
|
|
Yi ZhangandKe Bao
|
66a7fd5c0b
|
refactor: mamba radix cache server args initialize (#28151)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-06-18 13:02:36 -07:00 |
|
|
Liangsheng Yin
|
8f6d9ef9a5
|
[misc] Drop redundant req_pool_indices_cpu guards; fold hisparse into GLM-5.1 e2e (#28607)
|
2026-06-18 12:51:23 -07:00 |
|
|
Lawrence Wu
|
792cb3a5d0
|
fix: add missing guard for use_jit_ep_activation (#27377)
|
2026-06-18 12:51:09 -07:00 |
|
|
Xinyuan Tong
|
61a8b42c00
|
docs(minimax-m3): add MMMU-Pro accuracy to B200 benchmark card (#28668)
|
2026-06-18 11:40:56 -07:00 |
|
|
Jimmy Shong
|
f7632ef860
|
[Cookbook] Laguna-M.1: enable FP8 on Blackwell + drop provisional AIME numbers (#28664)
|
2026-06-18 09:23:53 -07:00 |
|
|
Jimmy Shong
|
0eded9e208
|
Add Laguna-M.1 cookbook (#28661)
|
2026-06-18 23:23:53 +08:00 |
|
|
Jimmy Shong
|
97e3b8998d
|
Pass quant_config to attention gate projection (#28649)
|
2026-06-18 20:04:25 +08:00 |
|
|
syy-hw
|
bb9d31f22d
|
[NPU] Add head_dim=256 to _can_use_tnd whitelist (#28635)
|
2026-06-18 17:55:50 +08:00 |
|
|
Estrella-xx
|
2a9cce5d27
|
[NPU] Add MTP support for GLM-4.7-Flash (#28516)
|
2026-06-18 17:54:06 +08:00 |
|
|
Xiaoyu Zhang
|
b7d7dfb4ed
|
[Bugfix] Fix Intern-S1 FP8 expert count lookup (#28629)
|
2026-06-18 17:49:59 +08:00 |
|
|
Cheng Wan
|
67db2ac3e7
|
refactor(runner): unify pp_proxy_tensors forward kwarg into one helper (#28382)
|
2026-06-18 02:23:47 -07:00 |
|
|
Douglas Yang
|
105e095e00
|
[Docker] Fix cu12 dev image build: pin torch reinstall + JIT-fallback for missing x86 cubins (#28632)
|
2026-06-18 10:51:57 +02:00 |
|
|
Zhanghengandispobock
|
867707f1f2
|
[UnifiedTree]: move some kl test from base to extra stage (#28627)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-06-18 01:39:46 -07:00 |
|
|
cctry
|
fa71064147
|
fix: speculative draft worker clobbering target attention backend (#28559)
|
2026-06-18 01:21:14 -07:00 |
|
|
Mohammad Miadh Angkadandshuwenn
|
59001267c3
|
Fix bench serving base-url-only runs (#28617)
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
|
2026-06-18 00:34:00 -07:00 |
|
|
|
9b10821c8e
|
[NPU] Add Ascend NPU support for DeepSeek-V4 (#25144)
Co-authored-by: khalil2ji3mp6 <khalilzhk@gmail.com>
Co-authored-by: randgun <kelonlu@163.com>
Co-authored-by: t00937989 <tanlei33@huawei.com>
|
2026-06-18 15:30:25 +08:00 |
|
|
zijiexiaandClaude Opus 4.8
|
3f66873304
|
[Docs] DeepSeek-V4 cookbook: drop --disable-flashinfer-autotune from GB300 Flash low-latency (#28590)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-18 00:05:21 -07:00 |
|
|
Vladislav NosivskoyandZhangheng
|
b7ae7149e8
|
[HiCache] Fix SWA L3 cache miss due to a prefetch/hit len mismatch (#27291)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-06-18 14:55:00 +08:00 |
|
|
DovLin
|
0188c54fbe
|
[FA3] Add unit test for only_qv (NoPE) KV decode path (#28595)
Signed-off-by: Shijin Zhang <dovis.zhang02@gmail.com>
|
2026-06-17 23:41:44 -07:00 |
|
|
kangwangamdandkangwangamd
|
6309fb9abb
|
[AMD] Fix Always mask padded topk_ids on HIP to prevent garbage MoE routing (DeepSeek-R1-MXFP4 accuracy regression) (#28378)
Co-authored-by: kangwangamd <kangwangamd@users.noreply.github.com>
|
2026-06-17 23:39:44 -07:00 |
|
|
Mick
|
3b61dc32c9
|
[diffusion] fix: fix fp8 fused tp scale loading (#28546)
|
2026-06-18 14:38:38 +08:00 |
|
|
Michael
|
5d1949152d
|
[AMD] ci: add extra-a 1-gpu-large tier (fp8kv-triton, streaming-session, spec-standalone) (#28458)
|
2026-06-17 23:31:32 -07:00 |
|
|
Michaelandmichaelzhang-ai
|
0e5a66dca4
|
[AMD] Register 3 JIT kernel unit tests for AMD CI (#27837)
Co-authored-by: michaelzhang-ai <michaelzhang@example.com>
|
2026-06-17 23:28:56 -07:00 |
|
|
Ryan Zzzandzhujunyu
|
b55cf4382d
|
docs: add DeepSeek-V4 compressed state dtype tip (#28613)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
|
2026-06-17 23:22:22 -07:00 |
|
|
cctry
|
7976928c57
|
Abort during chunked prefill + PD peer-liveness abort (#28086)
|
2026-06-17 23:13:28 -07:00 |
|
|
Jimmy Shong
|
d2539980b6
|
[Fix] don't force hybrid-SWA when sliding_window is disabled (#28604)
|
2026-06-17 22:11:27 -07:00 |
|
|
Chandrakant KhandelwalandChandrkant Khandelwal
|
4ee7882a46
|
[XPU] fix(deps): upgrade diffusers to fix fresh installs (#28443)
Co-authored-by: Chandrkant Khandelwal <pavan.sivaram.girijala@intel.com>
|
2026-06-18 12:44:11 +08:00 |
|
|
Mohammad Miadh Angkad
|
8d4a22c5af
|
[Docs] Add fp8 kv cache for tokenspeed mla docs (#28201)
|
2026-06-17 21:42:00 -07:00 |
|
|
Liangsheng Yin
|
cf93712937
|
[misc] Share bench HTTP-client base-URL resolution with IPv6-compatible formatting (#28598)
|
2026-06-17 20:50:49 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
3b9db3a1f0
|
[Mamba][GDN] Deduplicate spec conv-window intermediate cache via sliding window layout (#28302)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-17 20:42:31 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
3340f4e3da
|
[GDN][KDA][mem_cache] int8 checkpoint pool for the linear-attn prefix cache (#28185)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-17 20:41:46 -07:00 |
|
|
Cheng Wan
|
53318911ca
|
Add get_parallel(): a structured accessor for parallel-topology state (#28567)
|
2026-06-17 20:23:43 -07:00 |
|
|
siyu
|
d27d8b24de
|
fix (#28597)
|
2026-06-17 20:03:23 -07:00 |
|
|
Dongjun Na
|
462c01ea6b
|
[observability] add Ray metric backend wrappers (#26252)
Signed-off-by: Dongjun Na <kmu5544616@gmail.com>
|
2026-06-17 19:41:53 -07:00 |
|
|
Liangsheng Yin
|
d2b5488392
|
[misc] Centralize bench launch-vs-connect into a reusable acquire_endpoint (#28592)
|
2026-06-17 19:40:43 -07:00 |
|
|
luoroger37
|
c208a96a7d
|
Fix ScheduleBatch req pool CPU metadata (#28514)
|
2026-06-17 19:25:47 -07:00 |
|
|
Mick
|
05b3fd0f44
|
[diffusion] chore: remove ltx2 snapshot mode (#28533)
|
2026-06-18 10:20:21 +08:00 |
|
|
Liangsheng Yin
|
9888b7b42b
|
[misc] Trim dead code in trtllm_mha page-table backend; reuse eager page-table buffer (#28578)
|
2026-06-17 18:36:22 -07:00 |
|
|
sglang-botandsglang-bot
|
1981464ba4
|
docs: sync LMSYS SGLang blog cards (#28589)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-06-18 01:23:58 +00:00 |
|