|
799584e173
|
fix: get_processor fails when --tokenizer-path lacks model config.json (#25643)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-16 20:25:05 +03:00 |
|
|
feliang-gitandxutizhou
|
92b42c8d8a
|
LPLB: linear-programming load balancer for MoE expert parallelism (#24515)
Co-authored-by: xutizhou <xutingz@nvidia.com>
|
2026-06-16 10:19:42 -07:00 |
|
|
Zhangheng
|
78b6a4fabf
|
[UnifiedTree]: Clean up some unused dead code. (#28389)
|
2026-06-16 21:53:35 +08:00 |
|
|
|
265202cda2
|
fix(openai): validate assistant tool call arguments before chat template (#28035)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-06-16 12:21:23 +00:00 |
|
|
Yinghai LuandLianmin Zheng
|
fcca4611fa
|
[CAR] Let custom allreduce support VMM based allocation (#27593)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-16 04:49:05 -07:00 |
|
|
Wang, FangYuanandThomas Wang
|
a362ba9da3
|
[AMD] Feat: Add prefill context parallel support for deepseek v4 unified kv attention (#27928)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-06-16 02:00:51 -07:00 |
|
|
jacky.cheng
|
149fabcca7
|
[AMD] Fuse sigmoid + mul into single Triton kernel for shared expert gating (#27636)
|
2026-06-16 01:16:58 -07:00 |
|
|
YC Yen-Ching Tseng
|
102392df5b
|
[AMD][Fix] Skip EPLB topk remap when global server args are unset (#28404)
|
2026-06-16 01:13:22 -07:00 |
|
|
Xiaoyu Zhang
|
c5b9106c1a
|
[perf] Use default torch compile mode for Wan2.2 T2V A14B (#28304)
|
2026-06-16 15:45:00 +08:00 |
|
|
Baizhou Zhang
|
77f327cb6e
|
[2/n] [CP] Add context parallel strategy abstractions (#27313)
|
2026-06-16 00:20:04 -07:00 |
|
|
Zhangheng
|
6c908b3a3a
|
[UnifiedTree]: Replace anonymous tuples with NamedTuples in UnifiedRadixCache (#28375)
|
2026-06-16 14:54:04 +08:00 |
|
|
Junlin Wuandronnie_zheng
|
2a8ea70059
|
✨ [llm][npu][quant] Add W8A8 MXFP8 quantization support for Qwen3 Dense on Ascend NPU (#22352)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-16 09:45:18 +03:00 |
|
|
Michael
|
72d962be88
|
[AMD] Fix jit-kernel-unit-test-amd: activation.cuh ROCm build + per_token CUDA-only (R165) (#27947)
|
2026-06-15 23:44:26 -07:00 |
|
|
Liangsheng Yin
|
556cf54d47
|
[Perf] Avoid per-decode-step host sync in min_new_tokens penalty (#28397)
|
2026-06-15 23:32:28 -07:00 |
|
|
jy-song-hubandMick
|
637c9f780b
|
[diffusion] fix: add precision consistency layer (#27088)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-06-16 14:21:01 +08:00 |
|
|
Qiaolin Yuandshuwenn
|
e068355831
|
[spec decoding] supports step 0 in adaptive spec decoding (updating draft kv cache without draft decoding) (#23994)
Co-authored-by: shuwenn <2508695655@qq.com>
|
2026-06-15 22:21:26 -07:00 |
|
|
Thomas Wang
|
800aaefc9e
|
[AMD] Annotate ATOM source for imported v4 unified attention kernels (#28392)
|
2026-06-15 22:12:12 -07:00 |
|
|
iridiumine
|
486ec150d0
|
[NPU] Add NPU fallback for fused Triton gating kernels (#28293)
|
2026-06-16 11:37:05 +08:00 |
|
|
Shu Wang
|
32685874f3
|
Reenable MNNVL backend for FlashInfer allreduce fusion (#23402)
|
2026-06-15 20:19:15 -07:00 |
|
|
shuwenn
|
b23477af44
|
bench: infer tokenizer from serving model info (#28195)
|
2026-06-15 20:03:12 -07:00 |
|
|
zhangxiaolei
|
063ab89ac1
|
DeepSeek-V4 Online Compress support MTP (#26471)
|
2026-06-15 19:56:07 -07:00 |
|
|
huangtingwei
|
b5bcd76a41
|
[HiCache & JIT Kernel] Refactoring HiCache Write-Back Kernel (#21631)
|
2026-06-15 19:44:27 -07:00 |
|
|
Mick
|
a4a8a614b1
|
[diffusion] UX: suppress noisy diffusers torchao warning (#28317)
|
2026-06-16 10:32:21 +08:00 |
|
|
Mick
|
01e45762ba
|
[diffusion] feat: use srt custom allreduce for tp groups (#28324)
|
2026-06-16 09:22:47 +08:00 |
|
|
YAMY
|
b3be2e7402
|
[dsv4] Pad MLA decode q-heads to 64 (not full n_heads) for FlashMLA head64 kernel (#27954)
|
2026-06-15 17:18:10 -07:00 |
|
|
Liangsheng Yin
|
14f6348524
|
[Fix] Demote OpenAIServingResponses init failure log to one-line WARNING (#28349)
|
2026-06-15 16:58:33 -07:00 |
|
|
Hanming Lu
|
81dcb00673
|
[Spec v2] Use decode kernel for TRT-LLM MHA draft extend (#28241)
|
2026-06-15 16:57:08 -07:00 |
|
|
Kangyan-ZhouandClaude Fable 5
|
cad43d3212
|
[CI] Reclaim leaked /dev/shm segments on server startup (#28089)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-15 16:14:08 -07:00 |
|
|
Jia Guo
|
4ed698a491
|
fix(fa3): no NaN embeddings with fa_skip_kv_cache under piecewise CUDA graph (#27343)
|
2026-06-15 13:46:22 -07:00 |
|
|
YAMY
|
f870bf1ed0
|
[dsv4] Prewarm MHC prenorm kernel at startup (#27986)
|
2026-06-15 13:26:26 -07:00 |
|
|
Lianmin ZhengandIan O'Connell
|
7e629a2f8c
|
Allow overriding tokenizer path in benchmark harness (#28280)
Co-authored-by: Ian O'Connell <ianoc@meta.com>
|
2026-06-15 13:07:50 -07:00 |
|
|
|
33719cfb31
|
[PD] Optimize SWA allocation (#28085)
Co-authored-by: cctry <cctry@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-15 11:01:55 -07:00 |
|
|
Shangming Cai
|
378e66d248
|
[PD] Remove outdated backend whitelist for decode radix cache (#28238)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-15 22:36:05 +08:00 |
|
|
Trevor Morris
|
20f4272109
|
fix: Fix DSR1 perf regression due to unnecessarily falling back to triton gemm (#28073)
|
2026-06-15 09:45:09 -04:00 |
|
|
YAMY
|
d5899b95c4
|
fix(qwen3.5): keep CUDA dual-stream overlap (regressed by #25885) (#27868)
|
2026-06-15 09:44:21 -04:00 |
|
|
littleyellowbicycle
|
09e9c4fde3
|
【bugfix】The NPU's forward_dsa_prepare_npu also needs special handling for is_nextn (#28118)
|
2026-06-15 21:31:39 +08:00 |
|
|
Kurkur
|
e985422b2b
|
[Fix][MTP][MM] Fix EAGLE v2 chunked-prefill next-token chain crash on multimodal models due to placeholder tokens (#27863)
|
2026-06-15 21:30:45 +08:00 |
|
|
Mick
|
818808d152
|
[diffusion] optimize: optimize causal conv3d vae padding (#28204)
|
2026-06-15 20:18:08 +08:00 |
|
|
iridiumine
|
3df6e2f968
|
[NPU] Add MiMo-V2-Flash manual testcases (#28223)
|
2026-06-15 19:57:49 +08:00 |
|
|
|
eb349efb14
|
[EPD][BugFix] Fix encode_with_global_cache_mooncake (#28031)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: Michael Qiu <qiudayu.qdy@antgroup.com>
|
2026-06-15 19:47:52 +08:00 |
|
|
|
c4ec39a785
|
[AMD] refactor sparse MLA decode kernel for Deepseek V4 triton backend (#28265)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: yichiche@amd.com <jacky.cheng>
|
2026-06-15 03:26:59 -07:00 |
|
|
Thomas Wang
|
da12f36629
|
[AMD] Refactor unified_kv attention metadata to data class and fuse c4/128 out_loc (#28275)
|
2026-06-15 02:59:01 -07:00 |
|
|
Lianmin Zhengandgemini-code-assist[bot]
|
3b419f66da
|
[JIT] Track angle-bracket includes in source hash (#28273)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-06-15 02:58:14 -07:00 |
|
|
Zhonghua Deng
|
2a33724c9b
|
[perf] Reuse a pooled HTTP session for multimodal URL downloads (#28056)
Signed-off-by: Abatom <abzhonghua@gmail.com>
|
2026-06-15 17:47:47 +08:00 |
|
|
McZyWu
|
bf186cf8fc
|
bugfix revise interface get cpu copy for npu mem pool to align with gpu (#27802)
|
2026-06-15 17:24:10 +08:00 |
|
|
Duyi-Wang
|
63df86f5e7
|
[AMD] Skip eplb bookkeeping and topk remap when EPLB is not in use on mori-ep / HIP (#22985) (#28188)
|
2026-06-14 23:00:23 -07:00 |
|
|
Mick
|
578e936d8d
|
[diffusion] feat: persist torch.compile inductor/triton cache across restarts (#28205)
|
2026-06-15 13:34:19 +08:00 |
|
|
|
07b9108348
|
[Diffusion] FLUX: fuse FeedForward GELU into up-proj GEMM (cublasLt epilogue) (#28166)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-15 13:00:26 +08:00 |
|
|
Prajjandprajjwal1
|
441b75ee69
|
[quantization] NVFP4 MoE: split fused w13 gate/up global scales (#27588)
Co-authored-by: prajjwal1 <prajjwal1@protonmail.com>
|
2026-06-14 21:18:36 -07:00 |
|
|
Ryan Zzzandzhujunyu
|
ce9fad7196
|
[Bugfix][DeepSeek-V4] Fix Spec V2 Draft Input ID Dtype for DP Collectives (#28043)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
|
2026-06-14 21:11:53 -07:00 |
|