 zhangxiaolei123456
|
ad1bdb93df
|
perf: add minimax-2.5 fused_moe tuning config for h20 (#18833)
|
2026-02-15 15:46:56 +08:00 |
|
|
jackey hua
|
922fbc21e2
|
[Perf] Tune MiniMax M2 fused moe kernel on H100 GPU (#18851)
|
2026-02-15 15:30:52 +08:00 |
|
|
andyluo7andseungrokj
|
944a9f6fcf
|
Fix/qwen3 5 amd rope cutedsl fallback (#18753)
Co-authored-by: seungrokj <seungrok.jung@amd.com>
|
2026-02-14 22:09:44 -08:00 |
|
|
Bhavneek Singh
|
1ce3420784
|
Model: Support IBM Granite (Dense/Mamba + MoE) (#18040)
|
2026-02-15 11:24:41 +08:00 |
|
|
Lianmin Zhengandgithub-actions[bot]
|
b33769786f
|
[Auto Sync] Update grpc_request_manager.py, tokenizer_manag... (20260214) (#18838)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2026-02-14 18:12:32 -08:00 |
|
|
Guangda LiuandGuangda Liu
|
190fa8246f
|
Fix model loading for DeepSeek-V3.2-AWQ (#16907)
Co-authored-by: Guangda Liu <bingps@users.noreply.github.com>
|
2026-02-15 09:39:53 +08:00 |
|
|
Xiaoyu Zhang
|
c29394e3c8
|
[kernel slimming] Move fast_hadamard_transform to jit_kernel (#18475)
|
2026-02-14 23:06:21 +08:00 |
|
|
Raayan Dhar
|
92cdd398cd
|
feat: Support mrope_section with rope_type: "yarn" (#13313)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
|
2026-02-14 22:51:44 +08:00 |
|
|
ybyang
|
c8aa2a6534
|
Fix dsv32 encode_messages (#18126)
|
2026-02-14 16:44:13 +08:00 |
|
|
Johnsonms
|
34132d6da5
|
Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554)
|
2026-02-14 16:40:15 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
fa0ef6e4f7
|
[VLM][LLM] Optimize fused_moe triton kernel tma (#18782)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-02-14 14:35:26 +08:00 |
|
|
JD
|
f6c18c3a85
|
Fix/partial gen from waiting queue miss metadata (#17610)
|
2026-02-13 19:04:08 -08:00 |
|
|
|
066b0b70d9
|
Handle abort for retracted requests in disagg decode prealloc queue (#18705)
Co-authored-by: sunhailiang <sunhailiang@baidu.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2026-02-13 18:39:39 -08:00 |
|
|
shuwenn
|
bd39de7d5e
|
[Env] centralize hicache vars in environ.py (#17204)
|
2026-02-13 18:02:31 -08:00 |
|
|
Liangsheng Yin
|
4474fb98b4
|
[PD-Disagg] Fix double free when prebuilt batch is aborted. (#18822)
|
2026-02-13 17:46:35 -08:00 |
|
|
Leon Gao
|
ab0fb248fd
|
feat: add SGLANG_DISTRIBUTED_INIT_METHOD_OVERRIDE env var (#18743)
|
2026-02-14 09:37:33 +08:00 |
|
|
Minglei Zhu
|
8be18c655d
|
[Perf] refactor piecewise cuda graph support of Qwen3-Next (#17613)
|
2026-02-14 09:30:50 +08:00 |
|
|
Mohammad Miadh Angkad
|
1be41e9036
|
[FlashInfer] Bump FlashInfer version from 0.6.2 to 0.6.3 (#18448)
|
2026-02-14 07:43:33 +08:00 |
|
|
JD
|
191d354f53
|
fix double-free kv cache for requests that have already finished and been freed during preemption (#18694)
|
2026-02-13 13:17:44 -08:00 |
|
|
|
008ea46af1
|
[Auto Sync] Update loader.py, weight_utils.py (20260213) (#18779)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Xiuyu Li <xiuyu@x.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-02-13 12:22:50 -08:00 |
|
|
Qi Jiaandyizhang2077
|
4c6afbeeaa
|
[bugfix] fix mamba slot leak when scheduling fails with radix cache (#15840) (#16067)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2026-02-13 23:43:57 +08:00 |
|
|
dongjiyingdjyandShunkang
|
8b4c364960
|
refactor context parallel state (#17213)
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
|
2026-02-13 23:18:17 +08:00 |
|
|
Linyu WuandXiaoyu Zhang
|
0012d6a4eb
|
[Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-02-13 22:29:22 +08:00 |
|
|
Kaixi
|
98ad284ebf
|
Added cuda availability guard (#18480)
|
2026-02-13 20:18:34 +08:00 |
|
|
Ke Bao
|
a0ebaa6498
|
Cleanup debug log for Ring model (#18793)
|
2026-02-13 18:36:20 +08:00 |
|
|
Ke Bao
|
eacab2868a
|
Adjust mamba cache allocation (#18786)
|
2026-02-13 18:06:23 +08:00 |
|
|
Yinghai Lu
|
e4b2b57620
|
[schedule] Fix streaming return of customized_info (#18654)
|
2026-02-13 17:19:16 +08:00 |
|
|
|
d97eb111a3
|
Support LingV2_5 model (#18598)
Co-authored-by: zhangkaihong.zkh <zhangkaihong.zkh@antgroup.com>
Co-authored-by: 有禾 <zhangdonghao.zdh@antgroup.com>
Co-authored-by: yudian0504 <138860534+yudian0504@users.noreply.github.com>
Co-authored-by: 悠扬 <youyang.zmy@antgroup.com>
Co-authored-by: xinxingyang <xinxing.yangxx@antgroup.com>
Co-authored-by: zmy460290 <zmy460290@antgroup.com>
|
2026-02-13 16:09:15 +08:00 |
|
|
Shangming Cai
|
1f39bf6523
|
[Bugfix] Add warnings when NSA indexer cache indice mismatch in PD module (#18727)
|
2026-02-13 15:20:05 +08:00 |
|
|
Liangsheng Yin
|
e6f7a372ef
|
Rename request timeout env vars for waiting/running stages (#18766)
|
2026-02-12 22:58:40 -08:00 |
|
|
Liangsheng Yin
|
d29e331491
|
[Spec] Move forward timeout before verify to fix Eagle v1 filter mismatch (#18760)
|
2026-02-12 20:58:34 -08:00 |
|
|
|
7d4ae057ec
|
[Kernel] Add JIT rotary_embedding_kernel (#17934)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: root <root@zhikuan-A10x2.ea134>
|
2026-02-13 12:41:25 +08:00 |
|
|
|
c56a5efbaa
|
[Auto Sync] Update grok.py (20260213) (#18765)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-02-12 18:41:41 -08:00 |
|
|
Lianmin Zheng
|
d5f66fec15
|
Revert changes to weight_utils.py (#18759)
|
2026-02-12 17:15:16 -08:00 |
|
|
|
9815ee934c
|
[Auto Sync] Update weight_utils.py (20260212) (#18692)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Dan Zheng <dzheng@x.ai>
|
2026-02-12 16:26:05 -08:00 |
|
|
Shangming Cai
|
2a8a48c0ca
|
Reuse initialized transfer engine in mooncake store (#18460)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-02-13 01:21:35 +08:00 |
|
|
Yi Zhang
|
b168723424
|
[BUGFIX] fix bug in handle mamba radix cache in server_args (#18723)
|
2026-02-12 21:33:32 +08:00 |
|
|
Simo Lin
|
92c5749f41
|
refactor: replace local proto compilation with smg-grpc-proto package (#18682)
|
2026-02-12 05:29:24 -08:00 |
|
|
Scott Lee
|
c59b9223e6
|
Add spec_accept_histogram request statistic (#18332)
|
2026-02-12 21:09:21 +08:00 |
|
|
|
e20e6c28b9
|
[AMD] Fix accuracy issue when running TP4 dsv3 model with mtp (#18607)
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
|
2026-02-12 01:13:16 -08:00 |
|
|
chenxu214
|
1edc69be08
|
[Ascend]Support qwen3.5 (#18544)
This PR affects only the NPU. If any issues arise, please contact iforgetmyname.
|
2026-02-12 15:22:47 +08:00 |
|
|
JooYeonandjoo_yeon.lee
|
c9297661b9
|
fix: /metrics endpoint always reports engine_type="unified" in PD disaggregation mode (#18552)
Co-authored-by: joo_yeon.lee <joo_yeon.lee@samsung.com>
|
2026-02-12 14:20:43 +08:00 |
|
|
Zheng Li
|
4ed2548427
|
[Qwen3_5] Refactor Qwen3_5ForCausalLMMTP class implementation (#18538)
|
2026-02-12 13:38:26 +08:00 |
|
|
YAMY
|
454676811e
|
[Flashinfer Autotune] Fix FlashInfer FP4 MoE autotuning crash by removing incorrect flatten on hidden_states_scale (#18500)
|
2026-02-12 13:31:27 +08:00 |
|
|
|
20554a0a4f
|
[AMD] rocm 7.2 image release, PR test, Nightly Test (#17799)
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
|
2026-02-11 21:29:25 -08:00 |
|
|
danielafrimi
|
e422bcaed8
|
[Mamba] Add float16 support for SSM cache dtype (#18444)
|
2026-02-12 11:27:47 +08:00 |
|
|
Zhiyu
|
7e262b6496
|
Update modelopt quantization config parsing (#13919)
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
|
2026-02-12 11:08:29 +08:00 |
|
|
Yi Zhong
|
dc1309fc7e
|
Avoid kimi linear stream sync (#16186)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
|
2026-02-12 09:27:22 +08:00 |
|
|
Jiayi Yan
|
539bbf485c
|
[Bugfix] fix config bug caused by PR #18273 (#18535)
|
2026-02-12 09:26:46 +08:00 |
|
|
Yuwei An
|
2bd8363486
|
[PCG] GPT OSS Triton Kernel Support (#18405)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2026-02-12 09:23:55 +08:00 |
|