 dongjiyingdjyandShunkang
|
8b4c364960
|
refactor context parallel state (#17213)
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
|
2026-02-13 23:18:17 +08:00 |
|
|
Ke Bao
|
eacab2868a
|
Adjust mamba cache allocation (#18786)
|
2026-02-13 18:06:23 +08:00 |
|
|
|
d97eb111a3
|
Support LingV2_5 model (#18598)
Co-authored-by: zhangkaihong.zkh <zhangkaihong.zkh@antgroup.com>
Co-authored-by: 有禾 <zhangdonghao.zdh@antgroup.com>
Co-authored-by: yudian0504 <138860534+yudian0504@users.noreply.github.com>
Co-authored-by: 悠扬 <youyang.zmy@antgroup.com>
Co-authored-by: xinxingyang <xinxing.yangxx@antgroup.com>
Co-authored-by: zmy460290 <zmy460290@antgroup.com>
|
2026-02-13 16:09:15 +08:00 |
|
|
Yuwei An
|
2bd8363486
|
[PCG] GPT OSS Triton Kernel Support (#18405)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2026-02-12 09:23:55 +08:00 |
|
|
Lianmin Zheng
|
5875ef0a34
|
Clean up noisy startup log messages and refactor loader.py (#18531)
|
2026-02-11 16:12:57 -08:00 |
|
|
Piotr Mazurek
|
ded068a76e
|
Add LMF2 MoE model architecture (#17997)
|
2026-02-12 01:03:43 +08:00 |
|
|
Zehuan Li
|
26f2b3798d
|
[DLLM] Basic dLLM scheduling strategy and implementation (#17484)
Signed-off-by: Zehuan Li <lizehuan.lzh@antgroup.com>
|
2026-02-10 16:54:15 +08:00 |
|
|
Zheng Liand瑀澈
|
27c447653d
|
model: support Qwen3.5 (#18489)
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
|
2026-02-10 00:27:59 +08:00 |
|
|
Liangsheng Yin
|
875ad6cf35
|
Tiny rename for spec related fileds. (#18468)
|
2026-02-09 00:10:39 -08:00 |
|
|
Shangming Cai
|
bffd765417
|
Refactoring Mooncake TE as a shared distributed component (#17810)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-02-09 10:53:11 +08:00 |
|
|
Zack Yu
|
d71ccd8860
|
fix: sync server_args.kv_cache_dtype when detecting FP8 KV cache (#18394)
|
2026-02-08 14:10:59 +08:00 |
|
|
Yuhao Yangandltd0924
|
980d2936cd
|
model: support Step-3.5-Flash (#18084)
Co-authored-by: ltd0924 <ltd0924@sina.com>
|
2026-02-03 00:40:07 +08:00 |
|
|
Xuhao Zhang
|
0537232b05
|
[NPU]mindspore model support moe (#15363)
|
2026-02-02 17:52:49 +08:00 |
|
|
Ke Bao
|
d396650bd2
|
Fix swa kv cache memory allocation (#18039)
|
2026-02-01 14:26:51 +08:00 |
|
|
Bi Xue
|
5d00150e99
|
[sglang] fix mm token padded value overlap with text token id (#17781)
|
2026-01-30 17:09:13 -08:00 |
|
|
Zheng Liandyizhang2077
|
0c5a81acb8
|
[BUGFIX] Fix dp size > 1 for qwen3 vl model (#17624)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2026-01-30 20:44:25 +08:00 |
|
|
Ke Bao
|
77a27e728c
|
Add cuda graph status to prefill log (#17836)
|
2026-01-30 16:56:53 +08:00 |
|
|
R0CKSTAR
|
d3cdee0a04
|
[MUSA][4/N] Add common device utilities, distributed backend, and custom op wiring (#17246)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-01-28 23:13:24 -08:00 |
|
|
|
1b56a886bb
|
[chore]: improve time tracing of model loading process (#15426)
Co-authored-by: Michael Shin <mmshin@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-01-26 19:04:25 -08:00 |
|
|
Ke Bao
|
30ece5e1d6
|
Fix swa memory pool size with spec (#17630)
|
2026-01-25 14:10:43 +08:00 |
|
|
Glen Liu
|
a6280b2a23
|
add documentation example for LoRA overlap loading and cleanup unused function (#17464)
|
2026-01-24 15:33:16 +08:00 |
|
|
McZyWu
|
8a5ed2434f
|
[NPU]support model MiniCPM3-4B for npu (#16866)
|
2026-01-24 08:25:12 +08:00 |
|
|
Nicolas Castet
|
48e9daadff
|
Support symmetric memory pre-allocation to avoid fragmentation (#17089)
|
2026-01-23 17:57:04 +08:00 |
|
|
chenxu214
|
a4dc432587
|
Change naming for graph mode on multiplatform (#17469)
|
2026-01-22 19:25:06 +08:00 |
|
|
Piotr Mazurek
|
d6e2b88288
|
Add Liquid Foundation Model (LFM2) (#16890)
|
2026-01-22 11:11:20 +08:00 |
|
|
Binyao Jiang
|
6092721594
|
[Piecewise] Fix PCG issue for multimodal and embedding model that wraps language_model (#17290)
|
2026-01-20 14:06:06 -08:00 |
|
|
|
20ed3822bb
|
[Auto Sync] Update piecewise_cuda_graph_runner.py (20260119) (#17313)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
|
2026-01-20 14:05:05 -08:00 |
|
|
GuoweiWangU
|
16802fb6b2
|
[FIX] fix mambaish model pp kv cache compute (#17334)
|
2026-01-20 23:59:05 +08:00 |
|
|
|
f7a5e425c3
|
[3/N] Achieve fault tolerance at the DP level (#11657)
Co-authored-by: UNIDY <unidy2002@outlook.com>
Co-authored-by: Hank Han <hanhan7630@outlook.com>
|
2026-01-20 18:47:08 +08:00 |
|
|
Aurick Qiao
|
09a9d214f7
|
Pipe customized_info through CudaGraphRunner output (#17088)
|
2026-01-19 15:48:49 -08:00 |
|
|
Yongfei Xu
|
d2105d4abd
|
[DeepSeek v3.2] Opt MTP decode cuda batch sizes and nsa implementation (#16961)
|
2026-01-19 11:54:11 +08:00 |
|
|
Glen Liu
|
ad1b4e4728
|
[Feature] overlap LoRA weight loading with compute (#15512)
|
2026-01-19 10:43:17 +08:00 |
|
|
Stefan He
|
43779f27b7
|
Disable PCG for draft worker (#16354)
|
2026-01-17 09:56:56 +08:00 |
|
|
Baizhou Zhang
|
8b9e9357fe
|
[2/n] deepseek_v2.py Refactor: Migrate MHA forward method in deepseek_v2.py (#16817)
|
2026-01-17 09:36:25 +08:00 |
|
|
shaharmor98
|
ba625c2d90
|
Feat/support nemotron h mtp (#17013)
Signed-off-by: Shahar Mor <smor@nvidia.com>
|
2026-01-14 16:30:35 +08:00 |
|
|
|
7b682de870
|
[Model] Support IQuest-Coder-40B-Loop (#16348)
Co-authored-by: yxing <yxing@iquestlab.com>
Co-authored-by: yzhu <yzhu@ubiquant.com>
Co-authored-by: zelong518 <zelonghuang02@gmail.com>
|
2026-01-12 23:44:45 +08:00 |
|
|
Yibo Cai
|
2f4a6addf3
|
[cpu/arm64] support run sglang on arm64 cpu (#14867)
|
2026-01-11 04:27:19 -08:00 |
|
|
Yuwei An
|
2a9344d320
|
[tiny remove] remove torch_compile in parallel_state (#16865)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2026-01-10 16:04:25 -08:00 |
|
|
YAMY
|
2d088b85d9
|
[IDLE FORWARD][Indexer] Fix forward_idle bs mismatch issue in DeepseekV3.2's NSAIndexer (#15227)
|
2026-01-10 18:14:30 +08:00 |
|
|
lg(x)andPopSoda2002
|
3a8b44fe89
|
Update LoRA Weights via Tensor (#16226)
Co-authored-by: PopSoda2002 <zhouhp.me@gmail.com>
|
2026-01-10 17:36:43 +08:00 |
|
|
Liangsheng Yin
|
e6d40bff81
|
Revert "feat: reduce constrained-decoding overhead in TP" (#16845)
|
2026-01-10 11:39:38 +08:00 |
|
|
Raayan Dhar
|
76b3c698d6
|
feat: reduce constrained-decoding overhead in TP (#13947)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
|
2026-01-10 00:38:32 +08:00 |
|
|
Junrong Lin
|
eec7dbd31e
|
remove redundant max_running_reqs calculation in r3 (#16629)
|
2026-01-08 09:45:21 +08:00 |
|
|
Ke Bao
|
3aa11ca722
|
Remove hybrid_kvcache_ratio in server args (#16399)
|
2026-01-06 13:13:13 +08:00 |
|
|
Yi Zhang
|
a3914e3b3f
|
[Bugfix] fix some memory computation bugs for qwen3next with mtp (#16138)
|
2026-01-05 23:24:21 +08:00 |
|
|
fzyzcjy
|
1e7b326482
|
Super tiny fix main code (#16432)
|
2026-01-05 10:34:25 +08:00 |
|
|
Mick
|
9a8ba3c189
|
[diffusion] feat: support warmup with resolutions (#16330)
|
2026-01-05 10:16:26 +08:00 |
|
|
Ke Bao
|
76bc07a335
|
Move swa memory pool to a seperate file (#16347)
|
2026-01-04 22:39:30 +08:00 |
|
|
Siyuan ChenandXinyuan Tong
|
9a414b164c
|
[Performance] Optimze the performance of Qwen25VL (#15640)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-01-02 23:15:36 -08:00 |
|
|
sunxxuns
|
8b869e326c
|
[AMD] feat: add DLLM support for AMD GPUs with LLaDA2 testing (#15560)
|
2026-01-03 10:41:11 +08:00 |
|