 sglang-botandClaude Opus 4.7
|
0a2615df24
|
chore: add vLLM SPDX copyright headers to ported files (#25182)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-05-13 15:17:30 -07:00 |
|
|
Brayden Zhongandb8zhong
|
1d80a1a9fe
|
Use Cute-DSL NVFP4 quantization kernels (#23745)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-11 00:40:02 -07:00 |
|
|
RunningLeon
|
335dbd60b4
|
Support Intern-S2-Preview (#24875)
|
2026-05-10 22:17:30 +08:00 |
|
|
sky
|
c8bc23522f
|
Refactor: decouple segment tracking from comm registration (#21392)
Signed-off-by: wangfakang <fakangwang@gmail.com>
|
2026-05-06 17:07:58 +08:00 |
|
|
egvenediktovandronnie_zheng
|
83bf5d6869
|
[NPU]TP Communications compression For Qwen3 models for NPU (#20520)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-02 14:29:11 +03:00 |
|
|
Clint
|
87dad74b33
|
Add benchmark/hicache/bench_warm_cache.py for exact warm-cache shared-prefix benchmarking (#24083)
|
2026-04-30 23:48:32 -07:00 |
|
|
Yihao Wang
|
0acc569edd
|
[Bench] extend MMMU answer extractor with explicit-commit patterns (#24084)
|
2026-04-30 19:08:08 -07:00 |
|
|
Yihao Wang
|
903e46d848
|
[Bench] fix bench_hf.py KeyError + reduce print spam + add --limit (#24079)
|
2026-04-29 11:43:37 -07:00 |
|
|
hhwxw
|
d9270b8c6a
|
fix(moe): relocate orphan tuned configs after #23019 (#24004)
|
2026-04-29 02:00:13 -07:00 |
|
|
Xinyuan Tong
|
832b4f59ed
|
[Bench] fix MMMU answer-extraction regex dropping multi-line responses (#23864)
|
2026-04-29 14:48:49 +08:00 |
|
|
Alex NailsandClaude Opus 4.7
|
345fecc547
|
fix(bench): wire request_func in bench_long_context ContextWorkloadGenerator (#23898)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-28 14:45:51 -07:00 |
|
|
Muqi Li
|
69a71219cb
|
feat: tiny improve fp8_gemm tune usage (#23912)
|
2026-04-28 07:47:46 -04:00 |
|
|
Xiaoyu Zhang
|
6fbad22feb
|
Remove smoke wording from tests and comments (#23355)
|
2026-04-28 12:05:27 +08:00 |
|
|
|
6d03861476
|
support Hy3 preview (#23533)
Co-authored-by: pengmeng <pengmeng@tencent.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: russellfeng <russellfeng@tencent.com>
|
2026-04-24 12:03:24 -07:00 |
|
|
Piotr MazurekandPiotr Mazurek
|
6cf0b004ca
|
[MoE] Add LFM2 MoE tuning support + tuned configs for H100/B200/MI325X (#22791)
Co-authored-by: Piotr Mazurek <piotr.mazurek@liquid.ai>
|
2026-04-21 18:32:05 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
48daa831ea
|
[KDA] Fuse gate+cumsum and reuse chunk index for KDA (#23038)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-04-21 17:54:20 +08:00 |
|
|
shuwennandQiaolin-Yu
|
b65799cf83
|
[SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2026-04-20 14:25:04 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
5f7aee726a
|
refactor(moe): de-duplicate triton MoE runner path into shared helpers (#23019)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-17 17:05:13 -07:00 |
|
|
Hubert LuandHAI
|
edaa5973d4
|
[AMD][No-Merge] Simplify fused allreduce + RMSNorm and remove hidden_dim allowlist (#21986)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-04-11 23:47:08 -07:00 |
|
|
satyamk7054andSatyam Kumar
|
059b287e25
|
Add offline auto-tuning for LoRA CSGMV kernel (#20391)
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
|
2026-04-10 13:10:43 -07:00 |
|
|
Aditya SharmaandXinyuan Tong
|
f6e85676b5
|
model: support qwen3-asr (#22073)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-04-07 13:27:05 +08:00 |
|
|
|
2813cb6d9a
|
[New Model] Gemma 4 (#21952)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Pengyu Chen <pychen96@gmail.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Andy Luo <andy.luo@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: adarshxs <adarsh.shirawalmath@gmail.com>
|
2026-04-06 20:24:44 -07:00 |
|
|
Xiaoyu Zhang
|
f3f7711dac
|
Fix Python 3.11 f-string lint error in deepgemm Blackwell benchmark (#22108)
|
2026-04-04 21:15:22 +08:00 |
|
|
harrisonlimh
|
9fa12d605a
|
Add dsv3 router gemm benchmark on blackwell (#17707)
|
2026-04-04 01:18:01 -07:00 |
|
|
Xiaoyu Zhang
|
ee9d922f5a
|
Revert "[Kernel] Fuse temperature + softmax in sampling for decode speedup" (#22046)
|
2026-04-03 21:32:08 +08:00 |
|
|
Mook
|
7a59e05dd1
|
[Kernel] Fuse temperature + softmax in sampling for decode speedup (#20501)
|
2026-04-02 12:46:36 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
03a87068ea
|
[KDA] Fuse scaled_dot_kkt + solve_tril + recompute_w_u for KDA (#21604)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-03-31 20:57:27 -07:00 |
|
|
Polisetty V R K Jyothendra Varma
|
f0303fd07e
|
[Intel GPU] Enable DeepSeek R1 inference on XPU (#18461)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
|
2026-03-29 22:35:59 -07:00 |
|
|
shuwenn
|
c34593f951
|
[HiCache] fix: graceful shutdown of pending async tasks in bench_mix.py (#20276)
|
2026-03-29 00:46:32 -07:00 |
|
|
zhangxiaolei
|
e2b8463c80
|
[fix] qwen3.5 fuse_moe_triton_tune bug (#20232)
|
2026-03-27 19:23:24 -04:00 |
|
|
Yuan Luoandluoyuan.luo
|
f273ba1ccc
|
[KDA] Support CuTeDSL KDA decode kernel (#21203)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-03-25 09:47:09 +08:00 |
|
|
|
c4db64c16b
|
Add Lychee Doc Links Check to Local and CI (#19742)
Co-authored-by: Zijie Xia <zijie_xia@icloud.com>
Co-authored-by: Zijie Xia <zijiexia@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-03-24 13:48:26 -07:00 |
|
|
|
0986bed8e2
|
[HiCache][HybridModel]: Support mamba state offloading & HybridCacheController (#20457)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-03-23 20:02:50 -07:00 |
|
|
Lianmin Zheng
|
104b10f70a
|
refactor: consolidate is_in_ci (jit_kernel, sgl-kernel benchmarks, tests) (#21009)
|
2026-03-20 05:55:36 -07:00 |
|
|
cs-cat
|
22e378af86
|
Fix result writer in tuning_block_wise_kernel.py, and add FP8 kernel config for L40 (#20368)
Signed-off-by: cs-cat <118669451+cs-cat@users.noreply.github.com>
|
2026-03-20 09:28:54 +08:00 |
|
|
|
6b8a6545b2
|
Add Mistral Small 4 (Pixtral) support (#20708)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Alex Nails <alexnails@radixark.ai>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: dbari <dbari@users.noreply.github.com>
|
2026-03-18 14:15:32 -07:00 |
|
|
Yuan Luo
|
9c87e137ee
|
[GDN] Support GDN packed decode (#20627)
|
2026-03-18 13:20:07 +08:00 |
|
|
Xiaoyu Zhang
|
25e38216b6
|
[kernel slimming] Clean many useless sgl-kernel deprecated kernels (#20277)
|
2026-03-14 16:45:54 +08:00 |
|
|
Chongchong Tianandgemini-code-assist[bot]
|
70d4aabe42
|
Add CLI args to conveniently support tuning more models (#12922)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-03-12 23:10:55 -07:00 |
|
|
|
e29305c120
|
[GDN] Add benchmark for sglang gdn prefill (#20428)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Kaixi Hou <kaixih@nvidia.com>
|
2026-03-12 22:25:02 +08:00 |
|
|
Mook
|
abc672e717
|
[Benchmark] use flashinfer bench_gpu_time instead of triton do_bench (#20305)
|
2026-03-12 04:04:30 +00:00 |
|
|
Yuan Luoandluoyuan.luo
|
751c454099
|
Add DeepSeek3.2 and GlmMoeDsa into moe tune (#18876)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-03-10 17:12:58 +08:00 |
|
|
Mohammad Miadh Angkad
|
1b76eb9361
|
[Doc] Update version references and add automation (#18409)
|
2026-03-04 09:51:46 -08:00 |
|
|
Kangyan-ZhouandClaude Opus 4.6
|
dc92f88a21
|
Enhance bench_multiturn.py with OpenAI API support and richer metrics (#19724)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-03-03 13:48:04 -08:00 |
|
|
RoyWang
|
a1ef8e2cc0
|
[AMD] optimize Kimi K2.5 fused_moe_triton performance by tuning (#19228)
|
2026-02-26 11:50:13 -08:00 |
|
|
|
a0a8f1473c
|
[Benchmark] Fix generated_shared_prefix attribute naming and remove args dependency (#19363)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
|
2026-02-25 18:45:54 -08:00 |
|
|
|
a55f658835
|
[Misc] Normalize --host parameter to use plain hostname without scheme (#19309)
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-02-25 00:37:24 -08:00 |
|
|
Hubert Luandyctseng0211
|
17b0affbdf
|
[AMD] Support --enable-aiter-allreduce-fusion on AMD GPUs (#13747)
Co-authored-by: yctseng0211 <yctseng@amd.com>
|
2026-02-24 23:11:55 -08:00 |
|
|
Ratish PandLiangsheng Yin
|
ae6f6e1495
|
[Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2026-02-24 12:22:01 -08:00 |
|
|
Alec Leng
|
38f25e802d
|
Fix/deepseek readme link (#19258)
|
2026-02-24 10:46:56 -08:00 |
|