 hlu1
|
415f64e763
|
Add MambaPool kvcache offloading during retraction (#22493)
|
2026-04-22 08:51:03 +08:00 |
|
|
Qiaolin YuandYuzhen Zhou
|
c560326884
|
[perf] support return_routed_experts with overlap scheduling (#22911)
Co-authored-by: Yuzhen Zhou <82826991+zyzshishui@users.noreply.github.com>
|
2026-04-21 14:42:49 -07:00 |
|
|
Yanbin Jiang
|
4f764dfbb8
|
[Lora] Support LoRA and multi-batch in bench_one_batch_server (#23047)
|
2026-04-21 14:20:11 -07:00 |
|
|
Charles Chen
|
c396e4924b
|
[bug] Fix cache salt and extra keys for prefix cache isolation (#23300)
|
2026-04-21 13:53:24 -07:00 |
|
|
|
e3782d04d2
|
fix: fallback to triton for attention-sink models (flashinfer unsupported) (#23139)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-04-21 13:48:50 -07:00 |
|
|
Liangsheng Yin
|
6c2714f5ae
|
guard adaptive speculative against unsupported configs (#23289)
|
2026-04-21 13:47:34 -07:00 |
|
|
|
5273f11fd8
|
[PD] Resolve missing bootstrap_room problem about fake-decode in load-balance method (#18399)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-04-21 13:47:01 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
48daa831ea
|
[KDA] Fuse gate+cumsum and reuse chunk index for KDA (#23038)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-04-21 17:54:20 +08:00 |
|
|
Alan KaoandClaude Sonnet 4.6
|
8589b92a89
|
[AMD] Fused qk rmsnorm bf16 for amd/Kimi-K2.5-MXFP4 (#23186)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-04-21 02:35:09 -07:00 |
|
|
ybyang
|
fa8993111d
|
Fix: Add token heuristic increment in total_tokens load balancing (#22614)
|
2026-04-21 01:29:33 -07:00 |
|
|
Xiaoyu Zhang
|
0d69012ef8
|
Optimize LTX2 feed-forward tensor parallelism (#23221)
|
2026-04-21 16:29:23 +08:00 |
|
|
|
efa71ce5ab
|
[HiCache]Fix hybrid model move_indices (#22940)
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: flyerming <flyerming@163.com>
|
2026-04-21 00:15:39 -07:00 |
|
|
jianan-gu
|
2cf3ac515b
|
[Diffusion][CPU] Init CPU platform support for SGLang Diffusion (#20816)
|
2026-04-21 14:25:54 +08:00 |
|
|
Liangsheng Yin
|
2b2cad70d6
|
[Refactor] Move radix-cache utils onto RadixKey as methods (#23209)
|
2026-04-20 23:11:58 -07:00 |
|
|
|
a490632416
|
Opt-in strip of thinking tokens from radix cache (#23315)
Co-authored-by: ianliuy <ianl@alumni.usc.edu>
Co-authored-by: Wen-xuan-Xu <lilmeep727@gmail.com>
|
2026-04-20 22:59:50 -07:00 |
|
|
|
a8e3a534a4
|
[Score API] Add Multi-Item Scoring with pre-computed delimiter indices (#22544)
Co-authored-by: Chanh Nguyen <chanhnguyen@gmail.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
|
2026-04-20 22:50:40 -07:00 |
|
|
Shangming Cai
|
a58c7f381e
|
[PD] Fix clip logic when state indices lens are mismatch (#23323)
|
2026-04-21 13:22:20 +08:00 |
|
|
Yuhao Yang
|
5595f6e988
|
Fix trtllm mla chunked-prefill zero-length bug (#22291) (#22688)
|
2026-04-20 22:10:13 -07:00 |
|
|
Liangsheng Yin
|
6cc2eee50d
|
[misc] CI hygiene: enforce __main__ entry, drop silent-skipped tests, fix rerun-test protoc (#23305)
|
2026-04-20 21:16:24 -07:00 |
|
|
Lewisand百麒
|
0d0405273b
|
[Fix] Solve the error lead by _commit_transfer_to_req() when using IntraNode NVLink in PD disaggregation (#23252)
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
|
2026-04-21 11:02:18 +08:00 |
|
|
Ke Bao
|
50fc2c9e23
|
Fix hybrid swa chunked prefill oom (#23174)
|
2026-04-21 10:46:45 +08:00 |
|
|
Zhangheng
|
ab3ce02de9
|
[Hybrid-Cache]: Refactor hybrid_pool_assembler.py (#23243)
|
2026-04-21 10:45:23 +08:00 |
|
|
ishandhananiandjthomson04
|
3c007ee5d4
|
fix(hicache): emit KV events for L2 host cache insertions (#22894)
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
|
2026-04-20 19:07:03 -07:00 |
|
|
ChangLiu0709
|
ac08ebed65
|
[AMD] Resolve Qwen3.5 MTP (speculative decoding) radix cache conflict. (#22908)
|
2026-04-20 18:17:11 -07:00 |
|
|
Liangsheng Yin
|
c7a4ebf3c8
|
[Refactor] Replace page_align_keys helper with RadixKey.page_aligned method (#23107)
|
2026-04-20 18:10:42 -07:00 |
|
|
Tarushii Goel
|
3e367f9bcd
|
[sgl] fix incorrect behavior in cuda graph draft extend (#22832)
|
2026-04-20 16:29:16 -07:00 |
|
|
Tarushii Goel
|
100b0f86dd
|
[sgl] add support for weight update function in spedec (#22088)
|
2026-04-20 16:26:20 -07:00 |
|
|
Tarushii Goel
|
28f3a2d8ed
|
[sgl] multilayereagleworkerv2 fix (#22954)
|
2026-04-20 16:22:16 -07:00 |
|
|
Thomas Wang
|
57ecce9807
|
[AMD] Enable MTP for GLM-5-mxfp4 model (#23219)
|
2026-04-20 16:09:07 -07:00 |
|
|
jsheng_Linkedin
|
575fdc2c4c
|
[CI][LoRA] Drop flaky all-None batch from multi-LoRA parity test (#23287)
|
2026-04-20 14:43:25 -07:00 |
|
|
shuwennandQiaolin-Yu
|
b65799cf83
|
[SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2026-04-20 14:25:04 -07:00 |
|
|
shuwenn
|
dbcf7459b5
|
fix: reset empty prefill batch fullness (#23138)
|
2026-04-20 14:14:00 -07:00 |
|
|
Liangsheng Yin
|
8cb957ccff
|
[Perf] Make EAGLE bigram key an O(1) view on RadixKey (#23106)
|
2026-04-20 12:01:11 -07:00 |
|
|
ShunkangzandShunkang
|
3dc1491c95
|
Support moe_dp_size = 1 for various attention_cp_size (#22003)
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
|
2026-04-20 11:58:19 -07:00 |
|
|
Lee Nau
|
b4bb036b73
|
fix legacy deepep path for flashinfer_cutedsl (#22925)
|
2026-04-20 11:49:33 -07:00 |
|
|
ishandhanani
|
b5d9a86e4c
|
fix: add back priorty as radix cache policy (#23275)
|
2026-04-20 10:04:35 -07:00 |
|
|
Makcum888eandronnie_zheng
|
39c720d1b9
|
[Diffusion][NPU][CI] update perf numbers (#23056)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-04-20 19:34:11 +03:00 |
|
|
Mick
|
9a0fd2ff0c
|
[diffusion] optimize: default to in-memory loading for URL/base64 image inputs (#23118)
|
2026-04-20 23:29:02 +08:00 |
|
|
Mick
|
0be6ab04dd
|
[diffusion] refactor: LTX2.3 code cleanup (#23207)
|
2026-04-20 19:02:05 +08:00 |
|
|
Vladislav Nosivskoy
|
4028a73c10
|
[KV-Events] Fix kv events events publishing for CP (#22983)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
|
2026-04-20 17:34:38 +08:00 |
|
|
|
69eb95f20c
|
[AMD] Pin peft<0.19 in pyproject_other.toml to fix ROCm CI ImportError (#23161)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-04-19 23:43:56 -07:00 |
|
|
Liangsheng Yin
|
a2d30d27fe
|
wait for reap in kill_process_tree (#23213)
|
2026-04-19 23:36:33 -07:00 |
|
|
Bingxu Chen
|
ab936ce694
|
Revert "perf: optimize PCG inductor path for FP8 models (#21734)" (#23159)
Feel free to PR again.
|
2026-04-19 23:32:50 -07:00 |
|
|
Alex Nails
|
10e17cc55e
|
[gRPC] Native gRPC server: proto + Rust crate scaffold + server args (#22736)
|
2026-04-20 12:39:35 +08:00 |
|
|
Baizhou ZhangandClaude Opus 4.6
|
c304d0d64d
|
[Refactor] Deduplicate NSA utils.py into cp_utils.py for context parallel (#22914)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-19 21:35:35 -07:00 |
|
|
Liangsheng Yin
|
eb76aaba88
|
[core] Always-on StreamingSession in UnifiedRadixCache (#23202)
|
2026-04-19 21:19:43 -07:00 |
|
|
ShunkangzandShunkang
|
e389a52cc8
|
Support allreduce fusion with cp (#21249)
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
|
2026-04-19 21:06:00 -07:00 |
|
|
Liangsheng Yin
|
a7276b623e
|
integrate streaming session into UnifiedRadixCache (#23145)
|
2026-04-19 20:47:41 -07:00 |
|
|
|
1cff871c67
|
[Bugfix] Fix DeepEP timeout when compiling DeepGeMM in EP+DP+TP (#23185)
Co-authored-by: Byron Hsu <byronhsu@Byrons-MacBook-Pro.local>
Co-authored-by: Cheng Wan <ch-wan@users.noreply.github.com>
|
2026-04-19 17:36:11 -07:00 |
|
|
Liangsheng Yin
|
d3ce664612
|
move session to python/sglang/srt/session (#23144)
|
2026-04-19 17:34:19 -07:00 |
|