 Liangsheng Yin
|
ce1736fcc6
|
[Spec] Remove dead kernel params; fix stale comment in trtllm_mla (#25010)
|
2026-05-11 14:50:46 -07:00 |
|
|
Bruce Changlong Xu
|
d3edfb579b
|
[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995)
|
2026-05-11 14:20:22 -07:00 |
|
|
Jia Guo
|
da0eeb82f2
|
perf: add --prefill-only-disable-kv-cache to skip KV pool allocation (#23675)
|
2026-05-11 13:10:24 -07:00 |
|
|
Liangsheng Yin
|
c7e53e68a2
|
[Spec] Fix ngram metric off-by-1 in num_accepted_drafts_per_req_cpu (#24965)
|
2026-05-11 12:25:18 -07:00 |
|
|
Yan Ru Pei
|
4b6f776889
|
feat(kv-events): publish SWA radix cache events (#24718)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-05-11 10:31:45 -07:00 |
|
|
TianheandClaude Sonnet 4.6
|
95985f983d
|
feat(trace): support SGLANG_TRACE_LEVEL env var for startup trace level (#24716)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-05-11 10:31:03 -07:00 |
|
|
Bingxu ChenandCursor Agent
|
aeb8fefc25
|
[AMD] Pin cache-dit==1.3.0 in rocm.Dockerfile + AMD CI install script (#24924)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2026-05-11 22:32:13 +08:00 |
|
|
Mick
|
6d30b571b2
|
[diffusion] fix: fix single-step flow-match timesteps (#24708)
|
2026-05-11 18:09:24 +08:00 |
|
|
iridiumineandiridiumine
|
df441b8fea
|
[NPU] Support shared expert dual stream optimization (#23827)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
|
2026-05-11 15:50:15 +08:00 |
|
|
Brayden Zhongandb8zhong
|
1df9edcd01
|
Use Torch torch.mm for Deepseek V3.2 Indexer GEMM (#23856)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-11 00:41:05 -07:00 |
|
|
Brayden Zhongandb8zhong
|
1d80a1a9fe
|
Use Cute-DSL NVFP4 quantization kernels (#23745)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-11 00:40:02 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
044bb88a97
|
fix: SGLANG_RADIX_FORCE_MISS chunk-cache passthrough (#24950)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-11 00:07:46 -07:00 |
|
|
Bingxu Chenandbingxche
|
3ffb37789a
|
[AMD] Fix DeepSeek import cascade by supporting both pre- and post-#2958 aiter fused_qk_rmsnorm APIs (#24799)
Co-authored-by: bingxche <cursoragent@cursor.com>
|
2026-05-10 23:41:57 -07:00 |
|
|
Liangsheng Yin
|
faad02b3dd
|
spec: centralize EagleDraft{,Extend}Input.hidden_states shape (#24926)
|
2026-05-10 22:49:20 -07:00 |
|
|
Mick
|
6e5b4de01a
|
[diffusion] fix: further align ltx2.3 accuracy with tp (#24660)
|
2026-05-11 13:42:08 +08:00 |
|
|
Thomas
|
ed70226ec1
|
[Diffusion][NPU][GPU] Fix SANA model execution error (#24798)
|
2026-05-11 08:41:36 +03:00 |
|
|
Артем Савкинandronnie_zheng
|
9ec2880eca
|
[NPU] [Bugfix] Wan quantization fix (#24540)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-11 08:32:57 +03:00 |
|
|
Yuwei AnandClaude Opus 4.7
|
5207f074a4
|
Breakable Cuda Graph Support for bs > 1 (#24662)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-11 13:28:49 +08:00 |
|
|
Ming Yang
|
8e2142c15a
|
[MoE] Fix NaN in flashinfer TRT-LLM A2A dispatch by sanitizing padding slots (#24850)
|
2026-05-10 21:57:43 -07:00 |
|
|
Tejas Dharamsi
|
a6f359d103
|
[Rerank] Use heapq.nlargest for top_n to avoid full sort (#24871)
|
2026-05-10 21:48:37 -07:00 |
|
|
|
36c93fc6fb
|
[NPU] [Diffusion] Use fused operator to improve Wan model E2E performance. (#24028)
Co-authored-by: gengjinsong <gengjinsong@huawei.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gengjinsong <904939979@qq.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-05-11 07:17:31 +03:00 |
|
|
iridiumineandiridiumine
|
09a4828db9
|
[NPU] Fix warmup error with --disable-cuda-graph and mtp (#23819)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
|
2026-05-11 09:53:34 +08:00 |
|
|
McZyWu
|
4435a23a51
|
[NPU]adapt multibatch fia ops (#20177)
|
2026-05-11 09:44:14 +08:00 |
|
|
silencejade
|
407665a7d4
|
[NPU] Fix mrope_position computation in Eagle Worker v2 with PlanStream (#23423)
|
2026-05-11 09:43:37 +08:00 |
|
|
silencejade
|
0fc9598b3e
|
[NPU] Support radix-cache with mamba-extra-buffer for Qwen3.5 (#23891)
|
2026-05-11 09:40:44 +08:00 |
|
|
Jimmy Shong
|
e9a15b95da
|
[Fix] Disable FlashInfer allreduce fusion under deterministic inference (#24629)
|
2026-05-10 20:04:52 -05:00 |
|
|
|
aa7a9af12f
|
fix: STANDALONE spec-decode hidden-size mismatch crash (#24217)
Co-authored-by: root <root@sharp-heart-runs-fin-03.datacrunch.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-05-10 17:48:00 -07:00 |
|
|
Brayden Zhongandb8zhong
|
8acb0270fd
|
Followup fix for Custom AR V2 in non NVL scenarios (#24742)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-10 16:57:46 -07:00 |
|
|
YAMY
|
b202778aa5
|
Fix reduce_scatterv producer contract for SUM_LEN (#24785)
|
2026-05-10 16:51:13 -07:00 |
|
|
|
d82e339ce2
|
[Session R3] Add routed_experts_start_len for absolute routing slice control (#24851)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
Co-authored-by: Yuzhen Zhou <82826991+zyzshishui@users.noreply.github.com>
|
2026-05-10 10:04:43 -07:00 |
|
|
Yihao Wang
|
9150e77399
|
[Model] Add MiniCPM-V 4.6 support (#24855)
|
2026-05-10 12:24:17 -04:00 |
|
|
RunningLeon
|
335dbd60b4
|
Support Intern-S2-Preview (#24875)
|
2026-05-10 22:17:30 +08:00 |
|
|
Ke Bao
|
59faf986b2
|
[PD] Unify dsv4 dispatch with swa (#24888)
|
2026-05-10 22:01:13 +08:00 |
|
|
|
2f06867128
|
Optimize MHC pipeline: DeepGemm, fused norm, fused hc_head (#24775)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
|
2026-05-10 19:03:37 +08:00 |
|
|
Yuhao YangandCheng Wan
|
bd0aa22309
|
Fix PD bootstrap failure handling (#24772)
Co-authored-by: Cheng Wan <chwan@rice.edu>
|
2026-05-10 19:02:47 +08:00 |
|
|
Liangsheng Yin
|
8cc16c9974
|
[Spec] Cleanup idle stub and shape-check patterns (#24881)
|
2026-05-10 02:39:53 -07:00 |
|
|
|
c7f674e427
|
[Bug] Add dsv4 state_type branch to mooncake disaggregation (#24878)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-10 01:13:46 -07:00 |
|
|
Liangsheng Yin
|
d08744238a
|
[Spec V1] Split draft-extend phase from EagleDraftInput into new EagleDraftExtendInput (#24859)
|
2026-05-10 01:07:45 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
d3fd91ed97
|
[Gemma4] Optimize Gemm4 with fused Q/K/V RMSNorm + per-expert FP8 ckpt loader (#24696)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-05-10 00:24:12 -07:00 |
|
|
Qiaolin Yu
|
a87fb399de
|
[spec decoding] support kimi-k2.5-eagle3-mla (#24826)
|
2026-05-09 23:57:39 -07:00 |
|
|
shuwenn
|
b4d347e86e
|
[SPEC V2] fix: skip stale state updates in spec-v2 overlap (#23456)
|
2026-05-09 23:56:24 -07:00 |
|
|
|
cfd3fd00d0
|
[RL] Call torch.cuda.empty_cache() for in-place pause mode to avoid OOM (#24854)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 23:36:52 -07:00 |
|
|
Chi McIsaac
|
44efc23a9a
|
[diffusion] CI: add cache-dit CI tests (#19213)
|
2026-05-10 13:38:41 +08:00 |
|
|
|
1e6c6d1f07
|
[Utils] Make request dump robust to unpicklable server_args and large meta_info (#24767)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 21:41:41 -07:00 |
|
|
Stefan HeandBiao He
|
9578ba1b57
|
[Utils] Refactor device cache emptying (#24861)
Co-authored-by: Biao He <biao@Biaos-MacBook-Air.local>
|
2026-05-09 21:28:00 -07:00 |
|
|
|
47483001b6
|
[PrefillDelayer] support NCCL all-gather for cross-DP info sync (#24768)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 21:20:03 -07:00 |
|
|
|
7edb4c3cea
|
[NUMA+Ray] Fix NUMA NVML handle resolution under shuffled CUDA_VISIBLE_DEVICES (#24766)
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-09 21:18:39 -07:00 |
|
|
Liangsheng Yin
|
c95454b341
|
speculative: drop dead params/returns/no-ops (#24865)
|
2026-05-09 15:53:31 -07:00 |
|
|
Charles Chen
|
12f42f2e7e
|
Support Gemma3/4 + Eagle3 (#23976)
|
2026-05-09 13:34:56 -07:00 |
|
|
luchangliandZhangheng
|
8087e07d52
|
[UnifiedRadixTree]: Align cache_empty_result with RadixTree (#24779)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-05-09 23:52:22 +08:00 |
|