 Ke Bao
|
3c0a6c6987
|
Add page_size and SWA coverage to unified radix cache bench test (#22815)
|
2026-04-14 23:58:05 +08:00 |
|
|
Bi Xue
|
070c6a2489
|
[sgl] perf optimization for eplb (#21232)
|
2026-04-14 22:52:17 +08:00 |
|
|
Ke Bao
|
9f9e0231bb
|
Refactor unified radix cache UT into parameterized test suite (#22812)
|
2026-04-14 22:34:33 +08:00 |
|
|
Jincong Chen
|
6760c790bd
|
[bugfix] avoid attention padding tokens computation in pcg (#17706)
|
2026-04-14 16:08:23 +08:00 |
|
|
MichaelandHaiShaw
|
eab045b2b7
|
[AMD] Add MiniMax-M2.7 accuracy and performance nightly tests (#22722)
Co-authored-by: HaiShaw <hixiao@gmail.com>
|
2026-04-14 00:30:11 -07:00 |
|
|
|
e9d6b9eb2d
|
[HiCache & HybridModel] mooncake backend support DSA & mamba model (#21259)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
|
2026-04-13 18:47:36 -07:00 |
|
|
Liangsheng Yin
|
33a3ba256f
|
Delete dead rematch path in SessionAwareCache.release_session (#22735)
|
2026-04-13 17:02:40 -07:00 |
|
|
Kurt ShusterandYusheng Su
|
ff13dfee45
|
[lora][moe] Virtual experts for LoRA MoE (#22122)
Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
|
2026-04-13 21:19:30 +00:00 |
|
|
Asish Kumar
|
39810762d2
|
fix: use describe mode for SGLang version detection (#22600)
Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>
|
2026-04-13 09:45:45 -07:00 |
|
|
Liangsheng Yin
|
9e6d1c066e
|
TestStreamingSessionAbortLeakRepro: inherit stdout/stderr instead of tempfile (#22668)
|
2026-04-13 00:37:29 -07:00 |
|
|
Liangsheng Yin
|
c775c31cb3
|
Simplify test_chunked_prefill; remove redundant tests (#22652)
|
2026-04-12 20:26:54 -07:00 |
|
|
|
bc59cc0f96
|
[RaidxTree Refactor]: Support Unified HybridRadixTree V2 (#21206)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: xiezhq-hermann <xiezhq@stanford.edu>
|
2026-04-13 10:28:22 +08:00 |
|
|
Ziang Li
|
5593539942
|
[RL] Refactor NVFP4 shuffling/swizzling to in-place replacement (#22204)
|
2026-04-12 19:08:45 -07:00 |
|
|
Liangsheng Yin
|
da6b8e1448
|
Extract pause_resume_in_place kit; rename test_abort to test_scheduler_control (#22647)
|
2026-04-12 18:49:37 -07:00 |
|
|
Lawrence Wu
|
28e40d873c
|
fix(PD): respect pause_generation in disagg event loops (#20908)
|
2026-04-12 18:07:51 -07:00 |
|
|
|
c1ab68b45e
|
fix: streaming session race condition + some metrics (#21875)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-04-12 18:05:23 -07:00 |
|
|
Khoa PhamandClaude Opus 4.6
|
1f8df97054
|
Fix broken streaming response with --incremental-streaming-output (#22549)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-12 15:05:58 -07:00 |
|
|
Wenyao Gao
|
4dfc8e1c3f
|
VLM: support passing --mm-process-config for all models (#18467)
|
2026-04-12 17:08:05 +08:00 |
|
|
Liangsheng Yin
|
f1eb4ca90c
|
Fix streaming session busy check double-counting; add compat CI tests (#22213)
|
2026-04-12 01:48:16 -07:00 |
|
|
Xinyuan Tong
|
3f60df8012
|
[Test] Fix flaky test_function_call_specific by adding strict=True (#22624)
|
2026-04-12 01:22:57 -07:00 |
|
|
Hubert LuandHAI
|
edaa5973d4
|
[AMD][No-Merge] Simplify fused allreduce + RMSNorm and remove hidden_dim allowlist (#21986)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-04-11 23:47:08 -07:00 |
|
|
Alison ShaoandAlison Shao
|
d6c9d9116b
|
[CI] Update B200 est_times to prevent timeouts on slower machine (#22609)
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
|
2026-04-11 21:40:34 -07:00 |
|
|
Kurt Shuster
|
8da1cfb30d
|
[lora][moe] Decoupled LoRA MoE backend with Marlin support (#21858)
|
2026-04-11 14:59:27 -07:00 |
|
|
Liangsheng Yin
|
7ab94e438c
|
[Test] Fix flaky test_function_call_required by adding strict=True (#22586)
|
2026-04-11 02:14:22 -07:00 |
|
|
Baizhou Zhang
|
d14d368191
|
[Kernel] Set sgl_per_token_group_quant_8bit_v2 as default choice (#22467)
|
2026-04-11 01:59:57 -07:00 |
|
|
|
f855a0bde6
|
Introduce CUDA graph debug mode with breakable CUDA graph (#19102)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-04-11 00:36:56 -07:00 |
|
|
YC Yen-Ching TsengandHAI
|
3ce72252de
|
[AMD] Fix Timeout: stage-b-test-2-gpu-large-amd,stage-b-test-1-gpu-large-amd (#22228)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-04-10 22:55:44 -07:00 |
|
|
Khoa PhamandClaude Opus 4.6
|
04bd8e1218
|
[Spec][Ngram] Return token counts in list_external_corpora API (#22471)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-10 21:50:02 -07:00 |
|
|
Baizhou ZhangandClaude Opus 4.6
|
3c46ff2ac5
|
fix: restore CPU flash_attn test to use sgl_kernel directly (#22573)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-10 21:39:20 -07:00 |
|
|
Alex NailsandClaude Opus 4.6
|
8eac618a8d
|
[tokenizer] lazy text accumulation + use deltas directly for streaming (#22548)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-10 21:26:04 -07:00 |
|
|
Xinyuan Tong
|
7c6db40540
|
Fix tool call constrained decoding and parsing for models with native formats (#21593)
|
2026-04-10 20:37:23 -07:00 |
|
|
Liangsheng Yin
|
c2821dfbe9
|
[mem] Introduce PoolStats dataclass; unify pool metrics and token_usage (#22554)
|
2026-04-10 20:35:50 -07:00 |
|
|
Liangsheng Yin
|
6cd183ff6b
|
Remove redundant test_page_size.py (#22571)
|
2026-04-10 20:35:04 -07:00 |
|
|
|
265696b176
|
chore: update CI test est_time values (#22565)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-04-10 18:15:02 -07:00 |
|
|
Alex Nails
|
0af9166474
|
[tokenizer] improve non streaming request processing + some small fixes. (#20310)
|
2026-04-10 15:46:12 -07:00 |
|
|
satyamk7054andSatyam Kumar
|
059b287e25
|
Add offline auto-tuning for LoRA CSGMV kernel (#20391)
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
|
2026-04-10 13:10:43 -07:00 |
|
|
Qiaolin Yuand0xNullPath
|
d8831355a3
|
Fix multi_layer_eagle_worker_v2 draft extend selection, add chain style multi layer mtp test (#22340)
Co-authored-by: 0xNullPath <luyan@nvidia.com>
|
2026-04-10 12:44:52 -07:00 |
|
|
Trevor Morris
|
7dbd0dd9f0
|
MiniMax-M2.5 - Support dp attention, dp reduce scatter, FP4 all gather, AR fusion in prepare_attn (#20067)
|
2026-04-10 12:41:27 -07:00 |
|
|
Yujun Dong
|
8ba9646044
|
Make GDN support non-continuous B/A Tensor input to fix the accuracy regression of Qwen3.5-27B (#22312)
Signed-off-by: cs-cat <118669451+cs-cat@users.noreply.github.com>
|
2026-04-10 18:58:13 +08:00 |
|
|
Lee Nau
|
c554dc5c64
|
Add dedicated FlashInferCuteDslMoE layer for standard-path FP4 MoE (#21339)
|
2026-04-10 01:35:56 -07:00 |
|
|
Yuhao Yang
|
f5fd5ab622
|
add whisper test (#22302)
|
2026-04-10 15:34:53 +08:00 |
|
|
jianan-guandMa Mingfei
|
2ab141547d
|
[CPU] Add apply_routed_scaling_factor_on_output support for biased_grouped_topk fusion (#22413)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-04-10 15:16:05 +08:00 |
|
|
Ethan (Yusheng) Su
|
6d79c60995
|
[Lora] Lora kimi support (#22381)
|
2026-04-09 22:31:53 -07:00 |
|
|
Liangsheng Yin
|
722e25a621
|
Fix SWA eviction boundary and page-align chunked prefill (#22470)
|
2026-04-09 22:09:43 -07:00 |
|
|
|
45b0182205
|
[CI] Update est_time for 64 tests based on actual elapsed times (#22305)
Co-authored-by: Alison Shao <alison.shao@Mac.lan>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
|
2026-04-09 20:31:37 -07:00 |
|
|
Ethan (Yusheng) Su
|
28ef6de091
|
[Lora] Lora quat info re-factor and support deepseekv3 mla lora (#22323)
|
2026-04-09 14:19:58 -07:00 |
|
|
Lawrence WuandKangyan-Zhou
|
8eb235ab51
|
fix: do not strip whitespace from GLM tool call values (#20543)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2026-04-09 11:14:15 -07:00 |
|
|
YMbmzy
|
8a67fb20ea
|
[Speculative] Support penalty for spec v2 overlap scheduling (#22049)
|
2026-04-09 01:59:04 -07:00 |
|
|
|
19bbaeb3ee
|
[HiSparse]: Add HiSpares-DSA Model's nightly CI (#22425)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-04-09 01:00:55 -07:00 |
|
|
Sundara Raman Ramachandran
|
a64905a7b8
|
[CICD] [prefill-only] Consolidate prefill-only model E2E tests (#22405)
|
2026-04-09 00:54:34 -07:00 |
|