 fzyzcjy
|
5c440cdc41
|
Lift running_batch / running_mbs access — direct + PP-explicit (#25439)
|
2026-05-16 09:21:00 +08:00 |
|
|
fzyzcjy
|
80c3ce3204
|
Convert forward_pass_device_timer to None-init (#25438)
|
2026-05-16 09:20:31 +08:00 |
|
|
Lianmin ZhengandHanming Lu
|
21e420b4c2
|
[Test] Set default temperature to 0.0 in kl_test_utils (#25429)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2026-05-15 18:20:10 -07:00 |
|
|
fzyzcjy
|
40429248c8
|
Drop dead hasattr guards (hisparse_coordinator, metrics_collector) (#25437)
|
2026-05-16 09:19:56 +08:00 |
|
|
fzyzcjy
|
0071033ff6
|
Cache _linear_attn_registry_cache with sentinel (#25436)
|
2026-05-16 09:19:21 +08:00 |
|
|
fzyzcjy
|
6a1b05d706
|
Replace single-line defensive getattrs with direct access (#25435)
|
2026-05-16 09:18:43 +08:00 |
|
|
fzyzcjy
|
27c3190215
|
Remove fields that are never used in spec/engine/disagg (#25434)
|
2026-05-16 09:18:00 +08:00 |
|
|
fzyzcjy
|
e065445236
|
Remove managers' unused fields (#25433)
|
2026-05-16 09:17:11 +08:00 |
|
|
fzyzcjy
|
33d63aa7e1
|
Remove dead self.adder/can_run_list/running_bs writes in Scheduler._get_new_batch_prefill_raw (#25432)
|
2026-05-16 09:12:39 +08:00 |
|
|
fzyzcjy
|
824ad24149
|
Convert local-only self.X attributes to locals (#25430)
|
2026-05-16 09:05:43 +08:00 |
|
|
Yuhao Yang
|
18c16f8660
|
Port SGLANG_OPT_SWA_EVICT_DROP_PAGE_MARGIN from deepseek_v4_dev (#25419)
|
2026-05-15 17:39:13 -07:00 |
|
|
Brayden Zhongandb8zhong
|
d523ae127f
|
Fix Mistral Large 3 nightly test (#25407)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-15 17:28:35 -07:00 |
|
|
|
5ba69f50fb
|
Add multi-detokenizer support (#24944)
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-15 17:26:26 -07:00 |
|
|
Hanming Lu
|
afc7c9f7f3
|
[TRTLLM/SWA/Spec] fix trtllm mha + swa + spec accept length drop (#25103)
|
2026-05-15 17:15:31 -07:00 |
|
|
jasonjk-park
|
3c2956d880
|
Add extension points on SpeculativeAlgorithm for custom spec v2 (#24999)
|
2026-05-15 15:45:31 -07:00 |
|
|
Xinyuan Tong
|
7cb4669a04
|
[Fix] DeepSeek-V3.2: build structural tag locally to encode both wrapper and invoke layers (#25233)
|
2026-05-15 14:32:50 -07:00 |
|
|
Liangsheng Yin
|
494ee71189
|
split test_dsa_models_mtp into 4 files (#25318)
|
2026-05-15 14:16:57 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
54221dd998
|
feat(moe): reuse prev-layer output as symm_output for FP4 routed MoE (#25379)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-15 12:05:40 -07:00 |
|
|
Alex Nails
|
4df42da658
|
Introduce CudaDeviceMixin and CudaSRTPlatform (#24096)
|
2026-05-15 10:59:02 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
ee93795476
|
perf(mla): hybrid Triton fused cat+FP8-quantize for MLA chunked-prefill K/V (#25333)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-15 10:51:00 -07:00 |
|
|
Kai-Hsun ChenandClaude Opus 4.7
|
17c8a2fa53
|
[Llama4] Use strided in-place fused QK RMSNorm to drop a redundant copy (#25089)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-15 10:33:08 -07:00 |
|
|
Zhangheng
|
21b3ac52b4
|
[UnifiedTree]: Fix UnifiedRadixCache device match semantics with HiCache (#25277)
|
2026-05-16 00:40:55 +08:00 |
|
|
Cheng Wan
|
3f7e538b2f
|
Add NPU condition for cosine and sine caching (#25399)
|
2026-05-15 05:21:53 -07:00 |
|
|
Chi McIsaac
|
20123e0b16
|
[diffusion] fix: mount Cache-DiT before torch.compile in native denoising (#25328)
|
2026-05-15 18:08:39 +08:00 |
|
|
zhaochen zhang
|
12408ec668
|
[Disagg] Add retry with exponential backoff for prefill bootstrap reg… (#25125)
|
2026-05-15 16:38:51 +08:00 |
|
|
|
0c19540550
|
[Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
|
2026-05-15 01:04:56 -07:00 |
|
|
shuwennandClaude Opus 4.7
|
66ef97c00f
|
[Lint] Fix Optional[X] = (None,) typo defaults in two dataclasses (#25252)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-15 00:32:40 -07:00 |
|
|
Xiaoyu ZhangandBBuf Codex
|
aaaad9e7c2
|
[Codex] Diffusion tune Hunyuan3D shape export chunks (#24358)
Co-authored-by: BBuf Codex <bbuf-codex@users.noreply.github.com>
|
2026-05-15 15:31:01 +08:00 |
|
|
Chi McIsaac
|
4b6b434dfe
|
[diffusion] fix: fix Z-Image Cache-DiT sequence-parallel override (#25305)
|
2026-05-15 13:25:00 +08:00 |
|
|
WenhaoZhangandniehen6174
|
6cfa4c9c2f
|
[diffusion] fix: respect dit_precision config instead of hardcoded bfloat16 in DenoisingStagge (#24988)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
|
2026-05-15 13:22:24 +08:00 |
|
|
Cheng WanandClaude Opus 4.7
|
ad4994dc1d
|
DeepseekV2MoE: defer shared experts when routed kernel is non-mutating (#25279)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-14 22:20:55 -07:00 |
|
|
|
897587b03a
|
[MUSA]: Add flashinfer sampling backend (#24978)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-05-14 20:23:15 -07:00 |
|
|
|
d9fa84b25b
|
[UnifiedTree]: Support HiCache For DeepSeek_V4 (#24691)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-05-14 20:20:52 -07:00 |
|
|
Liangsheng Yin
|
d89b678d69
|
move dead sglang.test files to test/manual (#25316)
|
2026-05-14 20:02:44 -07:00 |
|
|
YAMY
|
8d5b347edd
|
Support Qwen3.5 NVFP4 MTP DeepEP (#24906)
|
2026-05-15 10:49:14 +08:00 |
|
|
Qiaolin Yu
|
7af4320d67
|
[perf] fix kimi tokenizer to improve ttft (#25265)
|
2026-05-14 19:11:25 -07:00 |
|
|
Cheng Wan
|
dca9ba6321
|
perf(mla): TMA bulk-store set_mla_kv_buffer (up to 12× over baseline) (#25311)
|
2026-05-14 18:23:41 -07:00 |
|
|
|
ba214ef3d3
|
ci: tag-gated nightly migration — foundation + 40 whole-file moves (#24725)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-05-14 16:11:15 -07:00 |
|
|
Liangsheng Yin
|
67096f48bf
|
Revert "[MoE] Decouple Mega MoE from DeepEP backend" (#25317)
|
2026-05-14 16:00:41 -07:00 |
|
|
Charles Chen
|
78408d2300
|
Fix frozen kv MTP crash when bonus_tokens is None (#25204)
|
2026-05-14 15:33:55 -07:00 |
|
|
Liangsheng Yin
|
22dfcdaa04
|
revert flashinfer 0.6.11 bumps (#25310)
|
2026-05-14 15:28:58 -07:00 |
|
|
Yuhao Yang
|
88d3ed7df1
|
Enable SGLANG_OPT_FP8_WO_A_GEMM by default (#25181)
|
2026-05-15 02:09:13 +08:00 |
|
|
Yuhao Yang
|
37f030a0de
|
[MoE] Decouple Mega MoE from DeepEP backend (#24884)
|
2026-05-15 02:01:44 +08:00 |
|
|
Le ZhangandClaude Opus 4.7
|
3fc60e5748
|
[MLX] bench_one_batch: thread --quantization through to MlxModelRunner (#25221)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-14 09:56:42 -07:00 |
|
|
Jae B.
|
90afd680f3
|
[Apple Silicon] [MLX] Auto-detect MLX-format quantization_config dict (#25191)
|
2026-05-14 09:55:37 -07:00 |
|
|
Liangsheng Yin
|
4593bbdf31
|
ci: dynamic partition + LPT from live sglang-ci-stats model (#25263)
|
2026-05-14 02:35:59 -07:00 |
|
|
Xingyu Liu
|
2279b79f35
|
Add --model-config-parser registry for pluggable config formats (#25050)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
|
2026-05-14 01:54:06 -07:00 |
|
|
YAMY
|
4be25f2428
|
fix(disagg): broadcast bootstrap port across multi-node prefill ranks (#24378)
|
2026-05-14 16:39:01 +08:00 |
|
|
|
bc265c5f82
|
[AMD] Add amd jit resolve token ids bench ci (#25210)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
|
2026-05-14 00:13:12 -07:00 |
|
|
|
7b128e143a
|
[AMD] Add amd jit clamp position bench ci (#25209)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
|
2026-05-14 00:03:56 -07:00 |
|