 Xiaoyu ZhangandClaude Fable 5
|
c00131ebaa
|
[Kernel] Migrate linear-attention, MiniMax-sparse and diffusion kernels to sglang.kernels (RFC #29630, Phase 2.5, 6/7) (#30793)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-15 11:21:36 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
ba5be86d42
|
[Kernel] Migrate DSA + DSV4 attention kernels to sglang.kernels (RFC #29630, Phase 2.5, 5/7) (#30792)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-15 11:11:22 +08:00 |
|
|
|
4ae9cc3c81
|
Fix gate stride for 4D decode layouts (#31231)
Co-authored-by: lmzheng <lmzheng@fb.com>
Co-authored-by: michael604work <michael604@meta.com>
|
2026-07-14 20:06:50 -07:00 |
|
|
Lianmin Zheng
|
b4fdce3b63
|
Fix post-capture KV sizing for SWA pools (#31092)
|
2026-07-14 20:06:15 -07:00 |
|
|
Polisetty V R K Jyothendra Varma
|
532cd337ed
|
[Intel GPU] DeepSeek V4 12/N: use sgl-kernel implementation of silu_and_mul_clamp to run on XPU (#28428)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
|
2026-07-15 11:03:53 +08:00 |
|
|
Polisetty V R K Jyothendra VarmaandMa Mingfei
|
46b675ce70
|
[Intel GPU] DeepSeek V4 11/N: support fp8_paged_mqa_logits_triton from sgl-kernel to run on XPU (#28059)
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-07-15 11:03:35 +08:00 |
|
|
Mick
|
43124cdd90
|
fix: fix image benchmark backend parity (#30867)
|
2026-07-15 10:11:22 +08:00 |
|
|
Liangsheng Yin
|
76dc427806
|
[Spec] Single-source num_tokens_per_req derivation and access (#31013)
|
2026-07-14 18:41:08 -07:00 |
|
|
Liangsheng Yin
|
ca0ee3f1a8
|
[Spec] Consolidate spec-worker weight updates into BaseSpecWorker via draft_runners (#31078)
|
2026-07-14 18:39:46 -07:00 |
|
|
weireweireandweireweire
|
a9cf5e68e6
|
[DSV4] Remove per-step seqlen D2H from speculative to make overlap scheduler work (#30365)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-07-14 18:01:22 -07:00 |
|
|
WenhaoZhang
|
90f10cbe26
|
[diffusion] post_training: Add LoRA IPC weight sync via lora_merge mode (#31029)
|
2026-07-15 08:42:54 +08:00 |
|
|
Liangsheng Yin
|
50d1edaa7f
|
[misc] Move SchedulerRecvSkipper into scheduler_components (#31222)
|
2026-07-14 16:35:04 -07:00 |
|
|
paulzhang-tm
|
463a3f4248
|
[Mamba] Support configurable conv-window layouts (#31059)
|
2026-07-14 14:41:10 -07:00 |
|
|
paulzhang-tm
|
08c46e1f1a
|
Add dummy forward batch preparation hook (#31070)
|
2026-07-14 14:30:31 -07:00 |
|
|
|
0d89564d27
|
Support scheduler_recv_interval (recv skipper) under DP-attention (#30457)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-07-14 14:02:58 -07:00 |
|
|
cctryandcctry
|
cb47a68717
|
[PD] Stride KV token->page indices on device before D2H copy (#31173)
Co-authored-by: cctry <cctry@fb.com>
|
2026-07-14 10:08:30 -07:00 |
|
|
hunhokimandHun-ho Kim
|
a5c3e0283f
|
[Bug fix] Account for KV replication fan-out in transfer-byte metrics (#30351)
Co-authored-by: Hun-ho Kim <hunho.kim@samsung.com>
|
2026-07-14 10:08:24 -07:00 |
|
|
Mick
|
04af94d150
|
fix: avoid tilelang cuda runtime pollution (#30870)
|
2026-07-14 22:30:27 +08:00 |
|
|
Peng Xingchen
|
f853293440
|
[NPU] Fix CPU device for node topology probe (#30619)
|
2026-07-14 22:17:54 +08:00 |
|
|
Ma Mingfei
|
31548781e0
|
[CPU] bypass scoring_func argument in topk for cpu device (#31110)
|
2026-07-14 21:48:22 +08:00 |
|
|
Kevin FlansburgandShangming Cai
|
bbb5702a3c
|
fix: avoid double KV release on disaggregated prefill grammar errors (#30937)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-07-14 20:16:58 +08:00 |
|
|
Mick
|
43241b7f3f
|
[diffusion] model: support fal Ideogram V4 Fast and Instant (#31177)
|
2026-07-14 19:51:35 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
ee000f6734
|
[CI] Fix SGLANG_JIT_KERNEL_RUN_FULL_TESTS never activating the nightly full jit-kernel sweep (#31042)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 17:32:29 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
1a35440c4a
|
[Kernel] Migrate generic attention kernels to sglang.kernels (RFC #29630, Phase 2.5, 4/7) (#30789)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 16:53:46 +08:00 |
|
|
fzyzcjy
|
0fe2dbd42c
|
Split initialize() into orchestration helpers (#31169)
|
2026-07-14 16:09:00 +08:00 |
|
|
Ankith Averineni
|
64a70c9097
|
[AMD] jit_kernel: complete utils.cuh HIP-compat (cudaDevAttr / cudaDeviceGetAttribute) (#31143)
|
2026-07-14 16:06:36 +08:00 |
|
|
fzyzcjy
|
bf04cc9b14
|
Extract cuda-graph setup into a module (#31168)
|
2026-07-14 16:04:45 +08:00 |
|
|
fzyzcjy
|
ed2fcd3201
|
Extract attention-backend setup into a module (#31167)
|
2026-07-14 16:03:48 +08:00 |
|
|
fzyzcjy
|
54f99a21d5
|
Narrow component dependencies to injected fields instead of ModelRunner (#31166)
|
2026-07-14 16:03:07 +08:00 |
|
|
fzyzcjy
|
6999007a13
|
Drop ModelRunner's duplicated parallel-degree fields and read them via self.ps (#31165)
|
2026-07-14 16:02:40 +08:00 |
|
|
fzyzcjy
|
cfd17301a8
|
Extract per-architecture KV-cache pool builders into KVCacheConfigurator (#31163)
|
2026-07-14 16:02:09 +08:00 |
|
|
fzyzcjy
|
d6cf2908ce
|
Introduce KVCacheConfigurator and migrate KV-cache config logic (#31162)
|
2026-07-14 16:01:45 +08:00 |
|
|
fzyzcjy
|
725920915f
|
Introduce ModelRunner.ps ParallelState (#31161)
|
2026-07-14 16:01:14 +08:00 |
|
|
fzyzcjy
|
1dc48c2c3b
|
Absorb capturer setup and extract the shared-mooncake gate (#31160)
|
2026-07-14 16:00:51 +08:00 |
|
|
fzyzcjy
|
08798dba0d
|
Extract MoE/EP setup into a moe_ep_setup module (#31159)
|
2026-07-14 16:00:24 +08:00 |
|
|
fzyzcjy
|
440aebdfe0
|
Extract small single-function helpers into modules (#31158)
|
2026-07-14 16:00:01 +08:00 |
|
|
fzyzcjy
|
17c04602c6
|
Extract spec aux-hidden-state resolution into a module (#31157)
|
2026-07-14 15:59:35 +08:00 |
|
|
fzyzcjy
|
39e508b7fc
|
Extract layer-index setup into a module (#31156)
|
2026-07-14 15:59:07 +08:00 |
|
|
fzyzcjy
|
5b540b16de
|
Extract load_model helpers into a load_model_utils module (#31155)
|
2026-07-14 15:58:40 +08:00 |
|
|
fzyzcjy
|
d15f6a9ac3
|
Introduce NgramEmbeddingManager component (#31154)
|
2026-07-14 15:58:08 +08:00 |
|
|
fzyzcjy
|
0f20f52e5e
|
Introduce RemoteInstanceWeightTransporter component (#31153)
|
2026-07-14 15:57:43 +08:00 |
|
|
fzyzcjy
|
caa85ea022
|
Extract init_torch_distributed and refactor into functions (#31152)
|
2026-07-14 15:56:57 +08:00 |
|
|
fzyzcjy
|
205a2f2de4
|
Move LoRA cuda-graph buffers and logging into LoRAManager (#31151)
|
2026-07-14 15:56:18 +08:00 |
|
|
fzyzcjy
|
e20c346541
|
Extract hybrid-arch helpers into configs.hybrid_arch and ModelConfig (#31150)
|
2026-07-14 15:55:32 +08:00 |
|
|
fzyzcjy
|
c9b4081016
|
Extract expert location updating into EPLBManager (#31149)
|
2026-07-14 15:54:40 +08:00 |
|
|
fzyzcjy
|
6507d4a090
|
Introduce WeightUpdater and WeightExporter components (#31148)
|
2026-07-14 15:53:33 +08:00 |
|
|
fzyzcjy
|
45dfa318fb
|
Extract kv cache dtype configuration into mem_cache (#31147)
|
2026-07-14 15:52:39 +08:00 |
|
|
fzyzcjy
|
cad8fe7a66
|
Extract leaf helpers out of ModelRunner into utility modules (#31146)
|
2026-07-14 15:52:03 +08:00 |
|
|
fzyzcjy
|
b1a60ad00d
|
Clean up ModelRunner by renaming effective-token property and remove dead code (#31145)
|
2026-07-14 15:50:53 +08:00 |
|
|
fzyzcjy
|
2cf753c4fe
|
Clarify ModelRunner.dp_size into attn_dp_size (#31142)
|
2026-07-14 15:49:05 +08:00 |
|