 fzyzcjy
|
0fe2dbd42c
|
Split initialize() into orchestration helpers (#31169)
|
2026-07-14 16:09:00 +08:00 |
|
|
Ankith Averineni
|
64a70c9097
|
[AMD] jit_kernel: complete utils.cuh HIP-compat (cudaDevAttr / cudaDeviceGetAttribute) (#31143)
|
2026-07-14 16:06:36 +08:00 |
|
|
fzyzcjy
|
bf04cc9b14
|
Extract cuda-graph setup into a module (#31168)
|
2026-07-14 16:04:45 +08:00 |
|
|
fzyzcjy
|
ed2fcd3201
|
Extract attention-backend setup into a module (#31167)
|
2026-07-14 16:03:48 +08:00 |
|
|
fzyzcjy
|
54f99a21d5
|
Narrow component dependencies to injected fields instead of ModelRunner (#31166)
|
2026-07-14 16:03:07 +08:00 |
|
|
fzyzcjy
|
6999007a13
|
Drop ModelRunner's duplicated parallel-degree fields and read them via self.ps (#31165)
|
2026-07-14 16:02:40 +08:00 |
|
|
fzyzcjy
|
cfd17301a8
|
Extract per-architecture KV-cache pool builders into KVCacheConfigurator (#31163)
|
2026-07-14 16:02:09 +08:00 |
|
|
fzyzcjy
|
d6cf2908ce
|
Introduce KVCacheConfigurator and migrate KV-cache config logic (#31162)
|
2026-07-14 16:01:45 +08:00 |
|
|
fzyzcjy
|
725920915f
|
Introduce ModelRunner.ps ParallelState (#31161)
|
2026-07-14 16:01:14 +08:00 |
|
|
fzyzcjy
|
1dc48c2c3b
|
Absorb capturer setup and extract the shared-mooncake gate (#31160)
|
2026-07-14 16:00:51 +08:00 |
|
|
fzyzcjy
|
08798dba0d
|
Extract MoE/EP setup into a moe_ep_setup module (#31159)
|
2026-07-14 16:00:24 +08:00 |
|
|
fzyzcjy
|
440aebdfe0
|
Extract small single-function helpers into modules (#31158)
|
2026-07-14 16:00:01 +08:00 |
|
|
fzyzcjy
|
17c04602c6
|
Extract spec aux-hidden-state resolution into a module (#31157)
|
2026-07-14 15:59:35 +08:00 |
|
|
fzyzcjy
|
39e508b7fc
|
Extract layer-index setup into a module (#31156)
|
2026-07-14 15:59:07 +08:00 |
|
|
fzyzcjy
|
5b540b16de
|
Extract load_model helpers into a load_model_utils module (#31155)
|
2026-07-14 15:58:40 +08:00 |
|
|
fzyzcjy
|
d15f6a9ac3
|
Introduce NgramEmbeddingManager component (#31154)
|
2026-07-14 15:58:08 +08:00 |
|
|
fzyzcjy
|
0f20f52e5e
|
Introduce RemoteInstanceWeightTransporter component (#31153)
|
2026-07-14 15:57:43 +08:00 |
|
|
fzyzcjy
|
caa85ea022
|
Extract init_torch_distributed and refactor into functions (#31152)
|
2026-07-14 15:56:57 +08:00 |
|
|
fzyzcjy
|
205a2f2de4
|
Move LoRA cuda-graph buffers and logging into LoRAManager (#31151)
|
2026-07-14 15:56:18 +08:00 |
|
|
fzyzcjy
|
e20c346541
|
Extract hybrid-arch helpers into configs.hybrid_arch and ModelConfig (#31150)
|
2026-07-14 15:55:32 +08:00 |
|
|
fzyzcjy
|
c9b4081016
|
Extract expert location updating into EPLBManager (#31149)
|
2026-07-14 15:54:40 +08:00 |
|
|
fzyzcjy
|
6507d4a090
|
Introduce WeightUpdater and WeightExporter components (#31148)
|
2026-07-14 15:53:33 +08:00 |
|
|
fzyzcjy
|
45dfa318fb
|
Extract kv cache dtype configuration into mem_cache (#31147)
|
2026-07-14 15:52:39 +08:00 |
|
|
fzyzcjy
|
cad8fe7a66
|
Extract leaf helpers out of ModelRunner into utility modules (#31146)
|
2026-07-14 15:52:03 +08:00 |
|
|
fzyzcjy
|
b1a60ad00d
|
Clean up ModelRunner by renaming effective-token property and remove dead code (#31145)
|
2026-07-14 15:50:53 +08:00 |
|
|
fzyzcjy
|
2cf753c4fe
|
Clarify ModelRunner.dp_size into attn_dp_size (#31142)
|
2026-07-14 15:49:05 +08:00 |
|
|
Zhanghengandispobock
|
afa3c06d1f
|
Using UnifiedRadixTree by default for SWA, Mamba, and DSA models (#30468)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-07-14 15:17:08 +08:00 |
|
|
gjsheu
|
2ced88238a
|
[NPU] [BUGFIX] Fix input parameters of swiglu_oai operator (#30458)
|
2026-07-14 14:16:24 +08:00 |
|
|
|
702bddcee8
|
[Model] Add support for JetBrains' Mellum v2 code generation model (#27375)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-13 22:54:38 -07:00 |
|
|
Yuxuan ZhangandBaizhou Zhang
|
7e229e2a81
|
support GLM-5.2 MTP index sharing with prefill CP (#30992)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-07-13 21:11:27 -07:00 |
|
|
cctry
|
1b4176cc46
|
[PD] Fix optimistic prefill inflight-queue hangs on parked/aborted reqs (#31075)
|
2026-07-13 20:34:44 -07:00 |
|
|
|
78dc581518
|
[bug-fix] Stabilize GLM-5.2 MTP IndexShare across PD and CUDA graph replay (#30839)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 19:37:07 -07:00 |
|
|
YAMY
|
41ad0d9c26
|
Allow prefill breakable CUDA graph for Qwen3.5 via multimodal opt-in allowlist (#30620)
|
2026-07-13 18:39:44 -07:00 |
|
|
|
7431f35fd8
|
Delete CUTLASS FP8 blockwise for SM90 and SM100, move SM120 to JIT and add SwapAB (#30438)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-14 09:31:32 +08:00 |
|
|
Brayden Zhongandroot
|
9756f768a6
|
Refactor FP4 quantization and remove deprecated JIT kernels (#30448)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
|
2026-07-14 09:22:07 +08:00 |
|
|
|
0c01971eeb
|
[Intel GPU] DeepSeek V4 9/N: use sgl-kernel implementation of hadamard_transform on XPU (#28046)
Co-authored-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-07-14 09:21:31 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
e9ef06c560
|
[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:20:59 +08:00 |
|
|
Polisetty V R K Jyothendra Varma
|
e489685509
|
[Intel GPU] DeepSeek V4 5/N: Use sgl-kernel implementation of fused_q_indexer_rope_hadamard_quant to run on XPU (#27873)
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
|
2026-07-14 09:20:50 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
ee464fedc6
|
[Kernel] Migrate scattered MoE kernels to sglang.kernels (RFC #29630, Phase 2.5, 2/7) (#30786)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:03:21 +08:00 |
|
|
Mick
|
33f83011e0
|
fix: fix Kimi-VL encoder parallelism (#30869)
|
2026-07-14 08:44:06 +08:00 |
|
|
|
423b8485fb
|
[Quantization] add humming quantization kernel (#23754)
Co-authored-by: guzekai01 <zekai01@antgroup.com>
Co-authored-by: Julian Huang <huangzhilin.hzl@gmail.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-14 08:42:56 +08:00 |
|
|
|
cfe4eefabb
|
[diffusion] model: support LongLive 2.0 T2V and I2V inference (#27639)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-07-13 17:39:30 -07:00 |
|
|
Mohammad Miadh Angkad
|
2f79d334f2
|
[Bugfix] Fix DeepSeek ForwardFlags across custom op boundary (#30987)
|
2026-07-13 17:19:44 -07:00 |
|
|
Po-Han Huang (NVIDIA)
|
cfc3d0555e
|
Fix ModelOpt NVFP4 scalar scales for merged linears (#29151)
|
2026-07-13 16:14:20 -07:00 |
|
|
hari-hm
|
a909077d22
|
Return top-p/top-k sampling mask/nucleas (#27408)
|
2026-07-13 17:58:51 -05:00 |
|
|
Brayden Zhong
|
0ee236ebdf
|
more fixes for Nemotron 3 parser for tool call and force nonempty content (#30533)
|
2026-07-14 06:50:27 +08:00 |
|
|
zijiexia
|
50ed4c011f
|
Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964)
|
2026-07-13 15:06:08 -07:00 |
|
|
Liangsheng Yin
|
e2728ac504
|
[Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998)
|
2026-07-13 15:30:31 -05:00 |
|
|
Jialin Ouyang
|
47030b28be
|
Fix MockDSV4ModelRunner missing spec_algorithm (#31056)
|
2026-07-13 15:24:28 -05:00 |
|
|
Liangsheng Yinandronhuafeng
|
2ab531cfcf
|
fa3/fa4: sync-free for all backends and phases (#29589)
Co-authored-by: ronhuafeng <ronhuafeng@users.noreply.github.com>
|
2026-07-13 15:09:57 -05:00 |
|