minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
14,840 Commits 2 Branches 0 Tags
ce733f106b53a977bb2ae5cdadbae072bc47df9a
Commit Graph
10051 Commits
Author SHA1 Message Date
Yuankai ChenandChun Fang ce733f106b [AMD] Fix RMSNorm batch-invariance on ROCm under deterministic inference (#28787) 
Co-authored-by: Chun Fang <chun.fang@amd.com>
 2026-07-04 23:49:06 -07:00
Mick a37bc2456d [diffusion] refactor: consolidate diffusion weight load planning (#30118) 2026-07-05 11:59:50 +08:00
HuangJi 5e6f49c986 [diffusion] feat: add LingBot realtime prompt, KV window, and lazy VAE controls (#30040) 2026-07-05 11:11:54 +08:00
cctry fbe3110866 Make mem_fraction_static reserve disaggregation-mode aware (#29615) 2026-07-04 18:44:06 -07:00
Cheng Wan 754524d8de [Fix] Skip cross-node probe in MultimemAllGatherer on single-node runs (fixes mooncake EP segfault) (#30139) 2026-07-04 15:36:23 -07:00
Cheng Wan 00f088f6be [fix] Wrap the sp_shard test entry point in sys.exit so failures propagate (#30138) 2026-07-04 14:23:40 -07:00
ybyang 63c4996fef fix: populate batch req rids and per-request http_worker_ipc for mult… (#29882) 2026-07-04 12:09:41 -07:00
Xinyuan Tong 854b46be99 feat(parser): resolve special-token suffix at runtime for compatibility (#29920) 2026-07-05 00:13:46 +08:00
Mick 763c6bf372 [diffusion] perf: add unified SP shard helpers and zero-copy tail-pad attention (#30107) 2026-07-04 23:57:39 +08:00
Praneth ParuchuriandMick b7c3709f33 [diffusion] fix: fix z-Image online fp8 quantization crash with dit_cpu_offload (#29903) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-07-04 23:40:43 +08:00
Xiaoyu Zhang 6dd0cefb2a [CI] Revert ModelOpt NVFP4 threshold relax (#29844) 2026-07-04 21:17:32 +08:00
Mick 36fc0093d6 [diffusion] fix: shut down diffusion workers on serve exit (#30110) 2026-07-04 20:42:39 +08:00
Baizhou Zhang e552f6ed75 [Fix] Fix DSA indexer fusion for NeoX RoPE (#30111) 2026-07-04 03:20:55 -07:00
Kaixi 92b800c531 [DSA][GLM5.2] Index Share for MHA (#29959) 2026-07-04 02:50:26 -07:00
Cheng WanandClaude Fable 5 b941e337a4 [refactor] Rename Arg.model_overridable to Arg.resolvable (stack 15/15) (#30077) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:23:01 -07:00
Cheng WanandClaude Fable 5 7ea2284551 [refactor] Migrate the DeepSeek family and the parallel-request chains (stack 14/15) (#30076) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:50 -07:00
Cheng WanandClaude Fable 5 3836cba9ee [refactor] Migrate the moe_runner_backend / quantization resolution chains (stack 13/15) (#30075) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:38 -07:00
Cheng WanandClaude Fable 5 276fbfe880 [refactor] Migrate the page_size resolution chain (stack 12/15) (#30074) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:28 -07:00
Cheng WanandClaude Fable 5 abbb41a214 [refactor] Migrate the attention_backend resolution chain (stack 11/15) (#30073) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:17 -07:00
Cheng WanandClaude Fable 5 5c95bf15c8 [refactor] Add the post-process resolution stage; migrate sampling_backend (stack 10/15) (#30072) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:05 -07:00
Cheng WanandClaude Fable 5 ae29c5a1dc [refactor] Sweep disable_hybrid_swa_memory writers; close the dtype family (stack 9/15) (#30071) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:21:54 -07:00
Cheng WanandClaude Fable 5 4bf4db09f6 [refactor] Add predicate-keyed registration; migrate the Step3p family (stack 8/15) (#30070) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:21:43 -07:00
Cheng WanandClaude Fable 5 8d8f17e28c [refactor] Migrate the first override families: Mistral/Pixtral dtype, MiniMaxM2, MiMoV2 (stack 7/15) (#30069) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:21:32 -07:00
Cheng WanandClaude Fable 5 df6491d80c [refactor] Wire the config resolution pipeline (dispatch, stash, dual-apply, publish) (stack 6/15) (#30068) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:21:21 -07:00
Cheng WanandClaude Fable 5 c3d751b231 [refactor] Add the declarative model-override registry and resolution gate (stack 5/15) (#30067) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:21:09 -07:00
Cheng WanandClaude Fable 5 10f258257f [refactor] Add the resolved-flags tier + resolvable-field metadata (stack 4/15) (#30066) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:20:58 -07:00
Cheng WanandClaude Fable 5 ff57171f98 [refactor] Soft-deprecate the legacy global ServerArgs accessors + ratchet (stack 3/15) (#30065) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:20:46 -07:00
Cheng WanandClaude Fable 5 def20782cf [refactor] Move ServerArgs ownership into the runtime context (stack 2/15) (#30064) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:20:34 -07:00
Cheng WanandClaude Fable 5 6d662c9245 [refactor] Add a read-through server_args accessor to RuntimeContext (stack 1/15) (#30063) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:19:46 -07:00
Mick 03962d4238 [diffusion] feat: enable compile warmup for vae decode (#29306) 2026-07-04 15:25:26 +08:00
san-tian 576dc31e33 Avoid logits multimem all-gather on cross-node TP groups (#29881) 2026-07-04 00:24:58 -07:00
Pranjal Shankhdharandpranjalssh ad744c6c6b [trtllm_mha] Fuse cuda-graph metadata rebuild into one triton kernel (#29843) 
Co-authored-by: pranjalssh <pranjalssh@fb.com>
 2026-07-03 22:24:28 -07:00
Cheng Wan 4028304579 [DSA] Disable indexer fusion by default to restore DeepSeek-V3.2 accuracy (#30088) 2026-07-03 20:50:37 -07:00
Mick 5af1f949ca [diffusion] CI: prefer official diffusion consistency GT (#29831) 2026-07-04 10:09:33 +08:00
Cheng Wan 5f623ad24e Revert "Fix wrong RMSNorm fallback to old Flashinfer CUDA kernel when in PCG" (#30083) 2026-07-03 19:05:20 -07:00
Cheng Wan c21f6f19cf [MoE] Fix moe_fused_gate out-of-range expert id on all-NaN rows (fixes eagle_dp_attention crash) (#30079) 2026-07-03 18:48:51 -07:00
Alison Shao b28bc1060f fix(mimo-vl): pass padded_context_dim to Qwen2_5_VisionPatchMerger (#29994) 2026-07-04 08:08:25 +08:00
Khoa PhamandKhoa Pham 6ce02b95ad fix: reorder DSA indexer dual-stream ops to avoid CUDA graph stream explosion (#30025) 
Co-authored-by: Khoa Pham <264503018+kpham-sgl@users.noreply.github.com>
 2026-07-03 13:53:16 -07:00
Baizhou Zhang 1f0f353d92 [CI] Add GLM52 NVFP4 MTP B200 tests (#30021) 2026-07-03 13:43:38 -07:00
ThanhhaoHao PhanClaude Opus 4.8
 		0203c60fdf [CP] Consolidate decode-context-parallel (DCP) helpers into layers/dcp/ (#29365) 
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-03 12:25:39 -07:00
Mick 486bcb48e7 [diffusion] CI: fix AMD diffusion CI import (#30039) 2026-07-03 22:26:08 +08:00
Jzz1943 1058d00fe0 [diffusion] feat: support cache-dit for Ideogram 4 (#29631) 2026-07-03 19:58:48 +08:00
Mick 42acfd1550 [diffusion] feat: performance_mode=speed enables torch.compile by default (#30016) 2026-07-03 19:12:17 +08:00
khalilzhk 430418e218 [NPU] bugfix for dsv4 memory pool (#30001) 2026-07-03 16:41:39 +08:00
Baizhou Zhang e3258d3b54 [Fix] Turn off dsa indexer fusion by default (#30018) 2026-07-03 01:08:06 -07:00
Polisetty V R K Jyothendra VarmaandMa Mingfei 4dddb04325 [Intel GPU] DeepSeek V4 6/N: use sgl-kernel implemetation of flash_mla_with_kvcache on XPU (#27914) 
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-07-03 15:59:38 +08:00
Polisetty V R K Jyothendra VarmaRahul VijayaraghavanMa Mingfei
 		e90fec4868 [Intel GPU] DeepSeek V4 10/N : Add sqrtsoftplus support to fused_topk_torch_native (#28048) 
Signed-off-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-07-03 15:59:12 +08:00
Cao E 9df16b5ba9 [XPU] Remove redundant xpu graph backend and make xpu graph opt-in by default (#29911) 2026-07-03 15:58:56 +08:00
McZyWu 8416544ab0 [NPU] bugfix for Base class add mamba_track_indices parameter (#29999) 2026-07-03 15:10:41 +08:00
Chandrakant Khandelwal fe60764f54 [diffusion] fix: add profiling support and fix VBench dataset handling in bench_offline_throughput (#27704) 2026-07-03 15:08:38 +08:00