minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
11,936 Commits 2 Branches 0 Tags
87e50f20f66fe9f5fbd60b2ec3ca55985ccaccdc
Commit Graph
11936 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
R0CKSTAR 87e50f20f6 [Apple Silicon][MLX] Cache seq_lens-derived tensors in BatchedDecodeContext (#23470) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2026-04-23 18:12:26 -07:00
MARATRIXandAlex Nails 74c2e5bacd [MUSA][8/N] Port CUDA kernels that are compatible with MUSA (#17946) 
Signed-off-by: yafeng.li <yafeng.li@mthreads.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
 2026-04-23 18:04:58 -07:00
Mick c0166355ae [diffusion] CI: minor refactor CI (#23576) 2026-04-24 08:48:31 +08:00
Cheng Wan d9c72bdd2b Skip unselected experts in flashinfer_trtllm (#23493) 2026-04-23 17:30:19 -07:00
Cheng WanandClaude Opus 4.7 000a2525e1 Move expert_mask_gpu from FusedMoE layer to StandardDispatcher (#23585) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-23 17:17:27 -07:00
Lianmin Zheng 95d021b523 Pre-set SWA cache location in CudaGraphRunner (#23552) 2026-04-23 16:51:29 -07:00
Lianmin Zheng bb962b0046 Fix MoE no_combine: skip router weight in down projection (#23545) 2026-04-23 16:47:58 -07:00
Sundara Raman Ramachandran cf88fdcc9c Expose child process PIDs from Engine for health check support (#23320) 2026-04-23 16:44:49 -07:00
Sahithi Chigurupati 9891572c4a [CI] Export GB200 nightly logs to S3 (#23502) 2026-04-23 15:35:10 -07:00
sglang-botandsglang-bot f3b88e080a chore: bump flashinfer version to 0.6.8.post1 (#23281) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-23 15:23:03 -07:00
Jia Guo 6428392b6f ci: fix cu129 wheel tagging + pipefail-abort in install script (follow-up to #23497) (#23587) 2026-04-23 14:52:58 -07:00
Byron Hsu 17210350fd [PD+DP] Allow PrefillDelayer in disaggregated-prefill mode (#23588) 2026-04-23 14:51:16 -07:00
Kangyan-ZhouandClaude Opus 4.6 2882a136bf [CI] Consolidate Docker release workflows into reusable workflow (#22541) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-23 14:06:01 -07:00
Alex NailsandClaude Opus 4.7 579bd0b152 [bug fix] has_fp8_weights_in_checkpoint: handle HF repo IDs, not just local paths (#23542) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-23 12:56:49 -07:00
zijiexiaandgemini-code-assist[bot] 9b2f7f8a91 docs: split MI300X and MI325X options in GLM-5.1 generator (#23540) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-23 12:01:58 -07:00
WangHao-hw 80125febb1 [BUGFIX]Fix Ascend backend pre-allocated range in NPU Graph Mode. (#22778) 2026-04-24 01:23:35 +08:00
Jinghong Liandronnie_zheng c6872fc8fb Fix: fallback to torch API when NVML memory query is not supported (#23426) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-04-23 19:26:04 +03:00
Jie Hao 86ed0680d7 feat: add OpenTelemetry tracing to DiffGenerator (#21254) 2026-04-23 09:25:23 -07:00
Arseniy MironovandNapkin-AI 76e4c5a1f8 [Diffusion][NPU][Bugfix] Ascend_fa crashes when sequence parallelism is used. (#23572) 
Co-authored-by: Napkin-AI <arseniy.mironov.dev@gmail.com>
 2026-04-23 19:21:30 +03:00
Baichuanandliubaichuan 54e21bb3a5 [fix] Fix dynamic chunking profiling crash on GLM-5 models (#23060) 
Co-authored-by: liubaichuan <liubaichuan@infini-ai.com>
 2026-04-23 19:30:57 +08:00
Xinyuan Tong 4868e367f8 docs: add Hunyuan 3 Preview cookbook (#23532) 2026-04-23 02:44:47 -07:00
Xinyi SongandHaiShaw cd459af4e2 [AMD] Use bpreshuffle FP8 blockscale GEMM to replace ABScale GEMM (#23319) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-04-23 01:51:30 -07:00
Bingxu ChenandYC Yen-Ching Tseng fd88a1c562 [AMD] skip deterministic inference for MLA FP8 test (#23382) 
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
 2026-04-23 00:43:23 -07:00
Goalina 1340d8b3bd [CI][NPU]use rsproxy.cn mirror to speed up Rust toolchain installation on NPU runners (#23514) 2026-04-23 09:52:14 +03:00
Ethan (Yusheng) Su 2ef1a21d5e [bug fix] fix: detect FP8 weights from safetensors header instead of ass… (#23414) 2026-04-23 14:49:57 +08:00
Kangyan-ZhouandClaude Opus 4.6 f1a70b4666 [Observability] Add HTTP sidecar endpoints and FlushCache gRPC RPC for gRPC mode (#22500) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-22 23:06:10 -07:00
mispa-ms 3c5b1f0810 [diffusion] fix: fix --warmup-resolutions hang with --enable-cfg-parallel (#23198) 2026-04-23 13:39:20 +08:00
Kangyan-ZhouandClaude Opus 4.6 18359aadc8 [CI] Lower GSM8K baselines for B200 nightly after eval unification (#22136) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-22 22:30:54 -07:00
Bingxu ChenandClaude Opus 4 2b4eeb8343 [AMD] Restore test_zimage_turbo.py and test_int4fp8_moe.py with __main__ entry (#23455) 
Co-authored-by: Claude Opus 4 (1M context) <noreply@anthropic.com>
 2026-04-22 22:28:20 -07:00
HuangJi 9716599383 [diffusion] fix: avoid illegal memory access in qwen image (#22953) 2026-04-23 12:41:26 +08:00
Mick 4d3c7e781a [diffusion] CI: do not retry consistency failures (#23517) 2026-04-23 12:39:37 +08:00
maocheng23 d3aa9128be Change SGLANG_SIMULATE_ACC_METHOD to 'match-expected' (#23527) 2026-04-22 21:26:08 -07:00
Jimmy ShongandSGLang CI 68a8ed9b11 [Fix/Kernel] Add JIT rmsnorm_hf kernel to fix transformers backend MMLU accuracy regression (#22931) 
Co-authored-by: SGLang CI <ci@sglang.ai>
 2026-04-23 12:00:31 +08:00
Alison Shao 267c2c0849 test: move test_epd_disaggregation to nightly-4-gpu (#23518) 2026-04-22 20:59:19 -07:00
Liangsheng Yin 0f21fe924a fix ngram greedy verify kwarg (#23521) 2026-04-22 20:49:54 -07:00
oriandzhiguo.qin 887d380ace [MUSA] Resolve output garbage in Context Parallel on MusaFlashAttentionBackend (#23270) 
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
 2026-04-22 20:22:20 -07:00
zijiexia 6490afe36e [docs] add deprecation notice banner to legacy documentation site (#23516) 2026-04-22 20:17:53 -07:00
Polisetty V R K Jyothendra Varma 214c35b031 [Intel GPU] Update xpu.Dockerfile to python 3.12 version (#23367) 2026-04-23 09:23:52 +08:00
Jia Guo b3e6cf60aa ci: build sgl-kernel wheels for both cu129 and cu130 (#23497) 2026-04-22 18:08:36 -07:00
Kangyan-ZhouandClaude Opus 4.7 c689f774a4 [CI] /rerun-stage: fix workflow-run URL lookup for sgl-kernel PRs (#23510) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-22 17:48:38 -07:00
Kangyan-ZhouandClaude Opus 4.7 0bee211335 [CI] Broaden stage-b-test-4-gpu-b200 runner pool to low-disk label (#23505) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-22 17:14:09 -07:00
Liangsheng YinandSoluMilken f611dd24f1 fix retrive -> retrieve typo (#23503) 
Co-authored-by: SoluMilken <19161836+solumilken@users.noreply.github.com>
 2026-04-22 16:35:04 -07:00
Yanbin Jiang 917d2aa1dc [LoRA] Fix EP + per-expert MoE LoRA illegal memory access (#23178) 2026-04-22 14:22:32 -07:00
Sam Shleifer b9e33d6a5b Dual MoE CUDA graph capture for lora/nolora batches (#22809) 2026-04-22 14:11:11 -07:00
Sahithi Chigurupati 9591033179 [CI] GB200 nightly: on-demand PR/branch image build and config filter (#23086) 2026-04-22 13:51:25 -07:00
Teng MaandShangming Cai 97fc950635 [Docker] chore: update mooncake wheel version (#20731) 
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-04-22 13:36:10 -07:00
jianan-guandMa Mingfei ad0fc88810 [CPU] [Quantization] Add GPTQ/AWQ 4bits quantization support for CPU (#22685) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-04-22 13:34:02 -07:00
Byron Hsu 0b77284587 [minor] Make DEFAULT_FORCE_STREAM_INTERVAL configurable via SGLANG_FORCE_STREAM_INTERVAL (#23215) 2026-04-22 13:05:40 -07:00
JasonHe-WQ f85e3140bf Fix:fix(timeout): fix timeout not propagated (#21944) 2026-04-22 12:48:48 -07:00
Chao ShiandChao Shi 94fb13db92 [devcontainer] Fix build error (#23478) 
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
 2026-04-22 12:24:15 -07:00