minke.yu/sglang

Fork 0

Files

T

History

8a1e6e4e46 Qwen3.8-27B Model Support (#34859 )

Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>

2026-08-19 16:31:43 +08:00

benchmark

[Model Loading] Overlap checkpoint staging with CUDA graph capture during startup (#32017 )

2026-08-13 12:26:25 -07:00

cli

feat(cli): add extensible serve backend plugins (#34753 )

2026-08-14 13:57:59 +08:00

kernels

Qwen3.8-27B Model Support (#34859 )

2026-08-19 16:31:43 +08:00

lang

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

multimodal_gen

[diffusion] refactor: gate native encoder quantized checkpoints (#35183 )

2026-08-19 16:18:36 +08:00

srt

Qwen3.8-27B Model Support (#34859 )

2026-08-19 16:31:43 +08:00

test

[CI] Trim the base-c 4-gpu-h100 stage from 5 shards to 4 (#35407 )

2026-08-19 00:48:07 -07:00

__init__.py

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

_platform_stubs.py

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

bench_offline_throughput.py

[misc] Add bench_serving compatibility shim (#28997 )

2026-06-23 19:49:53 -07:00

bench_one_batch_server.py

[misc] Unify benchmark deprecation shims and one_batch_server CLI entrypoint (#29108 )

2026-06-23 21:10:25 -07:00

bench_one_batch.py

[misc] Add bench_serving compatibility shim (#28997 )

2026-06-23 19:49:53 -07:00

bench_serving.py

[misc] Unify benchmark deprecation shims and one_batch_server CLI entrypoint (#29108 )

2026-06-23 21:10:25 -07:00

check_env.py

Remove the torchao integration (--torchao-config) (#34304 )

2026-08-14 21:49:11 +08:00

compile_deep_gemm.py

config: retire ServerArgs.override in favour of derive()

2026-08-05 19:30:53 -07:00

launch_server.py

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

profiler.py

…

README.md

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

utils.py

[diffusion] fix: fix local-path detection for MiniMax-H3 and other non-diffusers models (#33365 )

2026-08-04 14:03:35 +08:00

version.py

…

README.md

Code Structure

Folders

benchmark/: Benchmark implementations and dataset utilities.
cli/: Command-line interface commands and entrypoints.
kernels/: Kernel interfaces, implementations, selection, and debugging utilities shared by the runtimes.
lang/: Deprecated language frontend that is no longer actively maintained.
multimodal_gen/: Core runtime for image, video, and audio generation models, most of which are diffusion models.
srt/: Core runtime for autoregressive language models. (SRT = SGLang Runtime.)
test/: Shared test and evaluation utilities.

Files

README.md: This package structure overview.
__init__.py: Package initialization and public Python APIs.
bench_offline_throughput.py: Deprecated wrapper for the offline throughput benchmark.
bench_one_batch.py: Deprecated wrapper for the one-batch benchmark.
bench_one_batch_server.py: Deprecated wrapper for the server-based one-batch benchmark.
bench_serving.py: Deprecated wrapper for the online serving benchmark.
check_env.py: Environment and dependency diagnostics.
compile_deep_gemm.py: DeepGEMM kernel precompilation entrypoint.
launch_server.py: Compatibility entrypoint for launching an inference server.
profiler.py: Client entrypoint for collecting server profiling traces.
utils.py: Common package utilities.
version.py: Public package version resolution.