minke.yu/sglang

Files

T

History

YC Yen-Ching Tseng 7ba3430365 Fix Grok-2 nightly: derive image-understanding capability from is_multimodal (#33730 )

2026-08-19 23:56:51 -07:00

..

[Model Loading] Overlap checkpoint staging with CUDA graph capture during startup (#32017 )

2026-08-13 12:26:25 -07:00

feat(cli): add extensible serve backend plugins (#34753 )

2026-08-14 13:57:59 +08:00

Amd/dsv4 shared experts fusion top6 (#32340 )

2026-08-19 22:57:58 -07:00

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

[diffusion] UX: report where a component's weights are (#35618 )

2026-08-20 13:05:14 +08:00

Fix Grok-2 nightly: derive image-understanding capability from is_multimodal (#33730 )

2026-08-19 23:56:51 -07:00

Add three new test cases (#35502 )

2026-08-19 17:59:45 +08:00

__init__.py

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

_platform_stubs.py

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

bench_offline_throughput.py

[misc] Add bench_serving compatibility shim (#28997 )

2026-06-23 19:49:53 -07:00

bench_one_batch_server.py

[misc] Unify benchmark deprecation shims and one_batch_server CLI entrypoint (#29108 )

2026-06-23 21:10:25 -07:00

bench_one_batch.py

[misc] Add bench_serving compatibility shim (#28997 )

2026-06-23 19:49:53 -07:00

bench_serving.py

[misc] Unify benchmark deprecation shims and one_batch_server CLI entrypoint (#29108 )

2026-06-23 21:10:25 -07:00

check_env.py

Remove the torchao integration (--torchao-config) (#34304 )

2026-08-14 21:49:11 +08:00

compile_deep_gemm.py

config: retire ServerArgs.override in favour of derive()

2026-08-05 19:30:53 -07:00

launch_server.py

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

profiler.py

…

README.md

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

utils.py

[diffusion] fix: fix local-path detection for MiniMax-H3 and other non-diffusers models (#33365 )

2026-08-04 14:03:35 +08:00

version.py

…

README.md

Code Structure

Folders

benchmark/: Benchmark implementations and dataset utilities.
cli/: Command-line interface commands and entrypoints.
kernels/: Kernel interfaces, implementations, selection, and debugging utilities shared by the runtimes.
lang/: Deprecated language frontend that is no longer actively maintained.
multimodal_gen/: Core runtime for image, video, and audio generation models, most of which are diffusion models.
srt/: Core runtime for autoregressive language models. (SRT = SGLang Runtime.)
test/: Shared test and evaluation utilities.

Files

README.md: This package structure overview.
__init__.py: Package initialization and public Python APIs.
bench_offline_throughput.py: Deprecated wrapper for the offline throughput benchmark.
bench_one_batch.py: Deprecated wrapper for the one-batch benchmark.
bench_one_batch_server.py: Deprecated wrapper for the server-based one-batch benchmark.
bench_serving.py: Deprecated wrapper for the online serving benchmark.
check_env.py: Environment and dependency diagnostics.
compile_deep_gemm.py: DeepGEMM kernel precompilation entrypoint.
launch_server.py: Compatibility entrypoint for launching an inference server.
profiler.py: Client entrypoint for collecting server profiling traces.
utils.py: Common package utilities.
version.py: Public package version resolution.