minke.yu/sglang

Fork 0

Files

T

History

62a4a6ea0e [NPU] Add NPU arch35 support and enhance DSV4 processing in DeepSeek-V4 (#37373 )

Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
Co-authored-by: Kailong Lu <kelonlu@163.com>
Co-authored-by: cx <chengxin65@huawei.com>
Co-authored-by: ranjiewen <ranjiewen@huawei.com>
Co-authored-by: HEX1A0A <1a0ahex@gmail.com>
Co-authored-by: vstone-w <374330057@qq.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: ClownBin <chaobin1993@126.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>

2026-09-07 21:08:06 +08:00

benchmark

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113 )

2026-09-06 21:44:24 -07:00

cli

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

kernels

[Perf] Unified memory: close the DCP decode gap on Blackwell (#37926 )

2026-09-07 01:10:44 -07:00

lang

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

multimodal_gen

[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436 )

2026-09-07 15:13:59 +08:00

srt

[NPU] Add NPU arch35 support and enhance DSV4 processing in DeepSeek-V4 (#37373 )

2026-09-07 21:08:06 +08:00

test

[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436 )

2026-09-07 15:13:59 +08:00

__init__.py

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

_platform_stubs.py

[Fix] Register triton.runtime.cache.triton_key in the MPS stub so torch.compile keeps working (#37937 )

2026-09-03 22:56:14 -07:00

bench_offline_throughput.py

…

bench_one_batch_server.py

[misc] Unify benchmark deprecation shims and one_batch_server CLI entrypoint (#29108 )

2026-06-23 21:10:25 -07:00

bench_one_batch.py

…

bench_serving.py

[misc] Unify benchmark deprecation shims and one_batch_server CLI entrypoint (#29108 )

2026-06-23 21:10:25 -07:00

check_env.py

Remove the torchao integration (--torchao-config) (#34304 )

2026-08-14 21:49:11 +08:00

compile_deep_gemm.py

config: a parallel size has one spelling; a patched scope declares its own (#36621 )

2026-08-27 12:56:42 -07:00

launch_server.py

config: the runtime readers take the published bags (#36254 )

2026-08-26 05:08:25 -07:00

profiler.py

…

README.md

[Misc] Clean up python/sglang package structure (#35062 )

2026-08-17 14:24:35 -07:00

utils.py

[diffusion] fix: fix local-path detection for MiniMax-H3 and other non-diffusers models (#33365 )

2026-08-04 14:03:35 +08:00

version.py

…

README.md

Code Structure

Folders

benchmark/: Benchmark implementations and dataset utilities.
cli/: Command-line interface commands and entrypoints.
kernels/: Kernel interfaces, implementations, selection, and debugging utilities shared by the runtimes.
lang/: Deprecated language frontend that is no longer actively maintained.
multimodal_gen/: Core runtime for image, video, and audio generation models, most of which are diffusion models.
srt/: Core runtime for autoregressive language models. (SRT = SGLang Runtime.)
test/: Shared test and evaluation utilities.

Files

README.md: This package structure overview.
__init__.py: Package initialization and public Python APIs.
bench_offline_throughput.py: Deprecated wrapper for the offline throughput benchmark.
bench_one_batch.py: Deprecated wrapper for the one-batch benchmark.
bench_one_batch_server.py: Deprecated wrapper for the server-based one-batch benchmark.
bench_serving.py: Deprecated wrapper for the online serving benchmark.
check_env.py: Environment and dependency diagnostics.
compile_deep_gemm.py: DeepGEMM kernel precompilation entrypoint.
launch_server.py: Compatibility entrypoint for launching an inference server.
profiler.py: Client entrypoint for collecting server profiling traces.
utils.py: Common package utilities.
version.py: Public package version resolution.