sglang

fields

[unified-memory] PD disaggregation for every unified pool shape (#37506 )

2026-09-13 19:16:43 -07:00

model_overrides

[Qwen3.8] Enable NVIDIA NVFP4 on DGX Spark with file-backed PLE and PDL router fix (#39126 )

2026-09-13 16:23:41 +08:00

__init__.py

introduce arg_groups/ with nemotron_h hook (#24328 )

2026-05-03 16:28:11 -07:00

arg_utils.py

[Config] msgspec.Struct for the config tier (#38753 )

2026-09-09 19:41:19 -07:00

argparse_actions.py

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375 )

2026-09-08 16:42:12 -07:00

attention_hook.py

Delete cutlass_mla, non-Marlin GPTQ, AWQ AOT kernel, and Dual Chunk Flash Attention (#32114 )

2026-09-10 15:12:01 +08:00

choices.py

DFLASH support added for XPU (#32798 )

2026-09-11 10:39:37 +08:00

cuda_graph_hook.py

Add Opt-In for GLM-5.3 Flash breakable prefill CUDA graphs (#38522 )

2026-09-09 17:02:08 -07:00

deepseek_v4_hook.py

[DSv4] Integrate TRT-LLM DSv4 Attention for SM100/103 (#30805 )

2026-09-09 17:40:07 -07:00

dllm_hook.py

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086 )

2026-08-30 02:18:33 -07:00

expert_pack_hook.py

config: the lazy imports that buy nothing become eager (#36975 )

2026-08-29 04:21:54 -07:00

field_order.py

[Sampling] Support sampling masks with overlap scheduling (#36631 )

2026-09-10 14:52:44 -07:00

hicache_hook.py

[NPU][Hicache] Add Ascend Memcache Hicache L3 storage backend (#38827 )

2026-09-11 18:54:00 +08:00

hisparse_hook.py

[AMD] Enable Fast Triton Sparse MLA backend (#30575 )

2026-09-10 01:58:00 -07:00

kimi_k3_hook.py

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086 )

2026-08-30 02:18:33 -07:00

kv_cache_hook.py

[unified-memory] Enable prefill cuda-graph capture (#37418 )

2026-09-13 19:17:19 -07:00

layernorm_sp_hook.py

[Feature] Megatron LayerNorm sequence parallelism (--enable-layernorm-sp) (#30915 )

2026-08-31 19:27:28 -07:00

lora_hook.py

[Config] One writer for the declaration stash; no exception to the write seal (#38752 )

2026-09-09 19:22:06 -07:00

mamba_hook.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210 )

2026-09-02 19:46:08 -07:00

mega_moe_hook.py

Bump sgl-deep-gemm to 0.1.7 (#37279 )

2026-08-31 17:16:34 -07:00

memory_hook.py

[Qwen3.8] Enable NVIDIA NVFP4 on DGX Spark with file-backed PLE and PDL router fix (#39126 )

2026-09-13 16:23:41 +08:00

model_hook.py

config: an out-of-tree replacement point for every resolution-pipeline step (#39134 )

2026-09-12 17:26:54 -07:00

model_override_base.py

[Config] Round 6.5: a namespace declares what it derives, next to what it derives it from (#38113 )

2026-09-06 21:44:24 -07:00

model_path_hook.py

config: the lazy imports that buy nothing become eager (#36975 )

2026-08-29 04:21:54 -07:00

moe_hook.py

[NVIDIA] Support flashinfer Mega Moe (#31470 )

2026-09-10 00:22:47 -07:00

overrides.py

Add a provider hook for prefill-buffer ceilings (#39182 )

2026-09-12 21:37:10 -07:00

parallel_hook.py

config: an out-of-tree replacement point for every resolution-pipeline step (#39134 )

2026-09-12 17:26:54 -07:00

pd_disaggregation_hook.py

[Config] msgspec.Struct for the config tier (#38753 )

2026-09-09 19:41:19 -07:00

pipeline.py

[PD][OpenAI] Gate /v1/responses persistence behind --enable-response-store, default off (#39122 )

2026-09-13 21:20:47 +08:00

platform_hook.py

config: an out-of-tree replacement point for every resolution-pipeline step (#39134 )

2026-09-12 17:26:54 -07:00

prefill_buffer_ceiling.py

Add a provider hook for prefill-buffer ceilings (#39182 )

2026-09-12 21:37:10 -07:00

resolution_hooks.py

[PD][OpenAI] Gate /v1/responses persistence behind --enable-response-store, default off (#39122 )

2026-09-13 21:20:47 +08:00

serving_hook.py

Allow CUDA VMM feature transport with the Rust frontend (#39347 )

2026-09-14 17:09:49 -07:00

speculative_hook.py

[NPU] Support DFlash speculative decoding for MiMo-V2.5-Pro (mxfp4) (#37565 )

2026-09-12 11:59:23 +08:00

validation_hook.py

[PD][OpenAI] Gate /v1/responses persistence behind --enable-response-store, default off (#39122 )

2026-09-13 21:20:47 +08:00