sglang

adaptive_speculative_decoding.mdx

[SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055 )

2026-06-05 15:43:02 -07:00

attention_backend.mdx

Sync server arguments and environment variables + update various documentation (#28674 )

2026-06-22 10:23:46 -07:00

breakable_cuda_graph.mdx

[AMD] Make breakable CUDA graph run on ROCm/HIP (#28173 )

2026-06-19 07:16:00 -07:00

checkpoint_engine.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

cuda_graph_for_multi_modal_encoder.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

deterministic_inference.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

dp_dpa_smg_guide.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

dp_for_multi_modal_encoder.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

epd_disaggregation.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

expert_parallelism.mdx

[NVIDIA] Support flashinfer a2a with flashinfer_trtllm_routed moe (#22394 )

2026-06-29 16:23:58 -07:00

forward_hooks.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

hicache_best_practices.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

hicache_design.mdx

[Feat][LMCache] Support LMCache mp mode (#24089 )

2026-05-28 10:15:09 +08:00

hicache_storage_runtime_attach_detach.mdx

[HiCache] feat: default storage prefetch timeout (#23309 )

2026-05-11 18:49:35 -07:00

hicache.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

hicache.rst

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

hisparse_guide.mdx

hisparse: support NIXL DRAM KV destinations for HiSparse (#27563 )

2026-06-27 22:32:29 +08:00

hyperparameter_tuning.mdx

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

llm-d.mdx

docs: add llm-d page under Advanced Features (#28078 )

2026-06-12 18:40:31 -07:00

lora.ipynb

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

lora.mdx

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

model_loading.mdx

Sync server arguments and environment variables + update various documentation (#28674 )

2026-06-22 10:23:46 -07:00

object_storage.mdx

Sync server arguments and environment variables + update various documentation (#28674 )

2026-06-22 10:23:46 -07:00

observability.mdx

[Utils] Support configure log level at runtime (#26583 )

2026-05-29 14:49:06 -07:00

overview.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

pd_disaggregation.mdx

[NPU] Docs op performance optimize (#28277 )

2026-06-15 20:28:18 +08:00

piecewise_cuda_graph.mdx

Fix stale CUDA graph benchmark and docs refs (#28041 )

2026-06-13 21:51:42 -07:00

pipeline_parallelism.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

quantization.mdx

Add Intel Quantization Support in SGLang (#18139 )

2026-06-26 09:54:35 +08:00

quantized_kv_cache.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

rfork.mdx

Delegate ModelExpress loading to package (#24723 )

2026-05-16 11:16:44 -07:00

separate_reasoning.ipynb

[model] Apertus Tool/Function and Reasoning parser (#25100 )

2026-06-06 00:04:31 -07:00

separate_reasoning.mdx

[model] Apertus Tool/Function and Reasoning parser (#25100 )

2026-06-06 00:04:31 -07:00

server_arguments.mdx

feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533 )

2026-06-29 14:49:54 -07:00

sgl_model_gateway.mdx

fix(router): configure HTTP client connection settings (#24330 )

2026-05-07 11:42:45 -07:00

sglang_for_rl.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

speculative_decoding.ipynb

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

speculative_decoding.mdx

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

structured_outputs_for_reasoning_models.ipynb

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

structured_outputs_for_reasoning_models.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

structured_outputs.ipynb

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

structured_outputs.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

tool_parser.ipynb

[model] Apertus Tool/Function and Reasoning parser (#25100 )

2026-06-06 00:04:31 -07:00

tool_parser.mdx

[model] Apertus Tool/Function and Reasoning parser (#25100 )

2026-06-06 00:04:31 -07:00

vlm_query.ipynb

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

vlm_query.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00