sglang

adaptive_speculative_decoding.mdx

[SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055 )

2026-06-05 15:43:02 -07:00

attention_backend.mdx

[GDN] Auto-select FlashInfer GDN prefill on validated SM100 configs (#29734 )

2026-07-10 00:26:00 +08:00

breakable_cuda_graph.mdx

[AMD] Make breakable CUDA graph run on ROCm/HIP (#28173 )

2026-06-19 07:16:00 -07:00

checkpoint_engine.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

cuda_graph_for_multi_modal_encoder.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

deterministic_inference.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

dp_dpa_smg_guide.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

dp_for_multi_modal_encoder.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

epd_disaggregation.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

expert_parallelism.mdx

[NVIDIA] Support flashinfer a2a with flashinfer_trtllm_routed moe (#22394 )

2026-06-29 16:23:58 -07:00

forward_hooks.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

hicache_best_practices.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

hicache_design.mdx

[Feat][LMCache] Support LMCache mp mode (#24089 )

2026-05-28 10:15:09 +08:00

hicache_storage_runtime_attach_detach.mdx

[HiCache] feat: default storage prefetch timeout (#23309 )

2026-05-11 18:49:35 -07:00

hicache.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

hisparse_guide.mdx

hisparse: support NIXL DRAM KV destinations for HiSparse (#27563 )

2026-06-27 22:32:29 +08:00

hyperparameter_tuning.mdx

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

llm-d.mdx

docs: add llm-d page under Advanced Features (#28078 )

2026-06-12 18:40:31 -07:00

lora.mdx

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591 )

2026-06-28 18:38:28 -07:00

model_loading.mdx

Disable multi-threaded load by default when prefetch is on (#30146 )

2026-07-09 00:28:53 -07:00

object_storage.mdx

Sync server arguments and environment variables + update various documentation (#28674 )

2026-06-22 10:23:46 -07:00

observability.mdx

docs: document CUDA crash dump output (#31333 )

2026-07-15 22:18:36 +08:00

overview.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

pd_disaggregation.mdx

[MoE Refactor] [NPU] Refactor Ascend MoE implementation to reduce code duplication and align with community design (#25663 )

2026-07-15 14:59:42 +03:00

piecewise_cuda_graph.mdx

Fix stale CUDA graph benchmark and docs refs (#28041 )

2026-06-13 21:51:42 -07:00

pipeline_parallelism.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

quantization.mdx

Refactor FP4 quantization and remove deprecated JIT kernels (#30448 )

2026-07-14 09:22:07 +08:00

quantized_kv_cache.mdx

Add new Mintlify documentation site (docs_new/) (#23001 )

2026-04-20 15:10:22 -07:00

rfork.mdx

Delegate ModelExpress loading to package (#24723 )

2026-05-16 11:16:44 -07:00

separate_reasoning.mdx

[model] Apertus Tool/Function and Reasoning parser (#25100 )

2026-06-06 00:04:31 -07:00

server_arguments.mdx

docs: document CUDA crash dump output (#31333 )

2026-07-15 22:18:36 +08:00

sgl_model_gateway.mdx

fix(router): configure HTTP client connection settings (#24330 )

2026-05-07 11:42:45 -07:00

sglang_for_rl.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

speculative_decoding.mdx

Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964 )

2026-07-13 15:06:08 -07:00

structured_outputs_for_reasoning_models.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00

structured_outputs.mdx

Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964 )

2026-07-13 15:06:08 -07:00

tool_parser.mdx

[model] Apertus Tool/Function and Reasoning parser (#25100 )

2026-06-06 00:04:31 -07:00

vlm_query.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337 )

2026-04-21 00:15:17 -07:00