4 people 320bdd1ee2 [Docs] Document --retraction-policy, --return-hidden-states-mode, --language-model-only (#37989) ...

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: mottopanikeiku <fcetin@hawk.iit.edu>
Co-authored-by: alp <falpercetin@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

2026-09-05 05:26:28 +08:00

..

adaptive_speculative_decoding.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

attention_backend.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

breakable_cuda_graph.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

checkpoint_engine.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

cuda_graph_for_multi_modal_encoder.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

dcp.mdx

[Docs] Add decode context parallelism to advanced features (#34654)

2026-08-13 13:51:57 -07:00

deterministic_inference.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

dp_dpa_smg_guide.mdx

Add docs for TP LMHead optimizaiton (#35283)

2026-08-19 14:59:35 -07:00

dp_for_multi_modal_encoder.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

epd_disaggregation.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

expert_parallelism.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

forward_hooks.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

hicache_best_practices.mdx

docs: state that HiCache L2 is instance-private and only L3 is shared (#37050)

2026-08-29 23:47:50 +08:00

hicache_design.mdx

docs: state that HiCache L2 is instance-private and only L3 is shared (#37050)

2026-08-29 23:47:50 +08:00

hicache_storage_runtime_attach_detach.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

hicache.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

hisparse_guide.mdx

[Fix] Allow flashinfer_sparse_mla DSA backend for HiSparse on SM120 FP8 KV (#33075)

2026-08-11 15:05:04 -07:00

hyperparameter_tuning.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

llm-d.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

lora.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

model_loading.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

object_storage.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

observability.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

overview.mdx

[Simulator] Add high-fidelity CPU-based inference simulator (#33824)

2026-09-04 11:12:11 +08:00

pd_disaggregation.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

piecewise_cuda_graph.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

pipeline_parallelism.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

quantization.mdx

[XPU] Support GPT-OSS MXFP4 checkpoints on Intel XPU (#35751)

2026-09-04 14:20:28 +08:00

quantized_kv_cache.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

reasoning_aware_compression.mdx

Add Reasoning-Aware Compression (RAC) pruning recipe for reasoning models (#32414)

2026-08-14 15:13:45 -07:00

rfork.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

separate_reasoning.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

server_arguments.mdx

[Docs] Document --retraction-policy, --return-hidden-states-mode, --language-model-only (#37989)

2026-09-05 05:26:28 +08:00

session_radix_cache.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

sgl_model_gateway.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

sglang_for_rl.mdx

Report per-token weight-version spans in generation meta info (#35926)

2026-08-24 20:18:52 +08:00

sglang_simulator.mdx

[Simulator] Add high-fidelity CPU-based inference simulator (#33824)

2026-09-04 11:12:11 +08:00

speculative_decoding.mdx

[Speculative Decoding] Add native UNO serving support (#37667)

2026-09-03 20:08:41 +08:00

structured_outputs_for_reasoning_models.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

structured_outputs.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

tool_parser.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

vlm_query.mdx

[VLM] replace deprecated image processor use_fast (#34175)

2026-08-12 00:14:07 +08:00