3 people 6220f45d8e [PD] Add /v1/responses support to the HTTP PD router (#36141) ...

Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

2026-09-13 22:48:13 +08:00

..

adaptive_speculative_decoding.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

attention_backend.mdx

[AMD] Allow aiter attention backend for Gemma-4 (#38758)

2026-09-11 18:48:26 -07:00

breakable_cuda_graph.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

checkpoint_engine.mdx

[XPU] Make checkpoint_engine worker device-agnostic (#32382)

2026-09-11 09:56:39 +08:00

cuda_graph_for_multi_modal_encoder.mdx

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00

dcp.mdx

[DCP] Resolve --dcp-comm-backend to fi_a2a/a2a by default for every model (#39165)

2026-09-11 23:48:42 -07:00

deterministic_inference.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

dp_dpa_smg_guide.mdx

Add docs for TP LMHead optimizaiton (#35283)

2026-08-19 14:59:35 -07:00

dp_for_multi_modal_encoder.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

epd_disaggregation.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

expert_parallelism.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

forward_hooks.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

hicache_best_practices.mdx

docs: state that HiCache L2 is instance-private and only L3 is shared (#37050)

2026-08-29 23:47:50 +08:00

hicache_design.mdx

docs: state that HiCache L2 is instance-private and only L3 is shared (#37050)

2026-08-29 23:47:50 +08:00

hicache_storage_runtime_attach_detach.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

hicache.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

hisparse_guide.mdx

[Fix] Allow flashinfer_sparse_mla DSA backend for HiSparse on SM120 FP8 KV (#33075)

2026-08-11 15:05:04 -07:00

hyperparameter_tuning.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

llm-d.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

lora.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

model_loading.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

object_storage.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

observability.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

overview.mdx

[Simulator] Add high-fidelity CPU-based inference simulator (#33824)

2026-09-04 11:12:11 +08:00

pd_disaggregation.mdx

[PD] Add /v1/responses support to the HTTP PD router (#36141)

2026-09-13 22:48:13 +08:00

piecewise_cuda_graph.mdx

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00

pipeline_parallelism.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

quantization.mdx

Delete cutlass_mla, non-Marlin GPTQ, AWQ AOT kernel, and Dual Chunk Flash Attention (#32114)

2026-09-10 15:12:01 +08:00

quantized_kv_cache.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

radix_eviction_policy.mdx

[Refactor] Let eviction policies take construction parameters (#37795)

2026-09-05 13:48:30 +08:00

reasoning_aware_compression.mdx

Add Reasoning-Aware Compression (RAC) pruning recipe for reasoning models (#32414)

2026-08-14 15:13:45 -07:00

rfork.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

separate_reasoning.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

server_arguments.mdx

[PD][OpenAI] Gate /v1/responses persistence behind --enable-response-store, default off (#39122)

2026-09-13 21:20:47 +08:00

session_radix_cache.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

sgl_model_gateway.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

sglang_for_rl.mdx

Report per-token weight-version spans in generation meta info (#35926)

2026-08-24 20:18:52 +08:00

sglang_simulator.mdx

[Simulator] Add high-fidelity CPU-based inference simulator (#33824)

2026-09-04 11:12:11 +08:00

speculative_decoding.mdx

[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)

2026-09-08 16:42:12 -07:00

structured_outputs_for_reasoning_models.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

structured_outputs.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

tool_parser.mdx

[Docs] Rename docs_new/ to docs/ (#32123)

2026-08-03 16:51:00 -07:00

vlm_query.mdx

[VLM] replace deprecated image processor use_fast (#34175)

2026-08-12 00:14:07 +08:00