4 people 2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906) ...

Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

2026-06-09 21:36:57 -07:00

..

adaptive_speculative_decoding.mdx

[SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055)

2026-06-05 15:43:02 -07:00

attention_backend.mdx

docs(cookbook): port popular model usage guides into cookbook pages (#25813)

2026-06-01 17:41:49 -07:00

breakable_cuda_graph.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

checkpoint_engine.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

cuda_graph_for_multi_modal_encoder.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

deterministic_inference.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

dp_dpa_smg_guide.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

dp_for_multi_modal_encoder.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

epd_disaggregation.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

expert_parallelism.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

forward_hooks.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

hicache_best_practices.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

hicache_design.mdx

[Feat][LMCache] Support LMCache mp mode (#24089)

2026-05-28 10:15:09 +08:00

hicache_storage_runtime_attach_detach.mdx

[HiCache] feat: default storage prefetch timeout (#23309)

2026-05-11 18:49:35 -07:00

hicache.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

hicache.rst

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

hisparse_guide.mdx

[hisparse]: update user guide (#26249)

2026-05-25 17:54:55 +08:00

hyperparameter_tuning.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

lora.ipynb

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

lora.mdx

[Feature] add LoRADrainer to address high P99 TTFT (#17913)

2026-05-02 16:13:43 -07:00

object_storage.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

observability.mdx

[Utils] Support configure log level at runtime (#26583)

2026-05-29 14:49:06 -07:00

overview.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

pd_disaggregation.mdx

[PD] docs: clarify disaggregation IB device formats (#25521)

2026-06-02 11:38:33 +08:00

piecewise_cuda_graph.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

pipeline_parallelism.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

quantization.mdx

docs: sync legacy docs/-only updates into docs_new (Mintlify) (#27308)

2026-06-04 19:45:13 -07:00

quantized_kv_cache.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

rfork.mdx

Delegate ModelExpress loading to package (#24723)

2026-05-16 11:16:44 -07:00

separate_reasoning.ipynb

[model] Apertus Tool/Function and Reasoning parser (#25100)

2026-06-06 00:04:31 -07:00

separate_reasoning.mdx

[model] Apertus Tool/Function and Reasoning parser (#25100)

2026-06-06 00:04:31 -07:00

server_arguments.mdx

[Refactor] Cuda Graph Runner/Backend Refactor (#23906)

2026-06-09 21:36:57 -07:00

sgl_model_gateway.mdx

fix(router): configure HTTP client connection settings (#24330)

2026-05-07 11:42:45 -07:00

sglang_for_rl.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

speculative_decoding.ipynb

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

speculative_decoding.mdx

docs(cookbook): port popular model usage guides into cookbook pages (#25813)

2026-06-01 17:41:49 -07:00

structured_outputs_for_reasoning_models.ipynb

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

structured_outputs_for_reasoning_models.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

structured_outputs.ipynb

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

structured_outputs.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

tool_parser.ipynb

[model] Apertus Tool/Function and Reasoning parser (#25100)

2026-06-06 00:04:31 -07:00

tool_parser.mdx

[model] Apertus Tool/Function and Reasoning parser (#25100)

2026-06-06 00:04:31 -07:00

vlm_query.ipynb

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

vlm_query.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00