3 people b8ec544946 [DSA] Integrate Q8KV8 FP8 Sparse MLA Prefill into the DSA Backend (DeepSeek-V3.2) (#30514) ...

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>

2026-07-19 11:58:16 +08:00

..

adaptive_speculative_decoding.mdx

[SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055)

2026-06-05 15:43:02 -07:00

attention_backend.mdx

[DSA] Integrate Q8KV8 FP8 Sparse MLA Prefill into the DSA Backend (DeepSeek-V3.2) (#30514)

2026-07-19 11:58:16 +08:00

breakable_cuda_graph.mdx

[AMD] Make breakable CUDA graph run on ROCm/HIP (#28173)

2026-06-19 07:16:00 -07:00

checkpoint_engine.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

cuda_graph_for_multi_modal_encoder.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

deterministic_inference.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

dp_dpa_smg_guide.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

dp_for_multi_modal_encoder.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

epd_disaggregation.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

expert_parallelism.mdx

[NVIDIA] Support flashinfer a2a with flashinfer_trtllm_routed moe (#22394)

2026-06-29 16:23:58 -07:00

forward_hooks.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

hicache_best_practices.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

hicache_design.mdx

[Feat][LMCache] Support LMCache mp mode (#24089)

2026-05-28 10:15:09 +08:00

hicache_storage_runtime_attach_detach.mdx

[HiCache] feat: default storage prefetch timeout (#23309)

2026-05-11 18:49:35 -07:00

hicache.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

hisparse_guide.mdx

hisparse: support NIXL DRAM KV destinations for HiSparse (#27563)

2026-06-27 22:32:29 +08:00

hyperparameter_tuning.mdx

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)

2026-06-28 18:38:28 -07:00

llm-d.mdx

docs: add llm-d page under Advanced Features (#28078)

2026-06-12 18:40:31 -07:00

lora.mdx

[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)

2026-06-28 18:38:28 -07:00

model_loading.mdx

Disable multi-threaded load by default when prefetch is on (#30146)

2026-07-09 00:28:53 -07:00

object_storage.mdx

Sync server arguments and environment variables + update various documentation (#28674)

2026-06-22 10:23:46 -07:00

observability.mdx

docs: document CUDA crash dump output (#31333)

2026-07-15 22:18:36 +08:00

overview.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

pd_disaggregation.mdx

[MoE Refactor] [NPU] Refactor Ascend MoE implementation to reduce code duplication and align with community design (#25663)

2026-07-15 14:59:42 +03:00

piecewise_cuda_graph.mdx

Fix stale CUDA graph benchmark and docs refs (#28041)

2026-06-13 21:51:42 -07:00

pipeline_parallelism.mdx

Add new Mintlify documentation site (docs_new/) (#23001)

2026-04-20 15:10:22 -07:00

quantization.mdx

Remove deprecated Mamba flags from doc, wrong FP8 GEMM docstrings and change Nemotron image to 0.5.15 (#31094)

2026-07-17 14:34:29 -07:00

quantized_kv_cache.mdx

[Feature] Add FP4 KV Cache Design and support SM120 GPUs (#21601)

2026-07-17 14:49:43 -07:00

rfork.mdx

Delegate ModelExpress loading to package (#24723)

2026-05-16 11:16:44 -07:00

separate_reasoning.mdx

[model] Apertus Tool/Function and Reasoning parser (#25100)

2026-06-06 00:04:31 -07:00

server_arguments.mdx

[DSA] Integrate Q8KV8 FP8 Sparse MLA Prefill into the DSA Backend (DeepSeek-V3.2) (#30514)

2026-07-19 11:58:16 +08:00

sgl_model_gateway.mdx

fix(router): configure HTTP client connection settings (#24330)

2026-05-07 11:42:45 -07:00

sglang_for_rl.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

speculative_decoding.mdx

Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964)

2026-07-13 15:06:08 -07:00

structured_outputs_for_reasoning_models.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00

structured_outputs.mdx

Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964)

2026-07-13 15:06:08 -07:00

tool_parser.mdx

[model] Apertus Tool/Function and Reasoning parser (#25100)

2026-06-06 00:04:31 -07:00

vlm_query.mdx

[Docs] Sync docs_new with legacy docs and update migration redirects (#23337)

2026-04-21 00:15:17 -07:00