add doc for quantized kv cache (#14348)

Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com> Co-authored-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
2025-12-04 13:01:05 -08:00
parent 922756aaa1
commit 88d1bab537
3 changed files with 164 additions and 1 deletions
@@ -41,6 +41,7 @@ Its core features include:
   advanced_features/tool_parser.ipynb
   advanced_features/separate_reasoning.ipynb
   advanced_features/quantization.md
+   advanced_features/quantized_kv_cache.md
   advanced_features/expert_parallelism.md
   advanced_features/lora.ipynb
   advanced_features/pd_disaggregation.md