sglang/tools/sglang-simulator/examples/assets/tokenizer/tokenizer_config.json at main - sglang - Gitea

minke.yu/sglang

Files

T

59799a3687 [Simulator] Add high-fidelity CPU-based inference simulator (#33824 )

Co-authored-by: zhouhaizhu.zhz <zhouhaizhu.zhz@alibaba-inc.com>
Co-authored-by: LinSiyuan814 <linsiyuan.lsy@alibaba-inc.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>

2026-09-04 11:12:11 +08:00

7 lines

151 B

JSON

Raw Permalink Blame History

 {
   "backend": "tokenizers",
   "model_max_length": 1000000000000000019884624838656,
   "tokenizer_class": "TokenizersBackend",
   "unk_token": "[UNK]"
 }