 Zhihao Zhanganda4zhangfei
|
9c1c5c6d7d
|
[ngram] use SGLANG_NGRAM_FORCE_GREEDY_VERIFY to control verify method (#13153)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
|
2025-11-12 21:07:33 +08:00 |
|
|
Zhihao Zhanganda4zhangfei
|
6f08488042
|
fix missing output_token_logprobs when using ngram speculative decoding (#10702)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
|
2025-11-10 02:04:42 -08:00 |
|
|
Zhihao Zhanganda4zhangfei
|
24f7cb1ece
|
[speculative decoding] rename lookahead to ngram (#11010)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
|
2025-09-28 21:06:59 -07:00 |
|
|
|
e7bc600304
|
[Feature] Speculative decoding support lookahead (#9873)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
|
2025-09-18 16:42:41 -07:00 |
|