 narutolhy
|
eb7318f1c2
|
support tokenized batch request (#11091)
|
2025-10-19 07:05:02 +00:00 |
|
|
narutolhy
|
c61b9a1d01
|
fix self.enable_kv_cache_events (#11178)
|
2025-10-03 14:09:41 -07:00 |
|
|
narutolhy
|
d17986f8c6
|
Enable optional FP32 compute for LM Head (#10729)
Thanks to MiniMax Team and Chenyang Zhao's support.
|
2025-09-29 20:45:17 -07:00 |
|
|
narutolhy
|
99757cc3e6
|
fix probs name which without temp scaling name (#9984)
|
2025-09-13 12:19:57 +08:00 |
|
|
|
839c93bd2d
|
feat: add original logprobs to response (#8375)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: luhongyu.4869 <luhongyu.4869@bytedance.com>
|
2025-08-29 11:43:57 -07:00 |
|
|
narutolhy
|
3e34e9004f
|
Fix: sync prepare_fp8_layer_for_marlin with latest vllm changes (#7648)
|
2025-06-30 21:51:01 -07:00 |
|