yhyang201 c377923304 [feat] Reduce GPU memory overhead by using weakref (#9673)

2025-08-28 01:09:06 -07:00

..

penaltylib

[feat] Reduce GPU memory overhead by using weakref (#9673)

2025-08-28 01:09:06 -07:00

custom_logit_processor.py

Skip the flaky test_stateful_custom_logit_processor (#6251)

2025-05-12 18:29:41 -07:00

sampling_batch_info.py

Clean up allocators (#9134)

2025-08-13 13:56:04 -07:00

sampling_params.py

[BugFix] add verify logit_bias to avoid crash because of IndexError (#7749)

2025-07-14 02:44:12 +08:00