fzyzcjy 2600fc0d47 Overlapped weight offload (#8034)

2025-08-23 02:06:46 -07:00

..

openai

Add deepseek v3.1 thinking parser support and update docs (#9464)

2025-08-21 15:09:40 -07:00

context.py

Revert "bugfix: Fix output_ids extraction in detokenizer_manager" (#9467)

2025-08-21 17:24:25 -07:00

engine.py

Overlapped weight offload (#8034)

2025-08-23 02:06:46 -07:00

EngineBase.py

Support dynamic LoRA loading / unloading in engine/server API (#7446)

2025-06-27 21:00:27 -07:00

harmony_utils.py

(gpt-oss, oai, chat): Remove Harmony Integration and Implement Native GPT-OSS Tool Call Support (#9043)

2025-08-11 18:59:18 -07:00

http_server_engine.py

[Multimodal][Perf] Use pybase64 instead of base64 (#7724)

2025-07-08 14:00:58 -07:00

http_server.py

Support GC Freezing to improve latency & throughput (#9241)

2025-08-23 13:43:09 +08:00

tool.py

Support v1/responses and use harmony in serving_chat (#8837)

2025-08-06 16:20:34 -07:00