 Shi Shuai
|
755a36614b
|
fix: added "\n" to qwen25 tool parser structural tags (#6631)
|
2025-05-26 19:25:45 -07:00 |
|
|
Shi Shuai
|
9c574585b3
|
fix: remove content=none test when tool called (#6347)
|
2025-05-23 15:12:55 -07:00 |
|
|
Shi Shuaiandsleepcoo
|
81f431eded
|
feat: Add FlashMLA submodule (#4449)
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
|
2025-03-15 23:30:25 -07:00 |
|
|
Shi Shuai
|
817d43705c
|
feat: support ep size < 32 for sgl kernel (#4348)
|
2025-03-12 20:50:46 -07:00 |
|
|
Shi Shuai
|
e074e76b31
|
docs: Add offline engine launch example and documentation (#3771)
|
2025-02-21 11:25:52 -08:00 |
|
|
Shi Shuai
|
c7c79b16cd
|
[Fix] OpenAI API adapter tokenizer encoding (#3432)
|
2025-02-21 09:24:15 -08:00 |
|
|
|
55de40f782
|
[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: simveit <simp.veitner@gmail.com>
|
2025-02-19 11:15:44 -08:00 |
|
|
Shi Shuai
|
d03c4c25a7
|
[docs] Update sampling_params.md (#3617)
|
2025-02-16 18:52:30 -08:00 |
|
|
Shi Shuaiandzhaochenyang20
|
7443197a63
|
[CI] Improve Docs CI Efficiency (#3587)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
|
2025-02-14 19:57:00 -08:00 |
|
|
|
20cf910d8f
|
[docs] Update quantization documentation (#3437)
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: jamessand <shazhizhou0@gmail.com>
|
2025-02-09 10:39:49 -08:00 |
|
|
|
6702592d0e
|
[docs] Add multi-node inference example for SLURM in documentation (#3408)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: aflah02 <aflah20082@iiitd.ac.in>
|
2025-02-08 21:45:14 -08:00 |
|
|
Shi Shuai
|
591e751e07
|
Fix: Runtime error for function calling (#3300)
|
2025-02-06 20:52:01 -08:00 |
|
|
Shi Shuai
|
c4f9707e16
|
Improve: Token-In Token-Out Usage for RLHF (#2843)
|
2025-01-11 15:14:26 -08:00 |
|
|
Shi ShuaiandChayenne
|
dd2e2d275f
|
Docs: Update documentation workflow and contribution guide (#2704)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
|
2025-01-02 09:18:31 -08:00 |
|
|
Shi Shuai
|
062c48d2bd
|
[Docs] Add Support for Pydantic Structured Output Format (#2697)
|
2025-01-01 15:08:43 -08:00 |
|
|
Shi Shuai
|
0a765bbccc
|
Docs: Refactor Contribution Guide (#2690)
|
2024-12-31 14:11:00 -08:00 |
|
|
Shi Shuai
|
fad29f7f52
|
CI: Fix unittest for engine input token ids and output token ids (#2646)
|
2024-12-29 13:28:59 -08:00 |
|
|
Shi ShuaiandChayenne
|
35bdb48557
|
[Feature] Get Token IDs with Engine.generate() (#2636)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
|
2024-12-29 12:28:27 -08:00 |
|
|
Shi Shuai
|
333e3bfde5
|
[docs]Refactor constrained decoding tutorial (#2633)
|
2024-12-28 07:00:38 -08:00 |
|
|
Shi ShuaiandChayenne
|
239c9d4d3a
|
Docs: Add constrained decoding tutorial (#2614)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
|
2024-12-27 23:54:28 -08:00 |
|
|
Shi ShuaiandChayenne
|
25e5d589e3
|
Doc: Update Grammar Backend (#2545)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
|
2024-12-22 17:14:40 -08:00 |
|