 Qiaolin YuandCheng Wan
|
41650b0d70
|
feat: support compatibility between MTP and two-batch-overlap (#7225)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-06-27 01:10:27 -07:00 |
|
|
Qiaolin Yu
|
b8df43ab9c
|
Fix gathered_buffer issues in tbo (#7531)
|
2025-06-25 14:42:21 -07:00 |
|
|
Qiaolin Yu
|
f20f70003d
|
Fix torch version in blackwell dockerfile (#7017)
|
2025-06-09 17:06:50 -07:00 |
|
|
Qiaolin Yu
|
7dc0e39442
|
Bump torch to 2.7.0 (#6788)
|
2025-05-31 14:43:12 -07:00 |
|
|
Qiaolin Yu
|
0b9557fcd7
|
Disable compiling arch below sm_90 in aarch64 by default (#6380)
|
2025-05-27 15:50:02 -07:00 |
|
|
Qiaolin Yu
|
aff584fa54
|
Fix sgl-kernel build on aarch64 platforms (#6062)
|
2025-05-06 16:10:57 -07:00 |
|
|
Qiaolin Yuandzhaochenyang20
|
357671e216
|
Add examples for server token-in-token-out (#4103)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
|
2025-03-05 13:16:31 -08:00 |
|
|
Qiaolin Yu
|
4725e3f652
|
Add examples for returning hidden states when using the server (#4074)
|
2025-03-04 19:31:50 -08:00 |
|
|
Qiaolin Yu
|
57a404fd55
|
Remove outdated test utils and fix links for the doc of sampling params (#3999)
|
2025-03-03 09:41:38 -08:00 |
|
|
Qiaolin YuandBeichen-Ma
|
40782f05d7
|
Refactor: Move return_hidden_states to the generate input (#3985)
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
|
2025-03-01 17:51:29 -08:00 |
|
|
Qiaolin Yu
|
d38878523d
|
Fix the doc link for sampling params (#3861)
|
2025-02-27 13:31:43 -08:00 |
|
|
|
d6898dd253
|
Add return hidden state in the native API (#3897)
Co-authored-by: Beichen-Ma <mabeichen12@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
|
2025-02-26 22:06:54 -08:00 |
|