Raayan Dhar
|
92cdd398cd
|
feat: Support mrope_section with rope_type: "yarn" (#13313)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
|
2026-02-14 22:51:44 +08:00 |
|
Raayan Dhar
|
76b3c698d6
|
feat: reduce constrained-decoding overhead in TP (#13947)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
|
2026-01-10 00:38:32 +08:00 |
|
Raayan Dhar
|
84d13c54bb
|
feat: only add input vision tokens in bench_serving result if vision dataset is used (#15492)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
|
2026-01-06 12:14:42 +08:00 |
|
 Raayan DharandShangming Cai
|
4397cda7dc
|
feat: raise error in PD when page sizes are mismatched (#14474)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-01-05 19:54:01 +08:00 |
|
Raayan Dhar
|
91d249cd9b
|
fix: small changes to enable test_mrope.py (#14082)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
|
2025-11-27 22:58:17 -08:00 |
|