Commit Graph
27 Commits
Author SHA1 Message Date
Mick 02723e1b0d CI: rewrite test_vision_chunked_prefill to speedup (#5682) 2025-04-26 18:33:13 -07:00
feda9b11b3 fix: fix one more bug from merging mm_inputs (#5718)
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>
2025-04-25 17:28:33 -07:00
MickandXinyuan Tong c998d04b46 vlm: enable radix cache for qwen-vl models (#5349)
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
2025-04-23 20:35:05 -07:00
Mick 34ef6c8135 [VLM] Adopt fast image processor by default (#5065) 2025-04-11 21:46:58 -07:00
Mick e53a0b3d5b [fix] fix mrope positions not picked up (#5265) 2025-04-11 01:29:45 -07:00
Mick fbebcb7aa4 model: support mllama4 (#5144) 2025-04-09 09:28:44 -07:00
Mick 5cb552b1d4 refactor: multimodal data (#4754) 2025-03-31 09:57:51 -07:00
Mick 1e86457c90 model: Minicpmo (#3023) 2025-03-24 20:08:40 -07:00
Mick 11577cedb7 refactor: bug fixes and refactor for vlm (#4661) 2025-03-22 22:48:49 -07:00
Mick d373a48c98 fix: second_per_grid_ts should be used to get mrope position (#3682) 2025-03-17 18:12:38 -07:00
Mick 98be3bd306 refactor: rewrite bench-mmmu-sglang (#4458) 2025-03-17 18:11:47 -07:00
Mick 0f52fb55ec config: Update fused moe config (#4493) 2025-03-16 23:51:58 -07:00
Mick 9d02bb3e2a Urgent model support: support gemma-3-it (#4424) 2025-03-16 17:37:32 -07:00
Mick 8ec2ce0726 perf: update fused moe config (#4459) 2025-03-15 21:23:57 -07:00
Mick 035ac2ab74 ci: update transformers==4.48.3 (#4451) 2025-03-15 13:27:26 -07:00
Mick 01090e8ac3 model: Support Janus-pro (#3203) 2025-03-12 11:02:11 -07:00
Mick ff2ce0b86f refactor: move image processors to separate files (#4229) 2025-03-11 12:35:35 -07:00
Mickandzhaochenyang20 583d6af71b example: add vlm to token in & out example (#3941)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-03-04 22:18:26 -08:00
Mick 45205d88a0 bench: Add MMMU benchmark for vLM (#3562) 2025-02-22 08:10:59 -08:00
Mick 99c1b9d2ee fix: apply cache size limit of attention mask for VisionAttention (#3657) 2025-02-19 20:16:48 +08:00
Mick 424848d26f fix: remove dependency on latest transformers impl (#3635) 2025-02-19 01:14:11 +08:00
Mick bcc213df61 Model: Support Qwen 2.5 vl (#3258) 2025-02-16 00:58:53 -08:00
MickandChayenne 7711ac6ed0 doc: emphasize and notify the usage of chat_template (#3589)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
2025-02-15 00:10:32 -08:00
Mickandzhaochenyang20 ced680663c doc: Support a new vLM (#3405)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-02-12 00:43:14 -08:00
Mick 9f635ea50d [Fix] Address remaining issues of supporting MiniCPMV (#2977) 2025-01-28 00:22:13 -08:00
3d93f84a00 [Feature] Support minicpmv v2.6 (#2785)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
2025-01-18 14:14:19 -08:00
Mick 1775b963db [Fix] fix incorrectly overwriting the port specified in ServerArgs (#2714) 2025-01-02 10:28:22 -08:00