 Xinyuan Tong
|
b602f42354
|
Urgent Fix: intern-s1 chat-template matching (#8403)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-27 00:22:31 -07:00 |
|
|
Xinyuan TongandXinyuan Tong
|
38000a5f44
|
Fix gemma3n with hybrid swa (#8240)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-23 13:29:18 -07:00 |
|
|
Xinyuan TongandXinyuan Tong
|
70251e935e
|
fix: match chat-template for internvl3 (#8262)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-23 13:29:03 -07:00 |
|
|
Xinyuan TongandXinyuan Tong
|
69adc4f81c
|
fix: retrieve mm token by modality, raise error if none (#8221)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-22 08:06:35 +08:00 |
|
|
Xinyuan Tong
|
8430bfe3e9
|
[Refactor] simplify multimodal data processing (#8107)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-20 21:43:09 -07:00 |
|
|
Xinyuan Tong
|
7498522f7d
|
update transformers to 4.53.2 (#8029)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-15 18:24:39 -07:00 |
|
|
Xinyuan Tong
|
9120e83d03
|
fix: remove redundant rotary embedding cache recomputation in MiniCPM (#8022)
|
2025-07-15 00:12:45 -07:00 |
|
|
Xinyuan Tong
|
6e923dbd30
|
feat: update multimodal data handling in engine entrypoint (#8002)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-15 00:12:22 -07:00 |
|
|
Xinyuan Tong
|
e5888eddda
|
Fixes typo in assertion message (#7895)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-09 01:47:14 -07:00 |
|
|
Xinyuan Tong
|
136c6e0431
|
fix: Handles input_embeds in GenerateReqInput when n>1 (#7830)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-08 14:00:42 -07:00 |
|
|
Xinyuan Tong
|
43e20c0647
|
Support Mimo-VL (#7579)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-08 14:00:25 -07:00 |
|
|
Xinyuan Tong
|
4bab50a6b5
|
Fix llama4 vision (#7840)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-08 14:00:03 -07:00 |
|
|
Xinyuan Tong
|
43f93f632c
|
fix CI: update native api ipynb (#7754)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-07-03 15:25:00 -07:00 |
|
|
Xinyuan Tong
|
3a911b854d
|
Refactor mm processors and Enable mixed modality processing (#7629)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-06-30 23:14:48 -07:00 |
|
|
Xinyuan Tong
|
8f335b5bd6
|
Fix stream reasoning parser and Adds Kimi reasoning parser (#7432)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-06-29 14:39:05 -07:00 |
|
|
|
c45e49d817
|
oai: Adds support for OpenAI chat completions API in bench_serving (#7036)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-06-28 22:59:20 +00:00 |
|
|
Xinyuan Tong
|
357921aa51
|
Fix: Minicpm (#7612)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-06-27 17:32:29 -07:00 |
|
|
Xinyuan Tong
|
1b95162008
|
Updates transformers and timm dependencies (#7577)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-06-27 00:30:17 -07:00 |
|
|
Xinyuan Tong
|
604efe07e1
|
Updates Gemma3n MLP layer to adapt latest transformers version (#7573)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-06-26 15:07:22 -07:00 |
|
|
|
9b00990bea
|
chore: remove vlm unnecessary import (#7541)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-06-26 01:38:15 -07:00 |
|
|
Xinyuan TongandChang Su
|
0998808009
|
Refine OpenAI serving entrypoint to remove batch requests (#7372)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Chang Su <csu272@usc.edu>
|
2025-06-20 14:33:43 -07:00 |
|
|
Xinyuan Tong
|
70c471a868
|
[Refactor] OAI Server components (#7167)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-06-16 20:45:20 -07:00 |
|
|
Xinyuan Tong
|
697b0f71f0
|
[Refactor] image data process in bench_serving (#6879)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-06-06 21:11:17 -07:00 |
|
|
Xinyuan Tong
|
cf9815ba69
|
[Refactor] Multimodal data processing for VLM (#6659)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-06-04 11:22:33 -07:00 |
|
|
Xinyuan Tong
|
d6864ce6d6
|
[New Model] Devstral support (#6547)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-05-26 19:27:48 -07:00 |
|
|
Xinyuan Tong
|
681fdc264b
|
Refactor vlm embedding routine to use precomputed feature (#6543)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-05-24 18:39:21 -07:00 |
|
|
Xinyuan Tong
|
16d4f6801b
|
doc: Update README.md with adding deepwiki badge to enable weekly auto-refresh (#6508)
|
2025-05-21 16:27:34 -07:00 |
|
|
XinyuanTong
|
9d8ec2e67e
|
Fix and Clean up chat-template requirement for VLM (#6114)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-05-11 00:14:09 +08:00 |
|
|
XinyuanTong
|
e88dd482ed
|
[CI]Add performance CI for VLM (#6038)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-05-07 19:20:03 -07:00 |
|
|
XinyuanTong
|
6ea1e6ac6e
|
Support MMMU benchmark for InternVL (#5968)
|
2025-05-02 00:17:21 -07:00 |
|
|
XinyuanTong
|
c5645e928f
|
feat: add concurrency evaluation logic in mmmu benchmark (#5782)
|
2025-05-01 18:20:08 -07:00 |
|
|
XinyuanTong
|
e97e57e699
|
Remove unused method calculate_num_image_tokens from qwen2_vl.py (#5783)
|
2025-04-30 17:46:59 -07:00 |
|
|
XinyuanTong
|
8465f035d1
|
Add qwen3 30b fused moe config (#5859)
|
2025-04-29 00:24:00 -07:00 |
|
|
XinyuanTong
|
0045f4b2af
|
feat: Add fused moe triton config for qwen3 moe on h100 (#5833)
|
2025-04-28 08:37:13 -07:00 |
|
|
XinyuanTong
|
e7beff8a13
|
fix: examples for token_in_token_out_vlm (#5193)
|
2025-04-11 01:38:23 -07:00 |
|
|
XinyuanTong
|
d09a51f1f6
|
[feat&refactor] Enhance multimodal input support with refactor io_struct (#4938)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-04-08 14:48:07 -07:00 |
|
|
XinyuanTongandGeLee
|
9eb49e878b
|
[VLM RLHF] Take Image input for verl vlm rollout (#4915)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: GeLee <leege233@gmail.com>
|
2025-04-01 20:03:17 -07:00 |
|
|
XinyuanTong
|
42a45df043
|
[Fix] self.worker assignment in TpModelWorker and refactor references (#4788)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
|
2025-03-27 20:28:38 -07:00 |
|