Commit Graph
18 Commits
Author SHA1 Message Date
Vincent ZhongandBrayden Zhong 2ac5b98395 fix: fix rmsnorm -> layernorm in qwen3 omni (#11791)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2025-12-06 12:12:57 +08:00
Vincent Zhong 6bc3062894 Fix launch of Olmo3 (#13666)
Signed-off-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
2025-11-20 12:04:30 -08:00
Vincent Zhong 0d116b9a0b Clean up deprecated tile_tokens_dim for next flashinfer (#13341)
Signed-off-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
2025-11-16 00:50:15 +08:00
Vincent Zhong b4d2da106e [docs] upd docker files names everywhere (#12133) 2025-10-25 18:20:23 -07:00
Vincent Zhong e8640ee9be [smol] [perf] Inverse perm improvement (#11482)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
2025-10-21 19:18:10 +08:00
Vincent Zhong a220536f40 [ perf ] Replace json-> orjson in hot path (#11221)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
2025-10-12 20:30:58 +08:00
Vincent Zhong be740acdb0 [smol] [perf] Qwen3-VL in place op. (#11481)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
2025-10-12 20:25:30 +08:00
Vincent Zhong 36a6b8dbfc Update v1/responses to be more OpenAI-compatible. (#9624) 2025-10-05 18:47:46 +00:00
Vincent Zhong 71959545df Fix gemma 3 launch with transformers: the error: AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size' (#9614) 2025-09-29 06:18:29 +00:00
Vincent Zhong 0b14159fc4 Add reasoning examples for GPT-OSS in Markdown examples (#9626) 2025-09-15 11:27:40 +08:00
Vincent Zhongandgemini-code-assist[bot] 1489cd6c02 [docs / oneliner] update mmmu docs instruction (#9768)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-09-15 11:26:39 +08:00
Vincent Zhong 9a0d0b754d [Performance] Improve Qwen RMSNorm by replacing with native RMSNorm op (#9709) 2025-08-31 17:20:50 +08:00
Vincent Zhong 327f7b7c87 fix(grok): remove duplicate replicate_lm_head configuration (#9549) 2025-08-23 19:49:24 -07:00
Vincent Zhongandb8zhong 45a31a82e4 docs: Update documentation to reflect xgrammar as default grammar backend (#6601)
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
2025-05-27 13:29:13 +08:00
Vincent ZhongandBrayden Zhong e9ef39d2e9 docs: Update the MD files (#6373)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2025-05-17 09:23:16 -07:00
vzed 95c231e50d Tool Call: Add chat_template_kwargs documentation (#5679) 2025-05-04 13:12:40 -07:00
vzed 094891c01a fix: Use is not None instead of != None for None checks. (#5687) 2025-04-26 19:26:57 -07:00
vzed df2cf583ce we fix the non existent access of decrypted_config_file (#5685) 2025-04-26 18:32:37 -07:00