Commit Graph
9 Commits
Author SHA1 Message Date
Jinn 1953efb60e [AMD] ROCm: route W4A16 MoE to Triton and fix packed-weight loading (#17863) 2026-01-28 08:20:23 -08:00
Jinn ab74f8f09d Remove batches api in docs & example (#7400) 2025-06-20 19:46:31 -07:00
Jinn ffd1a26e09 Add more refactored openai test & in CI (#7284) 2025-06-18 13:52:55 -07:00
Jinn 50876abc47 Add test for refactored openai server (#7161) 2025-06-13 20:42:57 -07:00
Jhinandzhaochenyang20 70b3c6eeb1 Add update_weights_from_disk endpoint to Engine (#4102)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-03-05 12:25:18 -08:00
Jhin bf2a70872e Update DeepSeek V3 Doc (#3541) 2025-02-12 23:15:37 -08:00
656f7fc1bc Docs: Quick fix for Speculative_decoding doc (#3228)
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
2025-01-31 08:30:40 -08:00
7b9b4f4426 Docs fix about EAGLE and streaming output (#3166)
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>
2025-01-27 18:10:45 -08:00
9472e69963 Doc: Add Docs about EAGLE speculative decoding (#3144)
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-01-26 17:49:13 -08:00