13 Commits
Author SHA1 Message Date
Jonah Bernard 0d031335ed [Pipeline Parallelism][Bug] Fix scheduler hang in pipeline parallelism setup (#23006) 2026-04-17 14:50:47 +08:00
Jonah Bernard 8216b921a1 Add MLX profiling to bench_one_batch.py (#22159) 2026-04-09 20:45:21 +08:00
a32e0d57e7 [LoRA][III] Add LoRA support for MoE layers and enable TP (#14105)
Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-03-24 13:14:14 -07:00
Jonah BernardandQiaolin Yu fb37c0a400 [args] Add Expert Parallelism Argument To SRT Runner (#18492)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
2026-03-03 14:16:35 -08:00
Jonah Bernard d7a03c7ebf [MoE Refactor] Refactor FlashInferFusedMoE into FusedMoE and flashinfer_trtllm.py (#19266) 2026-02-24 16:47:53 -08:00
Jonah Bernard 45ef834412 Add MoE Integration Tests For CUTLASS Coverage (#16280) 2026-01-05 11:26:11 -08:00
Jonah Bernard bc25ea6762 [MoE] Add Comprehensive MoE Integration Tests (#12090) 2025-11-07 00:34:46 -08:00
Jonah Bernard a209fb05c1 [Qwen3 VL] Add LoRA support for Qwen 3 VL (#12165) 2025-11-03 20:32:54 -08:00
Jonah Bernard 6ef23b9833 [Test] Add parameters to SRTRunner (#12227) 2025-11-03 11:20:56 -08:00
Jonah Bernard 4b046a72d3 docs(server-arguments): add allowed options for each argument (#11560) 2025-10-24 11:49:20 -07:00
Jonah Bernard 62eff37ba1 Refactor Triton-kernel MoE runner integration (#11795) 2025-10-23 18:47:28 -07:00
Jonah BernardandSimo Lin f4aa78801e [router] Add Rust CLI flags for queue size, timeout, and rate limit for token bucket rate limiter (#11483)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2025-10-13 11:08:48 -07:00
Jonah Bernard 8e776c78a1 docs(router): add token-bucket rate limiting to the docs (#11485) 2025-10-12 20:03:27 -07:00