 Yinghai Lu
|
e4b2b57620
|
[schedule] Fix streaming return of customized_info (#18654)
|
2026-02-13 17:19:16 +08:00 |
|
|
Yinghai Lu
|
11892599f1
|
[metric] Optional extra metric labels (#18049)
|
2026-02-01 14:25:59 +08:00 |
|
|
Yinghai LuandKangyan-Zhou
|
aea57b33c6
|
[scheduler] Clear MM data of finished batch (#17251)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2026-01-20 17:45:38 -08:00 |
|
|
Yinghai Lu
|
d3c08fb07c
|
[layers] support zero-dim rmsnorm (#16978)
|
2026-01-12 15:53:19 -08:00 |
|
|
Yinghai Lu
|
e91a717632
|
[llama] Allow passing tp_rank and tp_size into llama mlp (#16837)
|
2026-01-10 10:32:05 +08:00 |
|
|
Yinghai Lu
|
027042604d
|
[distributed] Clean up MoE groups in destroy_model_parallel (#15345)
|
2026-01-02 14:45:14 +08:00 |
|
|
Yinghai Lu
|
fc05acc2c7
|
[FusedMoE] Fix fused w13 tp sharded weight loading (#15432)
|
2025-12-21 13:59:36 +08:00 |
|
|
Yinghai Lu
|
d143b02097
|
[registry] Add a strict mode to model registration (#14933)
|
2025-12-13 09:25:48 +08:00 |
|
|
Yinghai Lu
|
b05b346a13
|
[loader] enable private loader (#14620)
|
2025-12-11 11:49:46 -08:00 |
|
|
Yinghai Lu
|
41429a8c10
|
[ez] Fix typing (#14473)
|
2025-12-05 12:23:13 +08:00 |
|
|
|
f4d7ab7a63
|
[sgl-router] improvement to avoid hang (#4482)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
|
2025-03-17 10:37:50 -07:00 |
|
|
Yinghai Lu
|
c614dbdf95
|
Nicer standalone engine inferface (#4480)
|
2025-03-17 01:42:04 -07:00 |
|
|
Yinghai LuandAlex Kirillov
|
2e4a1e2d05
|
Initialize image processor for skip-tokenizer-init codepath (#4479)
Co-authored-by: Alex Kirillov <alex@iterationlab.org>
|
2025-03-16 18:10:09 -07:00 |
|
|
Yinghai Lu
|
799fb5f455
|
400 on empty input_ids (#4481)
|
2025-03-16 14:01:23 -07:00 |
|