 Simo Lin
|
41d33e4736
|
[router] add ut for worker and errors (#8170)
|
2025-07-19 14:38:33 -07:00 |
|
|
Simo Lin
|
b763cf7e8e
|
[router] allow router to have empty workers (#8160)
|
2025-07-18 22:09:54 -07:00 |
|
|
Simo Lin
|
8fcc55cfa1
|
[router] router metrics cleanup (#8158)
|
2025-07-18 22:09:17 -07:00 |
|
|
|
c8f31042a8
|
[router] Refactor router and policy traits with dependency injection (#7987)
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>
|
2025-07-18 14:24:24 -07:00 |
|
|
Simo Lin
|
8a7a7770e5
|
[ci] limit cmake build nproc (#8100)
|
2025-07-16 18:09:28 -07:00 |
|
|
Simo Lin
|
d9eb5efc71
|
[misc] update nvshmem and pin deepEP commit hash (#8098)
|
2025-07-16 08:54:55 -07:00 |
|
|
Simo Lin
|
f2d5c4920e
|
[router] add worker abstraction (#7960)
|
2025-07-11 20:17:48 -07:00 |
|
|
Simo Lin
|
4ed57807c2
|
[bugfix] add pd router policy validation (#7904)
|
2025-07-09 21:52:06 -07:00 |
|
|
Simo Lin
|
3646f6bb3e
|
[misc] release new router version (#7798)
|
2025-07-06 22:54:17 -07:00 |
|
|
Simo Lin
|
35724aa182
|
[docs] update router readme (#7797)
|
2025-07-06 22:54:11 -07:00 |
|
|
Simo Lin
|
ea3e7ffec7
|
[bugfix] Fix sgl-router get_server_info endpoint compatibility issue (#7813)
|
2025-07-06 19:52:57 -07:00 |
|
|
Simo Lin
|
5732d904cc
|
[misc] remove pdlb rust (#7796)
|
2025-07-05 17:44:51 -07:00 |
|
|
Simo Lin
|
e3f9b54819
|
[bugfix] fix runtime dropping panic in editable (#7628)
|
2025-06-29 15:38:28 -07:00 |
|
|
Simo Lin
|
7c0db3a6c5
|
[bugfix] Remove PR comment posting from Rust benchmark workflow (#7625)
|
2025-06-28 22:10:01 -07:00 |
|
|
Simo Lin
|
c071198c1d
|
[router] add centralized configuration module for sgl-router (#7588)
|
2025-06-27 15:42:02 -07:00 |
|
|
Simo Lin
|
3abc30364d
|
[ci] add router benchmark script and CI (#7498)
|
2025-06-25 01:28:25 -07:00 |
|
|
Simo Lin
|
30f2a44a96
|
[misc] Add PD service discovery support in router (#7361)
|
2025-06-22 17:54:14 -07:00 |
|
|
Simo Lin
|
09ae5b20f3
|
Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096)
|
2025-06-19 02:28:15 +08:00 |
|
|
Simo Lin
|
771669cbe0
|
[fix]: PyO3 macOS linking and consolidate on tracing for logging
|
2025-04-29 11:26:38 -07:00 |
|
|
Simo Lin
|
1468769bde
|
[Misc] add service discovery for sgl router
|
2025-04-29 10:21:19 -07:00 |
|
|
Simo Lin
|
f0365820e8
|
[Misc] add structure logging, write to file and log tracing for SGL Router
|
2025-04-27 16:54:10 -07:00 |
|