 Mick
|
bf66b7b6da
|
[diffusion] model: support Ideogram4 NVFP4 (#27379)
|
2026-06-06 11:14:28 +08:00 |
|
|
Mick
|
ff70aeac30
|
[diffusion] feat: add performance mode server args (#24491)
|
2026-05-14 00:57:46 +08:00 |
|
|
Mick
|
b76730701b
|
[diffusion] feat: enhance overlay mechanism (#21648)
|
2026-03-30 19:45:34 +08:00 |
|
|
Lianmin ZhengandClaude Opus 4.6
|
1d9c8e8c9e
|
Simplify routed experts test and move base64 encoding to tokenizer manager (#21634)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-29 12:44:01 -07:00 |
|
|
Liangsheng Yin
|
f0458e0b49
|
[Utils] Move network/socket utilities from common.py to network.py (#20646)
|
2026-03-15 20:35:24 -07:00 |
|
|
psaabandhnyls2002
|
1145805e7d
|
Fix socket utilities and reserve_port for IPv6 dual-stack support (#20491)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-03-15 14:29:10 -07:00 |
|
|
shuwenn
|
538acb4c46
|
fix: Add .text property to HttpResponse to prevent AttributeError (#20518)
|
2026-03-14 22:59:32 -07:00 |
|
|
Kangyan-ZhouandClaude Opus 4.6
|
f5a4a5429f
|
Revert early HTTP port reservation (#17754, #19805) (#20468)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-03-12 16:17:33 -07:00 |
|
|
Liangsheng Yin
|
61cad15d28
|
[Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306)
|
2026-03-11 00:07:37 -07:00 |
|
|
Mohammad Miadh Angkad
|
09fa012ba7
|
Fix /health regression from early prebound socket listen (#19805)
|
2026-03-03 23:00:46 -08:00 |
|
|
xrwang8
|
cedb86a950
|
Feature:Reserve HTTP server port before model loading to immediately detect port conflicts instead of failing after several minutes of model loading. (#17754)
Signed-off-by: xrwang8 <xrwang8@gmail.com>
|
2026-03-03 11:59:18 -08:00 |
|
|
|
a55f658835
|
[Misc] Normalize --host parameter to use plain hostname without scheme (#19309)
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-02-25 00:37:24 -08:00 |
|
|
SoluMilken
|
07a24f1a38
|
update pre-commit config (#18860)
|
2026-02-16 00:18:31 +08:00 |
|
|
shuwenn
|
3299c4f9c1
|
[CI] feat: add early exit to wait_for_server when process dies (#18602)
|
2026-02-13 16:46:09 -08:00 |
|
|
赵晨阳
|
1552aab741
|
Support execute_shell_command for env var support (#18390)
|
2026-02-07 12:33:29 +08:00 |
|
|
xlzheng
|
37e8724ef3
|
perf: optimize TypeBasedDispatcher using dict for O(1) lookup (#12001)
|
2025-11-15 22:02:42 +08:00 |
|
|
Liangsheng Yin
|
1086473111
|
Enhance retract test (page cases, long output cases) (#12781)
|
2025-11-11 03:03:26 +08:00 |
|
|
Liangsheng Yin
|
4e916f9840
|
[lint] tiny fix unimported packages. (#12927)
|
2025-11-10 00:59:10 +08:00 |
|
|
Mick
|
f5b3ccd9a5
|
feat: basic support for server-level multimodal cache (#10775)
|
2025-11-10 00:27:50 +08:00 |
|
|
hzh0425
|
d9c812d881
|
[hotfix]: Resolve ModuleNotFoundError in PD deployment for is_in_ci() (#12772)
|
2025-11-06 18:48:03 -08:00 |
|
|
Baizhou Zhang
|
4ef981e2b6
|
Revert "[Fix] Fix lint to pass CI" (#12042)
|
2025-10-23 19:44:58 -07:00 |
|
|
Baizhou Zhang
|
69ed8b67a8
|
[Fix] Fix lint to pass CI (#12037)
|
2025-10-23 19:39:38 -07:00 |
|
|
Lianmin Zheng
|
ffc722a690
|
Revert "lang: support direct video inference" (#12038)
|
2025-10-23 19:21:31 -07:00 |
|
|
MickandLianmin Zheng
|
823b442945
|
lang: support direct video inference (#9936)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-10-23 18:12:39 -07:00 |
|
|
Lifu Huang
|
9241f4fd20
|
Move cached kernel to srt.utils (#10776)
|
2025-09-22 23:00:36 -07:00 |
|
|
Lianmin Zhengandcctry
|
38c00ed7a1
|
Fix multimodal registry and code sync scripts (#10759)
Co-authored-by: cctry <shiyang@x.ai>
|
2025-09-22 15:36:01 -07:00 |
|
|
Lifu Huang
|
2101d93b4f
|
Fix CI TestChunkedSGMV (#10737)
|
2025-09-22 16:09:58 +08:00 |
|
|
Lifu Huang
|
635ccda673
|
[4/4] Introduce CachedKernel to reduce CSGMV kernel launch overheads by 60% (#10709)
|
2025-09-21 22:26:42 -07:00 |
|
|
Liangsheng Yin
|
305c9e8c2d
|
[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)
|
2025-09-15 10:06:08 +08:00 |
|
|
Liangsheng Yin
|
78f139812a
|
[1/N] DP-Refactor: move communicators into tokenizer_communicator_mixin (#10028)
|
2025-09-08 16:27:37 +08:00 |
|
|
Huapeng Zhou
|
75ee00112d
|
[Doc] Fix SGLang tool parser doc (#9886)
|
2025-09-04 21:52:53 +08:00 |
|
|
Lianmin Zheng
|
c480a3f6ea
|
Minor style fixes for sgl-kernel (#9289)
|
2025-08-18 09:38:35 -07:00 |
|
|
Lianmin Zheng
|
2449a0afe2
|
Refactor the docs (#9031)
|
2025-08-10 19:49:45 -07:00 |
|
|
Lianmin Zheng
|
a4c3b121d8
|
Split the scheduler into multiple mixin classes to reduce the file size (#8483)
|
2025-07-29 12:46:50 -07:00 |
|
|
MickandXinyuan Tong
|
3212c2ad3f
|
vlm: optimize tensor transport (#6003)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-07-26 17:41:01 +08:00 |
|
|
Brayden Zhong
|
a37e1247c1
|
[Multimodal][Perf] Use pybase64 instead of base64 (#7724)
|
2025-07-08 14:00:58 -07:00 |
|
|
woodx
|
e30ef368ab
|
Feat/support rerank (#6058)
|
2025-06-16 10:50:01 -07:00 |
|
|
Lifu Huang
|
3cf1473a09
|
Use monotonic clock for interval measurement (#6211)
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
|
2025-05-17 16:49:18 -07:00 |
|
|
applesaucethebunandBrayden Zhong
|
2ce8793519
|
Add typo checker in pre-commit (#6179)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2025-05-11 12:55:00 +08:00 |
|
|
SEPLOS
|
032f8faaab
|
Fix sglang frontend's incorrect dependency on torch (#4931)
|
2025-03-30 13:00:24 -07:00 |
|
|
mlmzandshuaills
|
f6ab4ca6bc
|
fix: fix ipython running error for Engine due to outlines nest_asyncio (#4582)
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
|
2025-03-21 19:11:15 -07:00 |
|
|
Zhiqiang Xie
|
9376ac361d
|
Memory pool fix for upstream change about eagle (#4170)
|
2025-03-07 00:58:20 -08:00 |
|
|
Yueyang PanandZhiqiang Xie
|
25482edb5c
|
Online serving benchmarks of real datasets for hierarchical KV caching (#3211)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-03-05 16:16:43 -08:00 |
|
|
|
55de40f782
|
[Docs]: Fix Multi-User Port Allocation Conflicts (#3601)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: simveit <simp.veitner@gmail.com>
|
2025-02-19 11:15:44 -08:00 |
|
|
|
39416e394a
|
fix lockfile and port_registry file permission error (#3598)
Co-authored-by: jiada li <jiada@lmsys.us-northcentral1-a.compute.internal>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
|
2025-02-15 19:14:45 -08:00 |
|
|
Shi Shuaiandzhaochenyang20
|
7443197a63
|
[CI] Improve Docs CI Efficiency (#3587)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
|
2025-02-14 19:57:00 -08:00 |
|
|
|
7b9b4f4426
|
Docs fix about EAGLE and streaming output (#3166)
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>
|
2025-01-27 18:10:45 -08:00 |
|
|
Lianmin Zheng
|
73401fd016
|
Sync distributed package from vllm 0.6.4.post1 (#3010)
|
2025-01-20 04:57:14 -08:00 |
|
|
fzyzcjy
|
81d27c8e31
|
Refactor to add TypeBasedDispatcher to simplify dispatching (#2958)
|
2025-01-18 20:13:27 -08:00 |
|
|
SangBin Cho
|
9208618b3e
|
[Core] in batch prefix caching by delay scheduling (#2442)
|
2024-12-11 12:51:50 -08:00 |
|