 shuwenn
|
ec5742f4ab
|
fix: Auto-correct page_size for Mamba no_buffer radix cache mode (#20538)
|
2026-04-08 00:19:31 +08:00 |
|
|
shuwenn
|
4f84ce5807
|
[CI] ci: add test_http_server_auth.py to CI (#21866)
|
2026-04-03 16:32:18 +08:00 |
|
|
shuwennandZhiqiang Xie
|
9cb362f70e
|
[HiCache] fix: Clone host indices to avoid memory leak (#21624)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-04-01 17:42:07 -07:00 |
|
|
shuwenn
|
a1c725bdc5
|
fix: pre-init tokenizer_manager to avoid AttributeError in shutdown (#21824)
|
2026-04-01 10:54:53 -07:00 |
|
|
shuwenn
|
6098c51bc2
|
fix(MiMo-V2-Flash): add mimo reasoning parser (#21414)
|
2026-04-02 00:47:27 +08:00 |
|
|
shuwenn
|
8e84f846cc
|
[Diffusion] Add --uvicorn-access-log-exclude-prefixes to suppress noisy access logs (#20379)
|
2026-04-01 09:31:44 +08:00 |
|
|
shuwenn
|
c34593f951
|
[HiCache] fix: graceful shutdown of pending async tasks in bench_mix.py (#20276)
|
2026-03-29 00:46:32 -07:00 |
|
|
shuwenn
|
18074e25dc
|
fix: scheduler launch hang when non-current rank dies (#20287)
|
2026-03-29 00:28:45 -07:00 |
|
|
shuwenn
|
646573e4e8
|
fix: use get_rope_config() to support models without rope_parameters (#21135)
|
2026-03-26 11:22:12 -07:00 |
|
|
shuwenn
|
2fba2bdad1
|
refactor: Remove dead code from utils/common.py (#20668)
|
2026-03-21 21:54:17 -07:00 |
|
|
shuwenn
|
6c91590e1b
|
[HiCache] refactor: hicache normalization flow and compatibility checks (#19669)
|
2026-03-20 18:38:44 -07:00 |
|
|
shuwenn
|
515b3a323d
|
feat: support human-readable suffixes (25.6k, 1M, 1Mi) for token CLI (#20577)
|
2026-03-16 20:05:33 -07:00 |
|
|
shuwenn
|
42f18fe560
|
[HiCache] fix: release write-through lock_ref during decode (#20049)
|
2026-03-16 14:49:31 +08:00 |
|
|
shuwenn
|
1ac6a26464
|
fix: Nemotron chunk size alias (#20458)
|
2026-03-14 23:23:39 -07:00 |
|
|
shuwenn
|
538acb4c46
|
fix: Add .text property to HttpResponse to prevent AttributeError (#20518)
|
2026-03-14 22:59:32 -07:00 |
|
|
shuwenn
|
acab24a76a
|
fix: gracefully abort last request in retract_decode on OOM (#19881)
|
2026-03-11 15:13:03 -07:00 |
|
|
shuwenn
|
5a11ae19c1
|
[CI] fix: notebook ci often OOM (#20199)
|
2026-03-09 22:32:41 -07:00 |
|
|
shuwenn
|
72f6dfcc31
|
fix: add ModelScope cache lookup and speculative path support (#20098)
|
2026-03-07 22:23:16 -08:00 |
|
|
shuwenn
|
7bd3dd9270
|
fix: image URL in notebook to use raw.githubusercontent.com (#20100)
|
2026-03-07 13:28:20 -08:00 |
|
|
shuwenn
|
bdffb027a8
|
[CI] fix: handle missing repo in lora notebook (#19700)
|
2026-03-02 10:27:32 -08:00 |
|
|
shuwenn
|
e3e71f275a
|
docs: refactor speculative decoding doc (#19186)
|
2026-03-01 22:03:20 -05:00 |
|
|
shuwenn
|
0c224c3c62
|
docs: Embed release lookup tool into Sphinx documentation site (#19264)
|
2026-02-24 11:11:27 -08:00 |
|
|
shuwenn
|
4cf4f0859f
|
[Doc] Convert the speculative decoding notebook to markdow (#18395)
|
2026-02-14 18:18:56 -08:00 |
|
|
shuwenn
|
bd39de7d5e
|
[Env] centralize hicache vars in environ.py (#17204)
|
2026-02-13 18:02:31 -08:00 |
|
|
shuwenn
|
3299c4f9c1
|
[CI] feat: add early exit to wait_for_server when process dies (#18602)
|
2026-02-13 16:46:09 -08:00 |
|
|
shuwenn
|
bc2405e6c1
|
feat: support release lookup (#18450)
|
2026-02-13 10:47:02 +08:00 |
|
|
shuwenn
|
8da14aea88
|
[HiCache] fix: StorageMetricsCollector was initialized twice (#18354)
|
2026-02-10 00:53:00 -08:00 |
|
|
shuwenn
|
f600965b0e
|
[CI] fix: notebook ci may not working (#18417)
|
2026-02-07 22:26:35 -08:00 |
|
|
shuwenn
|
ef1d0ea885
|
[Doc] add a summary section for spec decode document (#18323)
|
2026-02-05 16:34:31 -05:00 |
|
|
shuwenn
|
8b21dd4b77
|
[Doc] refine spec decode docs for SpecV2/STANDALONE/NGRAM (#18321)
|
2026-02-05 15:12:33 -05:00 |
|
|
shuwenn
|
a723d1c5ef
|
[model-gateway] ignore error for embeddings/classify in PD router (#15931)
|
2026-01-26 22:49:14 -05:00 |
|
|
shuwenn
|
57e432d951
|
fix: preserve disconnect events in api key middleware (#17253)
|
2026-01-26 22:48:24 -05:00 |
|
|
shuwenn
|
fd3b179ffd
|
[HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892)
|
2026-01-26 19:33:19 -08:00 |
|
|
shuwenn
|
8fb45523f3
|
feat: support bitsandbytes quantization algorithm (#15325)
|
2026-01-19 18:36:56 -08:00 |
|
|
shuwenn
|
71279e31f7
|
[CI] fix test_vlm_models.py (#17049)
|
2026-01-19 10:00:00 -08:00 |
|
|
shuwenn
|
8ec160ed46
|
feature: support uvicorn access log filter(disable logging /metrics) (#15513)
|
2026-01-15 20:00:06 -08:00 |
|
|
shuwenn
|
9227d9f60c
|
[Docs] sort and update server_arguments.md (#17163)
|
2026-01-15 12:07:18 -05:00 |
|
|
shuwennandXinyuan Tong
|
de94d793ad
|
feat: support qwen3(-VL) rerank scoring&chat template (#16403)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-01-15 00:45:46 +08:00 |
|
|
shuwenn
|
48c2aca9ba
|
[Env] centralize pd vars in environ.py (#16264)
|
2026-01-14 23:06:01 +08:00 |
|
|
shuwennandSimo Lin
|
cd33694585
|
feat: add --admin-api-key for finer-grained endpoint auth (#15908)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-13 20:21:55 -08:00 |
|
|
shuwenn
|
ac11e6a7c5
|
Add alphabetc1 into CI_PERMISSION (#16198)
|
2025-12-31 11:31:47 +08:00 |
|
|
shuwenn
|
c0fc7a89e7
|
[sgl-kernel] fix: make sgl-kernel build respect MAX_JOBS (#15575)
|
2025-12-31 10:44:45 +08:00 |
|
|
shuwenn
|
7380ec9d55
|
[CI] fix test_mla_deepseek_v3.py (#16096)
|
2025-12-29 10:18:02 -08:00 |
|
|
shuwenn
|
fe3d47fc9d
|
fix: warn once per env var key (#15846)
|
2025-12-26 18:41:15 +08:00 |
|
|
shuwenn
|
53f974b973
|
fix: potential crash for missing stream attribute (#15644)
|
2025-12-23 23:24:31 +08:00 |
|
|
shuwenn
|
758b9067a0
|
[CI] fix UT assert error in test_tokenizer_manager.py (#15646)
|
2025-12-23 22:24:33 +08:00 |
|
|
shuwenn
|
1d9ba2ce4d
|
[model-gateway] Use UUIDs for router-managed worker resources (#15540)
|
2025-12-21 07:40:03 -10:00 |
|
|
shuwenn
|
1d90b194b2
|
[model-gateway] bugfix: backward compatibility for GET endpoints (#15413)
|
2025-12-20 10:37:53 -10:00 |
|
|
shuwenn
|
5a0ad7310e
|
fix: update model name after weights update (#15416)
|
2025-12-19 21:53:14 +08:00 |
|
|
shuwennandLiangsheng Yin
|
fb17845723
|
fix: unreachable error check in retraction (#15433)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-19 16:33:34 +08:00 |
|
|
shuwenn
|
621061f017
|
[Bugfix] input prompt was not logged (#13936)
|
2025-11-28 16:00:51 +08:00 |
|