Commit Graph
32 Commits
Author SHA1 Message Date
shuwenn bdffb027a8 [CI] fix: handle missing repo in lora notebook (#19700) 2026-03-02 10:27:32 -08:00
shuwenn e3e71f275a docs: refactor speculative decoding doc (#19186) 2026-03-01 22:03:20 -05:00
shuwenn 0c224c3c62 docs: Embed release lookup tool into Sphinx documentation site (#19264) 2026-02-24 11:11:27 -08:00
shuwenn 4cf4f0859f [Doc] Convert the speculative decoding notebook to markdow (#18395) 2026-02-14 18:18:56 -08:00
shuwenn bd39de7d5e [Env] centralize hicache vars in environ.py (#17204) 2026-02-13 18:02:31 -08:00
shuwenn 3299c4f9c1 [CI] feat: add early exit to wait_for_server when process dies (#18602) 2026-02-13 16:46:09 -08:00
shuwenn bc2405e6c1 feat: support release lookup (#18450) 2026-02-13 10:47:02 +08:00
shuwenn 8da14aea88 [HiCache] fix: StorageMetricsCollector was initialized twice (#18354) 2026-02-10 00:53:00 -08:00
shuwenn f600965b0e [CI] fix: notebook ci may not working (#18417) 2026-02-07 22:26:35 -08:00
shuwenn ef1d0ea885 [Doc] add a summary section for spec decode document (#18323) 2026-02-05 16:34:31 -05:00
shuwenn 8b21dd4b77 [Doc] refine spec decode docs for SpecV2/STANDALONE/NGRAM (#18321) 2026-02-05 15:12:33 -05:00
shuwenn a723d1c5ef [model-gateway] ignore error for embeddings/classify in PD router (#15931) 2026-01-26 22:49:14 -05:00
shuwenn 57e432d951 fix: preserve disconnect events in api key middleware (#17253) 2026-01-26 22:48:24 -05:00
shuwenn fd3b179ffd [HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892) 2026-01-26 19:33:19 -08:00
shuwenn 8fb45523f3 feat: support bitsandbytes quantization algorithm (#15325) 2026-01-19 18:36:56 -08:00
shuwenn 71279e31f7 [CI] fix test_vlm_models.py (#17049) 2026-01-19 10:00:00 -08:00
shuwenn 8ec160ed46 feature: support uvicorn access log filter(disable logging /metrics) (#15513) 2026-01-15 20:00:06 -08:00
shuwenn 9227d9f60c [Docs] sort and update server_arguments.md (#17163) 2026-01-15 12:07:18 -05:00
shuwennandXinyuan Tong de94d793ad feat: support qwen3(-VL) rerank scoring&chat template (#16403)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-01-15 00:45:46 +08:00
shuwenn 48c2aca9ba [Env] centralize pd vars in environ.py (#16264) 2026-01-14 23:06:01 +08:00
shuwennandSimo Lin cd33694585 feat: add --admin-api-key for finer-grained endpoint auth (#15908)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2026-01-13 20:21:55 -08:00
shuwenn ac11e6a7c5 Add alphabetc1 into CI_PERMISSION (#16198) 2025-12-31 11:31:47 +08:00
shuwenn c0fc7a89e7 [sgl-kernel] fix: make sgl-kernel build respect MAX_JOBS (#15575) 2025-12-31 10:44:45 +08:00
shuwenn 7380ec9d55 [CI] fix test_mla_deepseek_v3.py (#16096) 2025-12-29 10:18:02 -08:00
shuwenn fe3d47fc9d fix: warn once per env var key (#15846) 2025-12-26 18:41:15 +08:00
shuwenn 53f974b973 fix: potential crash for missing stream attribute (#15644) 2025-12-23 23:24:31 +08:00
shuwenn 758b9067a0 [CI] fix UT assert error in test_tokenizer_manager.py (#15646) 2025-12-23 22:24:33 +08:00
shuwenn 1d9ba2ce4d [model-gateway] Use UUIDs for router-managed worker resources (#15540) 2025-12-21 07:40:03 -10:00
shuwenn 1d90b194b2 [model-gateway] bugfix: backward compatibility for GET endpoints (#15413) 2025-12-20 10:37:53 -10:00
shuwenn 5a0ad7310e fix: update model name after weights update (#15416) 2025-12-19 21:53:14 +08:00
shuwennandLiangsheng Yin fb17845723 fix: unreachable error check in retraction (#15433)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-12-19 16:33:34 +08:00
shuwenn 621061f017 [Bugfix] input prompt was not logged (#13936) 2025-11-28 16:00:51 +08:00