 Liangsheng Yin
|
9fed58805f
|
[Doc] Clarify SWA HybridSWAPoolConfigurator comments on all-SWA vs hybrid semantics (#22443)
|
2026-04-09 03:02:16 -07:00 |
|
|
Liangsheng YinandKe Bao
|
8ff01d6841
|
[Test] Add CPU unit tests for MemoryPoolConfigurator (#22420)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-04-09 00:39:19 -07:00 |
|
|
Liangsheng Yin
|
de441ac6bb
|
[core] Introduce MemoryPoolConfigurator class hierarchy (#22389)
|
2026-04-09 15:29:19 +08:00 |
|
|
Liangsheng Yin
|
edfddda192
|
Move runai model loader test to nightly suite (#22418)
|
2026-04-08 21:39:32 -07:00 |
|
|
Liangsheng Yin
|
2c4e113dd7
|
[CI] Fast-fail on lint check failure in check-stage-health (#22400)
|
2026-04-08 17:17:07 -07:00 |
|
|
Liangsheng Yin
|
1e3f6ebea6
|
[core] Extract pool sizing logic to pool_configurator.py (#22384)
|
2026-04-08 16:13:21 -07:00 |
|
|
|
1c5c6dad5e
|
[tiny] Fix TOCTOU race in pause-aware weight update locking (#22304)
Co-authored-by: maocheng23 <maocheng@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-07 18:54:28 -07:00 |
|
|
Liangsheng Yin
|
8c3d80eabe
|
Only upload CUDA coredumps on test failure (#22301)
|
2026-04-07 18:07:28 -07:00 |
|
|
Liangsheng Yin
|
0e2a0260a1
|
Add fast-fail to multimodal-gen CI (#22284)
|
2026-04-07 15:56:12 -07:00 |
|
|
Liangsheng Yin
|
cc35714b03
|
[tiny] migrate /get_server_info; print accept length in accuracy tests (#22282)
|
2026-04-07 13:08:35 -07:00 |
|
|
Liangsheng Yin
|
be0277f9a0
|
[Spec][Ngram] Add output-as-corpus accept length benchmark for external SAM (#22199)
|
2026-04-06 19:09:52 -07:00 |
|
|
Liangsheng Yin
|
e4b1366a46
|
[Spec][Ngram] Support multiple SAMs with dynamic HTTP API (#22203)
|
2026-04-06 18:49:22 -07:00 |
|
|
Liangsheng Yin
|
49cb7d546e
|
Move hash utils out of hicache_storage to break CUDA import chain (#22214)
|
2026-04-06 18:16:40 -07:00 |
|
|
Liangsheng Yin
|
6de2ff2a80
|
[Spec][Ngram] Followup fixes for MatchState incremental advance (#22180)
|
2026-04-05 23:04:28 -07:00 |
|
|
Liangsheng YinandShangming Cai
|
3a4f4cbc52
|
DEBUG: reproduce flaky test_load_weights_from_remote_instance (#22150)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-04-05 22:46:36 +08:00 |
|
|
Liangsheng Yin
|
df9c831ab8
|
Unify think_end_id to model_config as single source of truth (#22148)
|
2026-04-05 03:35:38 -07:00 |
|
|
Liangsheng Yin
|
aeff9fb7c1
|
Add dump_metric to MMMU, lm-eval, and NeMo Skills eval paths (#22147)
|
2026-04-05 03:23:52 -07:00 |
|
|
Liangsheng Yin
|
cd2d45e220
|
Isolate spec V1 path in decode post-processing (#22146)
|
2026-04-05 03:16:56 -07:00 |
|
|
Liangsheng Yin
|
bd6a585605
|
Consolidate reasoning tests into test/registered/reasoning/ (#22139)
|
2026-04-05 01:09:11 -07:00 |
|
|
Liangsheng Yin
|
904bb476d8
|
Migrate reasoning_tokens tests to existing server fixtures (#22102)
|
2026-04-05 00:30:57 -07:00 |
|
|
Liangsheng Yin
|
bb9e058f5b
|
Add failfast flag to rerun-test workflow (#22141)
|
2026-04-05 00:24:50 -07:00 |
|
|
Liangsheng Yin
|
675100b53a
|
Remove flaky TestToolChoiceLfm2Moe from test_tool_choice (#22137)
|
2026-04-04 22:53:11 -07:00 |
|
|
Liangsheng Yin
|
abc297521f
|
Fix killall_sglang missing the main sglang serve process (#22103)
|
2026-04-04 03:43:08 -07:00 |
|
|
Liangsheng Yin
|
e9d92b0e33
|
Relax spec decoding accuracy threshold to fix flaky test (#22100)
|
2026-04-04 02:38:35 -07:00 |
|
|
Liangsheng Yin
|
95cdbce34f
|
[Test] Extract common PD server setup into base fixture (#22080)
|
2026-04-03 16:37:12 -07:00 |
|
|
Liangsheng Yin
|
5118295f7b
|
[CI] Support CPU stage and auto-batch same-stage files in /rerun-test (#22081)
|
2026-04-03 15:56:54 -07:00 |
|
|
Liangsheng Yin
|
4cc970290d
|
[CI] Fix duplicate job names that bypass branch protection (#22001)
|
2026-04-02 23:59:35 -07:00 |
|
|
Liangsheng YinandDarkSharpness
|
9d9537fbd3
|
Migrate ngram corpus from torch cpp_extension to TVM FFI jit_kernel (#21920)
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-04-02 02:18:11 -07:00 |
|
|
Liangsheng Yin
|
f25bf86065
|
Fix ngram doc for speculative_num_draft_tokens default (#21910)
|
2026-04-01 22:18:24 -07:00 |
|
|
Liangsheng Yin
|
269589ad71
|
Return HTTP 400 for streaming validation errors (#21900)
|
2026-04-01 21:58:12 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
875a615993
|
fix(ci): update est_time for 57 tests based on runtime analysis (#21896)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-01 20:16:13 -07:00 |
|
|
Liangsheng Yin
|
ae3b207dfd
|
Allow /rerun-test to checkout fork PR branch for trusted users (#21890)
|
2026-04-01 18:20:29 -07:00 |
|
|
Liangsheng Yin
|
d7256eb69a
|
Unify GSM8K eval path to Chat API for regression CI readiness (#21667)
|
2026-04-01 17:12:19 -07:00 |
|
|
Liangsheng Yin
|
70fc4ce3ef
|
Add merge prohibition policy during CI maintenance mode (#21882)
|
2026-04-01 15:08:09 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
0138708576
|
[Misc] Add network timeout to eval dataset downloads (#21873)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-01 13:16:14 -07:00 |
|
|
Liangsheng Yin
|
ac039bd04e
|
Use CustomTestCase for TestSessionControl to enable CI retry (#21830)
|
2026-04-01 04:26:11 -07:00 |
|
|
Liangsheng Yin
|
09907795e1
|
Add latency and throughput metrics to run_eval (#21793)
|
2026-03-31 18:36:14 -07:00 |
|
|
Liangsheng Yin
|
e4c565f2f2
|
[Misc] Tiny: Add test network timeouts and dynamic max-parallel for 5090/2-gpu runners (#21800)
|
2026-03-31 18:27:39 -07:00 |
|
|
Liangsheng Yin
|
a8759dd9af
|
Fix killall.py crash when sglang is not yet installed (#21797)
|
2026-03-31 17:40:58 -07:00 |
|
|
Liangsheng Yin
|
b6fe0cca99
|
Switch MooncakeSpec to EAGLE3 + Llama-3.1 (#21794)
|
2026-03-31 17:12:20 -07:00 |
|
|
Liangsheng Yin
|
d047d41bad
|
Increase hicache eval to 200 examples (#21791)
|
2026-03-31 16:58:44 -07:00 |
|
|
Liangsheng Yin
|
7932e4c3e6
|
Remove redundant test_moe_eval_accuracy_large (#21787)
|
2026-03-31 16:45:03 -07:00 |
|
|
Liangsheng Yin
|
7581d814ae
|
Add CompletionSampler for non-chat eval in run_eval (#21785)
|
2026-03-31 16:33:07 -07:00 |
|
|
Liangsheng Yin
|
53d8aa23ae
|
Cache nvidia wheels locally to skip repeated 830 MB downloads in CI (#21778)
|
2026-03-31 16:06:09 -07:00 |
|
|
Liangsheng Yin
|
f4505e2ee3
|
Fix ineffective is_base_mistral CI patch for HF API rate limiting (#21729)
|
2026-03-31 12:54:34 -07:00 |
|
|
Liangsheng Yinandwan4ch
|
c06ca1526c
|
Fix circular reference in CustomTestCase.__init_subclass__ (#21650)
Co-authored-by: wan4ch <wan4ch@gmail.com>
|
2026-03-29 20:38:12 -07:00 |
|
|
Liangsheng Yin
|
fec9961a1f
|
Clean up _wait_for_scheduler_ready implementation (#21626)
|
2026-03-29 01:02:33 -07:00 |
|
|
Liangsheng Yin
|
402628e560
|
Patch transformers is_base_mistral in CI to avoid HF 429 rate limiting (#21586)
|
2026-03-27 22:19:36 -07:00 |
|
|
Liangsheng Yin
|
19b1f75186
|
Fix HFRunner hang when subprocess dies during init (#21582)
|
2026-03-27 21:22:42 -07:00 |
|
|
Liangsheng Yin
|
e1ee68d0fc
|
Release mm features on session close and support multiple /rerun-ut specs (#21501)
|
2026-03-26 18:31:29 -07:00 |
|
|
Liangsheng Yin
|
8a4cdcd538
|
Simplify flush_cache: reject concurrent requests, remove client-side retry (#21490)
|
2026-03-26 16:31:04 -07:00 |
|
|
Liangsheng Yin
|
9dc266adb4
|
Fix concurrent /rerun-ut posting duplicate workflow URLs (#21495)
|
2026-03-26 16:26:00 -07:00 |
|
|
Liangsheng Yin
|
c580ddd19d
|
Fix benchmark generating empty prompts when random_input_len is small (#21492)
|
2026-03-26 16:24:35 -07:00 |
|
|
Liangsheng Yin
|
fb90c9d298
|
[Test] Consolidate eval accuracy test mixins into eval_accuracy_kit (#21047)
|
2026-03-26 14:26:46 -07:00 |
|
|
Liangsheng Yin
|
e5dd411f64
|
[CI] Add ci-workflow-guide skill and consolidate CI docs (#21429)
|
2026-03-26 13:50:13 -07:00 |
|
|
Liangsheng Yin
|
e5b7650353
|
Fix UnboundLocalError when DetokenizerManager constructor fails (#21471)
|
2026-03-26 13:00:16 -07:00 |
|
|
Liangsheng Yin
|
17f43d1518
|
[CI] Skip stage health check for release branch cut (#21488)
|
2026-03-26 12:54:51 -07:00 |
|
|
Liangsheng Yin
|
79db3bec34
|
[CI] Add PID namespace and ps auxf diagnostics to killall.py (#21401)
|
2026-03-25 23:57:15 -07:00 |
|
|
Liangsheng Yin
|
176c8e7b0e
|
[CI] Simplify CI check actions and add maintenance gate to rerun-ut (#21455)
|
2026-03-25 23:28:18 -07:00 |
|
|
Liangsheng Yin
|
75682f1d2f
|
Remove noisy streaming backlog warning log (#21432)
|
2026-03-25 16:25:16 -07:00 |
|
|
Liangsheng Yin
|
4dd4e06f1d
|
[CI] Fix resource leak when setUpClass fails (#21338)
|
2026-03-25 16:22:44 -07:00 |
|
|
Liangsheng Yin
|
d5c5683d2b
|
[CI] Use ETag conditional requests in wait-for-jobs and add CI infra to check-changes (#21345)
|
2026-03-25 14:40:07 -07:00 |
|
|
Liangsheng Yin
|
4480e6c237
|
[CI] Add retry loop to killall_sglang GPU cleanup verification (#21393)
|
2026-03-25 02:16:20 -07:00 |
|
|
Liangsheng Yin
|
d937d01fe6
|
[CI] Fix cancel workflow: use bypass-maintenance label (#21364)
|
2026-03-24 21:43:00 -07:00 |
|
|
Liangsheng Yin
|
c769398748
|
[CI] Add include_high_priority checkbox to cancel workflow (#21363)
|
2026-03-24 21:30:44 -07:00 |
|
|
Liangsheng Yin
|
cd634abee4
|
[CI] Reduce session correctness test to 30 turns to fix flakiness (#21349)
|
2026-03-24 18:56:01 -07:00 |
|
|
Liangsheng Yin
|
37420dce0b
|
[CI] Enable failfast (-f) by default in run_suite.py (#21330)
|
2026-03-24 17:04:42 -07:00 |
|
|
Liangsheng Yin
|
3937a07b17
|
[CI] Add cross-job fast-fail health check (Layer 3) (#21341)
|
2026-03-24 16:58:56 -07:00 |
|
|
Liangsheng Yin
|
30896bd927
|
[CI] Remove test partition assignments from CI summary (#21344)
|
2026-03-24 16:27:47 -07:00 |
|
|
Liangsheng Yin
|
31c35f1c22
|
[CI] Skip multimodal CI for doc-only changes (#21334)
|
2026-03-24 14:07:25 -07:00 |
|
|
Liangsheng Yin
|
d9f5c2179c
|
ci(slash-cmd): allow write-permission users to /rerun-ut on fork PRs (#21121)
|
2026-03-22 00:45:48 -07:00 |
|
|
Liangsheng Yin
|
1e97864d75
|
ci(slash-cmd): allow repo write-permission users to /rerun-ut (#21120)
|
2026-03-22 00:32:29 -07:00 |
|
|
Liangsheng Yin
|
47d36d73f7
|
Update write-sglang-test skill: CUDA-only for common tests + prefer mock (#21119)
|
2026-03-21 22:54:43 -07:00 |
|
|
Liangsheng Yin
|
ff921a2ed3
|
Update cron schedule for PR test workflow (#21090)
|
2026-03-21 01:03:45 -07:00 |
|
|
Liangsheng Yin
|
9614271ae4
|
[Test] Fix flaky multi-instance memory occupation test (#21074)
|
2026-03-20 22:19:03 -07:00 |
|
|
Liangsheng Yin
|
6ad78b008b
|
Consolidate streaming session tests (4 files → 3, fewer server starts) (#20961)
|
2026-03-19 19:13:28 -07:00 |
|
|
Liangsheng Yin
|
8d22efdeea
|
[Tiny Fix] Fix IS_BLACKWELL env var empty string warning in rerun-ut workflow (#20957)
|
2026-03-19 17:24:35 -07:00 |
|
|
Liangsheng Yin
|
2b53e660de
|
Simplify streaming session logprob handling (#20955)
|
2026-03-19 17:09:40 -07:00 |
|
|
Liangsheng Yin
|
8b9482e665
|
fix(dp-attn): consistent overlap disable decision across DP ranks (#20853)
|
2026-03-18 15:16:39 -07:00 |
|
|
Liangsheng Yin
|
4d3976b6c5
|
[HiCache] Check in-flight async ops in is_fully_idle() before attach/detach (#20746)
|
2026-03-17 17:28:26 -07:00 |
|
|
Liangsheng Yin
|
5270a06488
|
[Disagg] Fix health check false-positive in disagg is_fully_idle (#20756)
|
2026-03-17 17:18:54 +08:00 |
|
|
Liangsheng Yin
|
f0458e0b49
|
[Utils] Move network/socket utilities from common.py to network.py (#20646)
|
2026-03-15 20:35:24 -07:00 |
|
|
Liangsheng Yin
|
d852f26cb6
|
Fix dual-stack socket handling: IPV6_V6ONLY, IPv4-first, is_port_available all-family check (#20643)
|
2026-03-15 17:17:23 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
c2245d9b55
|
ci: add runner dropdown to rerun-ut workflow dispatch (#20645)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-15 16:40:14 -07:00 |
|
|
Liangsheng Yin
|
116aef8504
|
[Test] Move embedding tests into test/registered/embedding/ and unit/ (#20642)
|
2026-03-15 14:48:43 -07:00 |
|
|
Liangsheng Yin
|
8397a8a301
|
[CI] Extract wait-for-jobs composite action and gate on stage-a-cpu-only (#20641)
|
2026-03-15 13:52:48 -07:00 |
|
|
Liangsheng Yin
|
fc7f9c1de7
|
Rename --stream-output to --incremental-streaming-output (#20614)
|
2026-03-14 23:22:33 -07:00 |
|
|
Liangsheng Yin
|
f605612b87
|
[HTTP] Fix /GET HTTP route when ollama endpoint is not set. (#20494)
|
2026-03-12 20:54:32 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
5f1bfb0d28
|
[Security] Fix /rerun-ut bypassing run-ci gate for fork PRs (#20424)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-12 02:24:29 -07:00 |
|
|
Liangsheng Yin
|
61cad15d28
|
[Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306)
|
2026-03-11 00:07:37 -07:00 |
|
|
Liangsheng Yin
|
50953aea8d
|
[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296)
|
2026-03-10 17:50:23 -07:00 |
|
|
Liangsheng Yin
|
ac07a6d439
|
Revert "[Scheduler] Decouple maybe_send_health_check_signal from process_batch_result" (#20259)
|
2026-03-10 01:58:48 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
208f1428e9
|
[Scheduler] Decouple maybe_send_health_check_signal from process_batch_result (#20227)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-09 21:18:56 -07:00 |
|
|
Liangsheng Yin
|
ffb4b6f4c1
|
[Core] Replace server_args mutation hack with explicit MemoryPoolConfig for draft worker init (#20183)
|
2026-03-09 11:45:54 -07:00 |
|
|
Liangsheng Yin
|
2ef00383ab
|
[Core] Refactor init_memory_pool into composable resolution helpers (#20142)
|
2026-03-08 21:46:27 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
7105bf3782
|
[Bug] Fix missing TTFT histogram for single-batch requests (#20122)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-08 15:18:51 -07:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot]
|
29f3a5396e
|
[Minor] Add SessionSlot.is_holding_kv property for readability (#20120)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-03-08 03:25:13 -07:00 |
|
|
|
36b557d2c9
|
Fix streaming session with paged KV cache (SWA/MLA) (#20070)
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-03-08 03:00:32 -07:00 |
|
|
Liangsheng Yin
|
d02c515ee8
|
Decouple scheduler log printing from metrics collection (#20107)
|
2026-03-07 22:09:10 -08:00 |
|
|
Liangsheng Yin
|
69ec15ad74
|
[CI] Re-enable streaming session tests with correctness and stress coverage (#20084)
|
2026-03-07 18:18:11 -08:00 |
|