 Liangsheng Yin
|
09907795e1
|
Add latency and throughput metrics to run_eval (#21793)
|
2026-03-31 18:36:14 -07:00 |
|
|
Liangsheng Yin
|
e4c565f2f2
|
[Misc] Tiny: Add test network timeouts and dynamic max-parallel for 5090/2-gpu runners (#21800)
|
2026-03-31 18:27:39 -07:00 |
|
|
Liangsheng Yin
|
a8759dd9af
|
Fix killall.py crash when sglang is not yet installed (#21797)
|
2026-03-31 17:40:58 -07:00 |
|
|
Liangsheng Yin
|
b6fe0cca99
|
Switch MooncakeSpec to EAGLE3 + Llama-3.1 (#21794)
|
2026-03-31 17:12:20 -07:00 |
|
|
Liangsheng Yin
|
d047d41bad
|
Increase hicache eval to 200 examples (#21791)
|
2026-03-31 16:58:44 -07:00 |
|
|
Liangsheng Yin
|
7932e4c3e6
|
Remove redundant test_moe_eval_accuracy_large (#21787)
|
2026-03-31 16:45:03 -07:00 |
|
|
Liangsheng Yin
|
7581d814ae
|
Add CompletionSampler for non-chat eval in run_eval (#21785)
|
2026-03-31 16:33:07 -07:00 |
|
|
Liangsheng Yin
|
53d8aa23ae
|
Cache nvidia wheels locally to skip repeated 830 MB downloads in CI (#21778)
|
2026-03-31 16:06:09 -07:00 |
|
|
Liangsheng Yin
|
f4505e2ee3
|
Fix ineffective is_base_mistral CI patch for HF API rate limiting (#21729)
|
2026-03-31 12:54:34 -07:00 |
|
|
Liangsheng Yinandwan4ch
|
c06ca1526c
|
Fix circular reference in CustomTestCase.__init_subclass__ (#21650)
Co-authored-by: wan4ch <wan4ch@gmail.com>
|
2026-03-29 20:38:12 -07:00 |
|
|
Liangsheng Yin
|
fec9961a1f
|
Clean up _wait_for_scheduler_ready implementation (#21626)
|
2026-03-29 01:02:33 -07:00 |
|
|
Liangsheng Yin
|
402628e560
|
Patch transformers is_base_mistral in CI to avoid HF 429 rate limiting (#21586)
|
2026-03-27 22:19:36 -07:00 |
|
|
Liangsheng Yin
|
19b1f75186
|
Fix HFRunner hang when subprocess dies during init (#21582)
|
2026-03-27 21:22:42 -07:00 |
|
|
Liangsheng Yin
|
e1ee68d0fc
|
Release mm features on session close and support multiple /rerun-ut specs (#21501)
|
2026-03-26 18:31:29 -07:00 |
|
|
Liangsheng Yin
|
8a4cdcd538
|
Simplify flush_cache: reject concurrent requests, remove client-side retry (#21490)
|
2026-03-26 16:31:04 -07:00 |
|
|
Liangsheng Yin
|
9dc266adb4
|
Fix concurrent /rerun-ut posting duplicate workflow URLs (#21495)
|
2026-03-26 16:26:00 -07:00 |
|
|
Liangsheng Yin
|
c580ddd19d
|
Fix benchmark generating empty prompts when random_input_len is small (#21492)
|
2026-03-26 16:24:35 -07:00 |
|
|
Liangsheng Yin
|
fb90c9d298
|
[Test] Consolidate eval accuracy test mixins into eval_accuracy_kit (#21047)
|
2026-03-26 14:26:46 -07:00 |
|
|
Liangsheng Yin
|
e5dd411f64
|
[CI] Add ci-workflow-guide skill and consolidate CI docs (#21429)
|
2026-03-26 13:50:13 -07:00 |
|
|
Liangsheng Yin
|
e5b7650353
|
Fix UnboundLocalError when DetokenizerManager constructor fails (#21471)
|
2026-03-26 13:00:16 -07:00 |
|
|
Liangsheng Yin
|
17f43d1518
|
[CI] Skip stage health check for release branch cut (#21488)
|
2026-03-26 12:54:51 -07:00 |
|
|
Liangsheng Yin
|
79db3bec34
|
[CI] Add PID namespace and ps auxf diagnostics to killall.py (#21401)
|
2026-03-25 23:57:15 -07:00 |
|
|
Liangsheng Yin
|
176c8e7b0e
|
[CI] Simplify CI check actions and add maintenance gate to rerun-ut (#21455)
|
2026-03-25 23:28:18 -07:00 |
|
|
Liangsheng Yin
|
75682f1d2f
|
Remove noisy streaming backlog warning log (#21432)
|
2026-03-25 16:25:16 -07:00 |
|
|
Liangsheng Yin
|
4dd4e06f1d
|
[CI] Fix resource leak when setUpClass fails (#21338)
|
2026-03-25 16:22:44 -07:00 |
|
|
Liangsheng Yin
|
d5c5683d2b
|
[CI] Use ETag conditional requests in wait-for-jobs and add CI infra to check-changes (#21345)
|
2026-03-25 14:40:07 -07:00 |
|
|
Liangsheng Yin
|
4480e6c237
|
[CI] Add retry loop to killall_sglang GPU cleanup verification (#21393)
|
2026-03-25 02:16:20 -07:00 |
|
|
Liangsheng Yin
|
d937d01fe6
|
[CI] Fix cancel workflow: use bypass-maintenance label (#21364)
|
2026-03-24 21:43:00 -07:00 |
|
|
Liangsheng Yin
|
c769398748
|
[CI] Add include_high_priority checkbox to cancel workflow (#21363)
|
2026-03-24 21:30:44 -07:00 |
|
|
Liangsheng Yin
|
cd634abee4
|
[CI] Reduce session correctness test to 30 turns to fix flakiness (#21349)
|
2026-03-24 18:56:01 -07:00 |
|
|
Liangsheng Yin
|
37420dce0b
|
[CI] Enable failfast (-f) by default in run_suite.py (#21330)
|
2026-03-24 17:04:42 -07:00 |
|
|
Liangsheng Yin
|
3937a07b17
|
[CI] Add cross-job fast-fail health check (Layer 3) (#21341)
|
2026-03-24 16:58:56 -07:00 |
|
|
Liangsheng Yin
|
30896bd927
|
[CI] Remove test partition assignments from CI summary (#21344)
|
2026-03-24 16:27:47 -07:00 |
|
|
Liangsheng Yin
|
31c35f1c22
|
[CI] Skip multimodal CI for doc-only changes (#21334)
|
2026-03-24 14:07:25 -07:00 |
|
|
Liangsheng Yin
|
d9f5c2179c
|
ci(slash-cmd): allow write-permission users to /rerun-ut on fork PRs (#21121)
|
2026-03-22 00:45:48 -07:00 |
|
|
Liangsheng Yin
|
1e97864d75
|
ci(slash-cmd): allow repo write-permission users to /rerun-ut (#21120)
|
2026-03-22 00:32:29 -07:00 |
|
|
Liangsheng Yin
|
47d36d73f7
|
Update write-sglang-test skill: CUDA-only for common tests + prefer mock (#21119)
|
2026-03-21 22:54:43 -07:00 |
|
|
Liangsheng Yin
|
ff921a2ed3
|
Update cron schedule for PR test workflow (#21090)
|
2026-03-21 01:03:45 -07:00 |
|
|
Liangsheng Yin
|
9614271ae4
|
[Test] Fix flaky multi-instance memory occupation test (#21074)
|
2026-03-20 22:19:03 -07:00 |
|
|
Liangsheng Yin
|
6ad78b008b
|
Consolidate streaming session tests (4 files → 3, fewer server starts) (#20961)
|
2026-03-19 19:13:28 -07:00 |
|
|
Liangsheng Yin
|
8d22efdeea
|
[Tiny Fix] Fix IS_BLACKWELL env var empty string warning in rerun-ut workflow (#20957)
|
2026-03-19 17:24:35 -07:00 |
|
|
Liangsheng Yin
|
2b53e660de
|
Simplify streaming session logprob handling (#20955)
|
2026-03-19 17:09:40 -07:00 |
|
|
Liangsheng Yin
|
8b9482e665
|
fix(dp-attn): consistent overlap disable decision across DP ranks (#20853)
|
2026-03-18 15:16:39 -07:00 |
|
|
Liangsheng Yin
|
4d3976b6c5
|
[HiCache] Check in-flight async ops in is_fully_idle() before attach/detach (#20746)
|
2026-03-17 17:28:26 -07:00 |
|
|
Liangsheng Yin
|
5270a06488
|
[Disagg] Fix health check false-positive in disagg is_fully_idle (#20756)
|
2026-03-17 17:18:54 +08:00 |
|
|
Liangsheng Yin
|
f0458e0b49
|
[Utils] Move network/socket utilities from common.py to network.py (#20646)
|
2026-03-15 20:35:24 -07:00 |
|
|
Liangsheng Yin
|
d852f26cb6
|
Fix dual-stack socket handling: IPV6_V6ONLY, IPv4-first, is_port_available all-family check (#20643)
|
2026-03-15 17:17:23 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
c2245d9b55
|
ci: add runner dropdown to rerun-ut workflow dispatch (#20645)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-15 16:40:14 -07:00 |
|
|
Liangsheng Yin
|
116aef8504
|
[Test] Move embedding tests into test/registered/embedding/ and unit/ (#20642)
|
2026-03-15 14:48:43 -07:00 |
|
|
Liangsheng Yin
|
8397a8a301
|
[CI] Extract wait-for-jobs composite action and gate on stage-a-cpu-only (#20641)
|
2026-03-15 13:52:48 -07:00 |
|
|
Liangsheng Yin
|
fc7f9c1de7
|
Rename --stream-output to --incremental-streaming-output (#20614)
|
2026-03-14 23:22:33 -07:00 |
|
|
Liangsheng Yin
|
f605612b87
|
[HTTP] Fix /GET HTTP route when ollama endpoint is not set. (#20494)
|
2026-03-12 20:54:32 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
5f1bfb0d28
|
[Security] Fix /rerun-ut bypassing run-ci gate for fork PRs (#20424)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-12 02:24:29 -07:00 |
|
|
Liangsheng Yin
|
61cad15d28
|
[Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306)
|
2026-03-11 00:07:37 -07:00 |
|
|
Liangsheng Yin
|
50953aea8d
|
[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296)
|
2026-03-10 17:50:23 -07:00 |
|
|
Liangsheng Yin
|
ac07a6d439
|
Revert "[Scheduler] Decouple maybe_send_health_check_signal from process_batch_result" (#20259)
|
2026-03-10 01:58:48 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
208f1428e9
|
[Scheduler] Decouple maybe_send_health_check_signal from process_batch_result (#20227)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-09 21:18:56 -07:00 |
|
|
Liangsheng Yin
|
ffb4b6f4c1
|
[Core] Replace server_args mutation hack with explicit MemoryPoolConfig for draft worker init (#20183)
|
2026-03-09 11:45:54 -07:00 |
|
|
Liangsheng Yin
|
2ef00383ab
|
[Core] Refactor init_memory_pool into composable resolution helpers (#20142)
|
2026-03-08 21:46:27 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
7105bf3782
|
[Bug] Fix missing TTFT histogram for single-batch requests (#20122)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-08 15:18:51 -07:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot]
|
29f3a5396e
|
[Minor] Add SessionSlot.is_holding_kv property for readability (#20120)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-03-08 03:25:13 -07:00 |
|
|
|
36b557d2c9
|
Fix streaming session with paged KV cache (SWA/MLA) (#20070)
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-03-08 03:00:32 -07:00 |
|
|
Liangsheng Yin
|
d02c515ee8
|
Decouple scheduler log printing from metrics collection (#20107)
|
2026-03-07 22:09:10 -08:00 |
|
|
Liangsheng Yin
|
69ec15ad74
|
[CI] Re-enable streaming session tests with correctness and stress coverage (#20084)
|
2026-03-07 18:18:11 -08:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
ddcecdea49
|
[Core] Unify max_num_reqs dp_size division for pool sizing (#20063)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-06 16:12:59 -08:00 |
|
|
Liangsheng Yin
|
604db4471d
|
[Core] Clarify memory variable naming in model runner (#20060)
|
2026-03-06 14:00:46 -08:00 |
|
|
Liangsheng Yin
|
7a6cf0e9ba
|
[Core] Extract _calculate_mamba_ratio and _init_pools from init_memory_pool (#20058)
|
2026-03-06 13:37:22 -08:00 |
|
|
Liangsheng Yin
|
861d78635f
|
[CI] remove itl testing due to unstable networking (#19904)
|
2026-03-04 16:32:17 -08:00 |
|
|
Liangsheng Yin
|
33c92732f4
|
[Triton] Use dynamic loop bound in alloc_extend_kernel (#19898)
|
2026-03-04 16:15:58 -08:00 |
|
|
Liangsheng Yin
|
c7ffbf25e9
|
[CI] Fix rerun-ut workflow: add DeepEP install, RDMA env, Blackwell detection (#19803)
|
2026-03-03 15:17:16 -08:00 |
|
|
Liangsheng Yin
|
1135e214b3
|
[CI] support /rerun-ut command in slash handler (#19800)
|
2026-03-03 14:10:49 -08:00 |
|
|
Liangsheng Yin
|
7a2d3df96f
|
Apply default stream to priority 0 in scheduling. (#16438)
|
2026-03-03 00:05:27 -08:00 |
|
|
Liangsheng Yin
|
5acb45cf32
|
[Session] Extract SessionController and clean up session logic in Scheduler (#19547)
|
2026-02-28 19:47:44 -08:00 |
|
|
Liangsheng Yin
|
ac400cb7bb
|
[CLI] Add --model-type override and keep launch_server supported (#19523)
|
2026-02-27 18:16:31 -08:00 |
|
|
Liangsheng Yin
|
e08ef06758
|
[Session] Gate streaming sessions with --enable-streaming-session and spec v2 guard (#19531)
|
2026-02-27 18:14:55 -08:00 |
|
|
Liangsheng Yin
|
1a32c0db4d
|
[Minor] Rename misleading chunked to reusing in ReqToTokenPool.alloc() (#19465)
|
2026-02-26 16:24:03 -08:00 |
|
|
Liangsheng Yin
|
c60dcc40bb
|
[Logging] Guard log_prefill_stats against idle batches in disagg prefill (#19361)
|
2026-02-25 13:31:52 -08:00 |
|
|
Liangsheng YinandYangmin Li
|
76d5410e01
|
[Disagg] Fix decode querying unregistered dp_rank when prefill dp_size is 1 (#19305)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
|
2026-02-24 22:52:39 -08:00 |
|
|
Liangsheng YinandCursor
|
ab0f608788
|
[PD-Disagg] Fix bootstrap server race condition when prefill workers not yet registered (#19288)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-24 20:22:16 -08:00 |
|
|
Liangsheng YinandRatish P
|
539f772f54
|
[PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268)
Co-authored-by: Ratish P <114130421+ratish1@users.noreply.github.com>
|
2026-02-24 19:58:01 -08:00 |
|
|
Liangsheng Yin
|
5e80027ac7
|
[PD-Disagg] Support FAKE transfer backend for more cases (#19215)
|
2026-02-23 20:50:43 -08:00 |
|
|
Liangsheng Yin
|
feb041f4e5
|
[PD-Disagg] Improve type hints across all conn.py (#19208)
|
2026-02-23 19:44:23 -08:00 |
|
|
Liangsheng YinandShangming Cai
|
ea7ef63e6d
|
[PD-Disagg] Deduplicate common KVManager methods into CommonKVManager (#19205)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-02-23 18:34:21 -08:00 |
|
|
Liangsheng Yin
|
d160c5b9bb
|
[PD-Disagg] Unify prefill info data transition flow, all with PrefillServerInfo (#19195)
|
2026-02-23 16:15:20 -08:00 |
|
|
Liangsheng Yin
|
9fac90d85d
|
[CI] Tiny enhance the dp attention load blance benchmark (#19194)
|
2026-02-23 14:33:32 -08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot]
|
2aa3fe394e
|
[CI] fix the teardown output of disaggregation test (#19193)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-02-23 12:41:03 -08:00 |
|
|
Liangsheng YinandChang Huaixin
|
2274bfebb1
|
[PD-Disagg] Support query dp rank from bootstrap server. (#19168)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
|
2026-02-23 10:59:30 -08:00 |
|
|
Liangsheng Yin
|
4653939cda
|
Revert "[jit kernel] Support per_token_group_quant_8bit jit kernel" (#19131)
|
2026-02-22 07:54:24 +08:00 |
|
|
Liangsheng Yin
|
1f2da824dd
|
[Benchmark] Remove re-exports from bench_serving.py (#19130)
|
2026-02-21 14:30:30 -08:00 |
|
|
Liangsheng Yin
|
3fb457b103
|
Tiny rename cuda_graph tests to piecewise_cuda_graph (#19128)
|
2026-02-21 13:46:01 -08:00 |
|
|
Liangsheng Yin
|
db34c1cbfb
|
Tiny remove duplicate coredump env injection (#19023)
|
2026-02-19 13:26:30 -08:00 |
|
|
Liangsheng Yin
|
5ff5aa6923
|
[spec v2]Fix torch gc of future indices (#18958)
|
2026-02-19 11:38:25 -08:00 |
|
|
Liangsheng Yin
|
2d85f01d43
|
Revert "Fix generated-shared-prefix bench_serving" (#18956)
|
2026-02-17 20:43:55 -08:00 |
|
|
Liangsheng Yin
|
83a475e8d7
|
feat: add cuda core dump CI warpper (#18909)
|
2026-02-17 14:49:26 -08:00 |
|
|
Liangsheng Yin
|
dcea74d63f
|
Add timeout abort kits for normal / eagle. (#18815)
|
2026-02-13 17:57:30 -08:00 |
|
|
Liangsheng Yin
|
4474fb98b4
|
[PD-Disagg] Fix double free when prebuilt batch is aborted. (#18822)
|
2026-02-13 17:46:35 -08:00 |
|
|
Liangsheng Yin
|
e6f7a372ef
|
Rename request timeout env vars for waiting/running stages (#18766)
|
2026-02-12 22:58:40 -08:00 |
|
|
Liangsheng Yin
|
d29e331491
|
[Spec] Move forward timeout before verify to fix Eagle v1 filter mismatch (#18760)
|
2026-02-12 20:58:34 -08:00 |
|
|
Liangsheng Yin
|
3404dda592
|
Try fix the max-parallel for maunally triggered test again. (#18686)
|
2026-02-11 20:08:25 -08:00 |
|
|
Liangsheng Yin
|
b2d7fd5c87
|
fix the max-parallel for /rerun-stage (#18658)
|
2026-02-11 19:06:51 -08:00 |
|