17 Commits
Author SHA1 Message Date
Cheng Wan bccf691b22 Bringing the parallel runtime up becomes a phase, not a side effect (#40345) 2026-09-21 12:29:50 -07:00
Cheng Wan 970e946e4f Retire the per-runner parallel record (#40343) 2026-09-21 12:26:40 -07:00
Polisetty V R K Jyothendra Varma e59a576f03 fix test/manual/test_forward_split_prefill.py UT due to many refactors and design changes (#36617)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
2026-09-03 01:48:55 -07:00
Cheng Wan d7b144f64e config: publishing is the process entry's job (#36251) 2026-08-26 04:58:41 -07:00
fzyzcjy e77d95c3d5 Pass per-forward overrides to ForwardBatch.init_new as explicit arguments (#30670) 2026-07-15 14:25:59 +08:00
fzyzcjy 725920915f Introduce ModelRunner.ps ParallelState (#31161) 2026-07-14 16:01:14 +08:00
fzyzcjy d0524d6433 Avoid scattered assignment of extend_input_len and fill_len by merging them into Req.extend_range (#27610) 2026-06-25 08:33:28 +08:00
Liangsheng Yin c864c8d9c2 [misc] Move bench_one_batch into sglang/benchmark/ with a back-compat shim (#28687) 2026-06-23 14:48:35 -07:00
fzyzcjy 259a2da3e0 Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637) 2026-06-08 14:52:18 +08:00
Mohammad Miadh AngkadandLianmin Zheng 52f221cce0 Fix Req array token-id concatenation (#26182)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-06 19:59:51 -07:00
fzyzcjy 3fd6a58e6c Inline the single-use split-prefill setup at its caller (#25722) 2026-05-19 09:21:29 +08:00
Liangsheng Yin 58ece60703 refactor: remove ModelWorkerBatch indirection (#25516) 2026-05-17 18:05:39 -07:00
495290aefd enable ut test for xpu devices (#11712)
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
2026-02-03 11:15:14 -08:00
Ke Bao 7f8a58fffb Refactor prefix cache type checking (#17028) 2026-01-15 11:28:13 +08:00
Cheng Wan 60f1ca6925 Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105) 2025-12-30 12:38:33 +08:00
Cheng Wan 6f9d0a89a0 [scheduler] fix: correcting extend_logprob_start_len calculation (#15922) 2025-12-28 14:57:04 -08:00
alisonshao 6b262ac839 Test reorganization: Move tests to manual/ (#13610) 2025-11-20 13:41:58 -08:00