 fzyzcjy
|
3f0814974c
|
Fix disaggregation bootstrap server lifetime (#25982)
|
2026-05-22 14:10:57 +08:00 |
|
|
fzyzcjy
|
e4d81e48c9
|
Pull the max-prefix-len computation into its own helper and rename the matched-token argument (#25728)
|
2026-05-19 09:27:06 +08:00 |
|
|
fzyzcjy
|
170fe57cf0
|
Encapsulate the pending-flush bookkeeping in a small wrapper (#25727)
|
2026-05-19 09:23:10 +08:00 |
|
|
fzyzcjy
|
5067da3eb6
|
Confine req-pool-idx assignment to the pool allocator (#25726)
|
2026-05-19 09:22:51 +08:00 |
|
|
fzyzcjy
|
6bcbf4de35
|
Fix the misnamed request finish-check method to reflect its mutating semantics (#25725)
|
2026-05-19 09:22:28 +08:00 |
|
|
fzyzcjy
|
2d2dff28da
|
Return a mamba tracking entry from the cache lookup instead of mutating caller lists (#25724)
|
2026-05-19 09:21:55 +08:00 |
|
|
fzyzcjy
|
3fd6a58e6c
|
Inline the single-use split-prefill setup at its caller (#25722)
|
2026-05-19 09:21:29 +08:00 |
|
|
fzyzcjy
|
1f3e5aa1e0
|
Publish elastic-EP active ranks from a dedicated step (#25721)
|
2026-05-19 09:21:04 +08:00 |
|
|
fzyzcjy
|
fa37b68653
|
Rename the request mid-chunk flag to describe what it actually tracks (#25720)
|
2026-05-19 09:20:43 +08:00 |
|
|
fzyzcjy
|
32f1259c91
|
Confine max-prefix-len to where it is used and drop the leftover variable (#25719)
|
2026-05-19 09:20:21 +08:00 |
|
|
fzyzcjy
|
1cba3ab467
|
Stop returning the unused prefix-computed flag from priority calc (#25718)
|
2026-05-19 09:20:00 +08:00 |
|
|
fzyzcjy
|
2d868656d0
|
Move the retract-decode ratio estimation onto the new-token-ratio tracker (#25717)
|
2026-05-19 09:19:42 +08:00 |
|
|
fzyzcjy
|
1a882c5c63
|
Pack scattered new-token-ratio state into a dedicated tracker (#25716)
|
2026-05-19 09:19:20 +08:00 |
|
|
fzyzcjy
|
954b5c5846
|
Pack scattered scheduler IPC channel state into a dedicated container (#25714)
|
2026-05-19 09:19:02 +08:00 |
|
|
fzyzcjy
|
07b4f262b7
|
Set up the idle sleeper outside of the IPC channel initialization (#25713)
|
2026-05-19 09:18:36 +08:00 |
|
|
fzyzcjy
|
2d40f45193
|
Pack scattered request logprob state into a dedicated container (#25712)
|
2026-05-19 09:18:19 +08:00 |
|
|
fzyzcjy
|
fb7e49d4eb
|
Expose can-run-cuda-graph as a regular property on the embedding result (#25711)
|
2026-05-19 09:18:00 +08:00 |
|
|
fzyzcjy
|
a740f8de33
|
Remove the dead hasattr fallback around the test-only crash counter (#25710)
|
2026-05-19 09:17:40 +08:00 |
|
|
fzyzcjy
|
0e198f0f4f
|
Refactor batch_result_processor into per-step prefill/decode helpers (#25709)
|
2026-05-19 09:17:17 +08:00 |
|
|
fzyzcjy
|
7e7cb969e9
|
Route streaming output through the accumulator's payload method instead of an inline send (#25708)
|
2026-05-19 09:16:42 +08:00 |
|
|
fzyzcjy
|
da50e3d943
|
Log per-request time stats in a dedicated tail step (#25707)
|
2026-05-19 09:16:22 +08:00 |
|
|
fzyzcjy
|
b911fd1673
|
Route streaming-accept decisions through the accumulator instead of an inline gate (#25706)
|
2026-05-19 09:15:45 +08:00 |
|
|
fzyzcjy
|
d8f190dfba
|
Pack scattered output-streamer state into a dedicated accumulator (#25705)
|
2026-05-19 09:14:59 +08:00 |
|
|
fzyzcjy
|
e8e55bb19b
|
Split the request-reception loop into smaller phases (#25703)
|
2026-05-19 09:12:47 +08:00 |
|
|
fzyzcjy
|
be64d875ad
|
Fix flush_cache AttributeError on is_stats_logging_rank (#25641)
|
2026-05-18 19:23:48 +08:00 |
|
|
fzyzcjy
|
8b94e1d0cf
|
Delete the now-unused is_work_request from scheduler.py (#25639)
|
2026-05-18 18:50:23 +08:00 |
|
|
fzyzcjy
|
c54b34c007
|
Move module-level helpers out of scheduler.py (#25638)
|
2026-05-18 18:45:38 +08:00 |
|
|
fzyzcjy
|
99ad2b0894
|
Move batch-result processing to SchedulerBatchResultProcessor and retire output_processor mixin (#25637)
|
2026-05-18 18:45:01 +08:00 |
|
|
fzyzcjy
|
7d0b0b6991
|
Carve out SchedulerBatchResultProcessor for batch-result state (#25636)
|
2026-05-18 18:44:41 +08:00 |
|
|
fzyzcjy
|
18a7eb9e58
|
Move output streaming to SchedulerOutputStreamer (#25635)
|
2026-05-18 18:44:07 +08:00 |
|
|
fzyzcjy
|
dc88b4eeb4
|
Stand up SchedulerOutputStreamer; migrate output-streaming state to it (#25634)
|
2026-05-18 18:43:48 +08:00 |
|
|
fzyzcjy
|
2cbe01d044
|
Move logprob assembly to SchedulerLogprobResultProcessor (#25633)
|
2026-05-18 18:43:27 +08:00 |
|
|
fzyzcjy
|
e737f61b29
|
Introduce SchedulerLogprobResultProcessor to own logprob state (#25632)
|
2026-05-18 18:42:59 +08:00 |
|
|
fzyzcjy
|
cf12070a0f
|
Move idle-metrics logging to SchedulerMetricsReporter (#25631)
|
2026-05-18 18:42:34 +08:00 |
|
|
fzyzcjy
|
fd97fbb096
|
Move metrics reporting to SchedulerMetricsReporter and retire metrics mixin (#25630)
|
2026-05-18 18:42:08 +08:00 |
|
|
fzyzcjy
|
780d969699
|
Add SchedulerMetricsReporter and route metrics state through it (#25629)
|
2026-05-18 18:41:35 +08:00 |
|
|
fzyzcjy
|
8357d07569
|
Move queue-load reporting to SchedulerLoadInquirer (#25628)
|
2026-05-18 18:41:12 +08:00 |
|
|
fzyzcjy
|
bde932cbbb
|
Carve out SchedulerLoadInquirer for queue-load state (#25627)
|
2026-05-18 18:40:46 +08:00 |
|
|
fzyzcjy
|
1213277879
|
Move KV-cache event emission to SchedulerKvEventsPublisher (#25626)
|
2026-05-18 18:40:20 +08:00 |
|
|
fzyzcjy
|
0f888442c2
|
Stand up SchedulerKvEventsPublisher; migrate KV-event state to it (#25625)
|
2026-05-18 18:39:50 +08:00 |
|
|
fzyzcjy
|
f3dce08283
|
Move invariant checks to SchedulerInvariantChecker and retire runtime_checker mixin (#25624)
|
2026-05-18 18:39:24 +08:00 |
|
|
fzyzcjy
|
8a200464fd
|
Introduce SchedulerInvariantChecker to own invariant-check state (#25623)
|
2026-05-18 18:38:57 +08:00 |
|
|
fzyzcjy
|
b463740953
|
Move create_scheduler_watchdog from runtime_checker mixin to scheduler.py (#25622)
|
2026-05-18 18:38:26 +08:00 |
|
|
fzyzcjy
|
ee392a1e14
|
Move pool-stats sampling to SchedulerPoolStatsObserver (#25621)
|
2026-05-18 18:37:50 +08:00 |
|
|
fzyzcjy
|
9fdf73f393
|
Add SchedulerPoolStatsObserver and route pool-stats state through it (#25619)
|
2026-05-18 18:36:36 +08:00 |
|
|
fzyzcjy
|
c58b47bc86
|
Move PoolStats dataclass to scheduler_components.pool_stats_observer (#25618)
|
2026-05-18 18:35:27 +08:00 |
|
|
fzyzcjy
|
95d86e5c43
|
Move on_idle from runtime_checker mixin into Scheduler (#25617)
|
2026-05-18 18:34:58 +08:00 |
|
|
fzyzcjy
|
7851ba09f7
|
Move weight-update RPC handlers to SchedulerWeightUpdaterManager (#25616)
|
2026-05-18 18:34:15 +08:00 |
|
|
fzyzcjy
|
56f27635b8
|
Carve out SchedulerWeightUpdaterManager for weight-update state (#25615)
|
2026-05-18 18:33:48 +08:00 |
|
|
fzyzcjy
|
a35690f070
|
Move profiler controls to SchedulerProfilerManager (#25614)
|
2026-05-18 18:33:17 +08:00 |
|
|
fzyzcjy
|
b0a511560c
|
Stand up SchedulerProfilerManager; migrate profiler state to it (#25613)
|
2026-05-18 18:32:46 +08:00 |
|
|
fzyzcjy
|
4d6eec7b32
|
Move DP-attention adapter methods to SchedulerDPAttnAdapter (#25612)
|
2026-05-18 18:32:16 +08:00 |
|
|
fzyzcjy
|
8f37a8a3f3
|
Introduce SchedulerDPAttnAdapter to own DP-attention state (#25611)
|
2026-05-18 18:31:45 +08:00 |
|
|
fzyzcjy
|
0e9eab19a9
|
Move request-ingress methods to SchedulerRequestReceiver (#25610)
|
2026-05-18 18:31:17 +08:00 |
|
|
fzyzcjy
|
e6f3dcd790
|
Add SchedulerRequestReceiver and route request-ingress state through it (#25609)
|
2026-05-18 18:30:43 +08:00 |
|
|
fzyzcjy
|
768d347565
|
Pre-declare mode-conditional Scheduler fields with explicit defaults (#25608)
|
2026-05-18 18:29:58 +08:00 |
|
|
fzyzcjy
|
3e3661fd2f
|
Move build_kv_cache to mem_cache.kv_cache_builder (#25607)
|
2026-05-18 18:29:30 +08:00 |
|
|
fzyzcjy
|
fed1197474
|
Reshape init_cache_with_memory_pool to match the future build_kv_cache signature (#25606)
|
2026-05-18 18:28:58 +08:00 |
|
|
fzyzcjy
|
60337abe24
|
Hoist hisparse and decode-offload setup out of init_cache_with_memory_pool (#25605)
|
2026-05-18 18:28:26 +08:00 |
|
|
fzyzcjy
|
8692bdd3de
|
Move maybe_register_hicache_draft to mem_cache.kv_cache_builder (#25604)
|
2026-05-18 18:27:58 +08:00 |
|
|
fzyzcjy
|
189e0a4240
|
Decouple _maybe_register_hicache_draft from self (#25603)
|
2026-05-18 18:27:29 +08:00 |
|
|
fzyzcjy
|
062f6f7ae8
|
Move get_draft_kv_pool to mem_cache.kv_cache_builder (#25602)
|
2026-05-18 18:27:01 +08:00 |
|
|
fzyzcjy
|
d1c04deba7
|
Decouple _get_draft_kv_pool from self before extraction (#25601)
|
2026-05-18 18:26:20 +08:00 |
|
|
fzyzcjy
|
4c6eb12dea
|
Fix invalid suite name in test_multi_detokenizer (#25450)
|
2026-05-16 09:42:11 +08:00 |
|
|
fzyzcjy
|
688b679af2
|
Convert discarded-value ternary to a plain if statement (#25449)
|
2026-05-16 09:35:36 +08:00 |
|
|
fzyzcjy
|
d0c38329b2
|
Inline the trivial _build_model_config wrapper (#25448)
|
2026-05-16 09:25:48 +08:00 |
|
|
fzyzcjy
|
4190328767
|
Replace defensive getattr in pool_configurator with direct access (#25447)
|
2026-05-16 09:25:14 +08:00 |
|
|
fzyzcjy
|
48f85d464f
|
Fix V2 trace filename collisions when DP/PP/EP enabled (#25446)
|
2026-05-16 09:24:39 +08:00 |
|
|
fzyzcjy
|
b3059e2d1e
|
Inject ParallelState into ProfilerV2 (#25445)
|
2026-05-16 09:24:15 +08:00 |
|
|
fzyzcjy
|
43797cc804
|
Bundle Scheduler rank/size fields into a frozen ParallelState (#25444)
|
2026-05-16 09:23:51 +08:00 |
|
|
fzyzcjy
|
7c716e73e0
|
Add mechanical-refactor-verify skill from miles (#25443)
|
2026-05-16 09:23:06 +08:00 |
|
|
fzyzcjy
|
fa8b7c9647
|
Lift forward_ct/cur_batch and use direct access in watchdog (#25442)
|
2026-05-16 09:22:41 +08:00 |
|
|
fzyzcjy
|
72eb231d28
|
Annotate dead max_running_requests_under_SLO (#25441)
|
2026-05-16 09:22:13 +08:00 |
|
|
fzyzcjy
|
c8e5cf5768
|
Fix LoRA pool not appearing in /v1/loads (#25440)
|
2026-05-16 09:21:27 +08:00 |
|
|
fzyzcjy
|
5c440cdc41
|
Lift running_batch / running_mbs access — direct + PP-explicit (#25439)
|
2026-05-16 09:21:00 +08:00 |
|
|
fzyzcjy
|
80c3ce3204
|
Convert forward_pass_device_timer to None-init (#25438)
|
2026-05-16 09:20:31 +08:00 |
|
|
fzyzcjy
|
40429248c8
|
Drop dead hasattr guards (hisparse_coordinator, metrics_collector) (#25437)
|
2026-05-16 09:19:56 +08:00 |
|
|
fzyzcjy
|
0071033ff6
|
Cache _linear_attn_registry_cache with sentinel (#25436)
|
2026-05-16 09:19:21 +08:00 |
|
|
fzyzcjy
|
6a1b05d706
|
Replace single-line defensive getattrs with direct access (#25435)
|
2026-05-16 09:18:43 +08:00 |
|
|
fzyzcjy
|
27c3190215
|
Remove fields that are never used in spec/engine/disagg (#25434)
|
2026-05-16 09:18:00 +08:00 |
|
|
fzyzcjy
|
e065445236
|
Remove managers' unused fields (#25433)
|
2026-05-16 09:17:11 +08:00 |
|
|
fzyzcjy
|
33d63aa7e1
|
Remove dead self.adder/can_run_list/running_bs writes in Scheduler._get_new_batch_prefill_raw (#25432)
|
2026-05-16 09:12:39 +08:00 |
|
|
fzyzcjy
|
824ad24149
|
Convert local-only self.X attributes to locals (#25430)
|
2026-05-16 09:05:43 +08:00 |
|
|
|
d5e707f132
|
Fix sgl-kernel-mla-test path after test was moved to test/manual (#24914)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
|
2026-05-10 22:00:08 -07:00 |
|
|
fzyzcjy
|
9ba4aac47b
|
Fix weight_checker e2e OOM on 32GB GPU + move to nightly (#24559)
|
2026-05-06 21:06:04 -07:00 |
|
|
fzyzcjy
|
c4c5541618
|
Support getting checksums in weight checker (#24537)
|
2026-05-06 22:59:28 +08:00 |
|
|
fzyzcjy
|
ae5ae840f6
|
Refactor buffer patterns in weight checker (#24538)
|
2026-05-06 22:52:07 +08:00 |
|
|
fzyzcjy
|
800deaaefa
|
Add unit and end-to-end tests for weight checker (#24536)
|
2026-05-06 22:48:48 +08:00 |
|
|
fzyzcjyandJD
|
491051c622
|
Cherry pick weight_checker _weight_fp32 buffer skip from #22663 (#24534)
Co-authored-by: JD <jaedon.guo@gmail.com>
|
2026-05-06 21:21:12 +08:00 |
|
|
fzyzcjyandJD
|
0d40931b08
|
Cherry pick weight_checker non-persistent buffer pattern list from #21278 (#24533)
Co-authored-by: JD <jaedon.guo@gmail.com>
|
2026-05-06 21:14:01 +08:00 |
|
|
fzyzcjyandYueming Yuan
|
864f9633f2
|
Cherry pick weight_checker fp8 dequant fix and non-persistent buffer skip from #21494 (#24532)
Co-authored-by: Yueming Yuan <yym022502@gmail.com>
|
2026-05-06 21:13:17 +08:00 |
|
|
fzyzcjy
|
11b0e510aa
|
Fix lint (#24520)
|
2026-05-06 18:26:41 +08:00 |
|
|
fzyzcjy
|
a858fda708
|
Add e2e test with log snapshot in dumper grafter (#24513)
|
2026-05-06 17:00:13 +08:00 |
|
|
fzyzcjy
|
8527db0a91
|
Enhance diff and tensor-info logging in dumper grafter (#24512)
|
2026-05-06 16:58:08 +08:00 |
|
|
fzyzcjy
|
75943cfbcf
|
Support per-call extras and dataclass transform input in dumper grafter (#24511)
|
2026-05-06 16:57:44 +08:00 |
|
|
fzyzcjy
|
833279eb2e
|
Support multi-rank exchange via all_gather_object in dumper grafter (#24510)
|
2026-05-06 16:57:20 +08:00 |
|
|
fzyzcjy
|
ebd64f5d40
|
Support user-supplied recv-side transform in dumper grafter (#24509)
|
2026-05-06 16:56:52 +08:00 |
|
|
fzyzcjy
|
9a65f0ac26
|
Support t2b direction and overlap protection in dumper grafter (#24508)
|
2026-05-06 16:56:24 +08:00 |
|
|
fzyzcjy
|
58487e68e5
|
Support cross-system tensor grafting in dumper (#24507)
|
2026-05-06 16:55:40 +08:00 |
|
|
fzyzcjy
|
61104d7d0a
|
Add prefixed _log helper in dumper (#24506)
|
2026-05-06 16:54:20 +08:00 |
|