3 people 86afa21ca7 feat: optional caller-supplied mm_hashes on GenerateReqInput (#25300) ...

Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

2026-06-01 20:04:37 +02:00

..

scheduler_components

[NPU] fix npu profiler (#24835)

2026-06-01 21:44:24 +08:00

async_dynamic_batch_tokenizer.py

[tokenizer] improve non streaming request processing + some small fixes. (#20310)

2026-04-10 15:46:12 -07:00

cache_controller.py

Refactor NIXL hicache. Add O_DIRECT support (#25173)

2026-06-01 17:28:53 +02:00

communicator.py

refactor: extract FanOutCommunicator and use declarative spec table (#22967)

2026-04-16 15:37:19 -07:00

configure_logging.py

[Utils] Support configure log level at runtime (#26583)

2026-05-29 14:49:06 -07:00

data_parallel_controller.py

Optimize get load calls (/v1/loads) using shared-memory load snapshots (#26348)

2026-05-29 13:40:26 -07:00

detokenizer_manager.py

[Utils] Support configure log level at runtime (#26583)

2026-05-29 14:49:06 -07:00

disagg_service.py

[PD] Cleanup BootstrapServer init and ready check (#19551)

2026-02-28 16:41:42 +08:00

embed_types.py

[Score API] Hoist query placeholder scan and specialize PositionalEmbeds stacking (#23513)

2026-04-29 13:51:53 -07:00

hisparse_coordinator.py

[core] Maintain req_pool_indices_cpu host mirror (like seq_lens_cpu) (#26425)

2026-05-26 18:59:54 -07:00

io_struct.py

feat: optional caller-supplied mm_hashes on GenerateReqInput (#25300)

2026-06-01 20:04:37 +02:00

load_snapshot.py

Optimize get load calls (/v1/loads) using shared-memory load snapshots (#26348)

2026-05-29 13:40:26 -07:00

mm_utils.py

Fix weights_checker checksum for 0-dim tensors and multi-GPU (#26863)

2026-05-31 21:27:03 -07:00

multi_tokenizer_mixin.py

[BugFix] preserve cached token details in multi-tokenizer output (#26590)

2026-05-28 13:31:55 -07:00

multimodal_processor.py

[Feature] Stronger transformers modeling backend with TP, PP, MoE, VLMs, and torch compile (#19163)

2026-04-02 16:02:33 -07:00

overlap_utils.py

[Scheduler] Defer prefill input_ids H2D to forward stream, unify resolve via future_map (#25945)

2026-05-30 02:58:13 -07:00

prefill_delayer.py

[PrefillDelayer] support NCCL all-gather for cross-DP info sync (#24768)

2026-05-09 21:20:03 -07:00

schedule_batch.py

[core] Compute token_type_ids in ForwardBatch.init_new (#26797)

2026-05-31 00:54:49 -07:00

schedule_policy.py

Support batch size > 1 when enable CP (#23269)

2026-05-27 14:11:17 -07:00

scheduler_input_blocker.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

scheduler_pp_mixin.py

[PP][Bugfix] Handle input_ids assignment in prepare_for_extend (#26883)

2026-06-01 14:43:50 +08:00

scheduler_recv_skipper.py

[Feat]Add scheduler recv skipper weights to environment configuration (#13855)

2025-11-27 18:16:11 +08:00

scheduler.py

Add a periodic full-radix-tree KV-canary sweep (#26812)

2026-05-31 09:56:42 +08:00

template_detection.py

Clean up server startup log noise (#26205)

2026-05-24 14:35:15 -07:00

template_manager.py

Clean up server startup log noise (#26205)

2026-05-24 14:35:15 -07:00

tokenizer_control_mixin.py

Fix weights_checker checksum for 0-dim tensors and multi-GPU (#26863)

2026-05-31 21:27:03 -07:00

tokenizer_manager_score_mixin.py

Replace single-line defensive getattrs with direct access (#25435)

2026-05-16 09:18:43 +08:00

tokenizer_manager.py

feat: optional caller-supplied mm_hashes on GenerateReqInput (#25300)

2026-06-01 20:04:37 +02:00

tp_worker.py

[core] step 1: route non-spec seq_lens via FutureMap with per-mode bootstrap fixes (#25944)

2026-05-21 20:15:51 -07:00

utils.py

[SPEC] fix: use effective max draft tokens for adaptive spec initiali… (#26354)

2026-05-28 13:33:11 -07:00