Sam Shleifer 58974ca16c [perf] Assemble flat prompt top logprobs scheduler-side as numpy arrays (#32223)

2026-07-31 18:00:51 -07:00

..

scheduler_components

[perf] Assemble flat prompt top logprobs scheduler-side as numpy arrays (#32223)

2026-07-31 18:00:51 -07:00

async_dynamic_batch_tokenizer.py

[tokenizer] improve non streaming request processing + some small fixes. (#20310)

2026-04-10 15:46:12 -07:00

cache_controller.py

[HiCache] Optimize L2 mem allocation when cache miss in L3 (#19320)

2026-07-16 15:00:53 -07:00

communicator.py

[1/N] elastic-ep: Add runtime EP scale-up (#30164)

2026-07-16 15:53:44 -07:00

configure_logging.py

[Utils] Support configure log level at runtime (#26583)

2026-05-29 14:49:06 -07:00

data_parallel_controller.py

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

detokenizer_manager.py

[perf] Assemble flat prompt top logprobs scheduler-side as numpy arrays (#32223)

2026-07-31 18:00:51 -07:00

disagg_service.py

[PD] Cleanup BootstrapServer init and ready check (#19551)

2026-02-28 16:41:42 +08:00

embed_types.py

Convert IPC dataclasses to msgspec.Struct with opt-in msgpack transport (#28688)

2026-06-26 12:04:03 -07:00

hisparse_coordinator.py

perf(hisparse): eliminate redundant swap output fill (#32483)

2026-07-31 12:09:44 +08:00

io_struct.py

[perf] Assemble flat prompt top logprobs scheduler-side as numpy arrays (#32223)

2026-07-31 18:00:51 -07:00

load_snapshot.py

Add prefill and decode load counters to LoadSnapshot (#32245)

2026-07-24 14:04:54 -07:00

min_free_slots_delayer.py

[Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)

2026-07-12 17:25:26 -05:00

mm_utils.py

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

multi_tokenizer_mixin.py

[perf] Assemble flat prompt top logprobs scheduler-side as numpy arrays (#32223)

2026-07-31 18:00:51 -07:00

multimodal_processor.py

[Feature] Stronger transformers modeling backend with TP, PP, MoE, VLMs, and torch compile (#19163)

2026-04-02 16:02:33 -07:00

overlap_utils.py

[bug-fix] Stabilize GLM-5.2 MTP IndexShare across PD and CUDA graph replay (#30839)

2026-07-13 19:37:07 -07:00

prefill_delayer.py

Fix prefill delayer wait histograms always observing 0 (#25975)

2026-06-14 00:35:29 -07:00

rust_server.py

support rust sglang server (#29799)

2026-07-31 11:56:31 -07:00

schedule_batch.py

[perf] Assemble flat prompt top logprobs scheduler-side as numpy arrays (#32223)

2026-07-31 18:00:51 -07:00

schedule_policy.py

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

scheduler_input_blocker.py

[Cleanup] IPC struct renames, better typing, and SenderWrapper removal (#29214)

2026-06-24 17:25:24 -07:00

scheduler_pp_mixin.py

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

scheduler.py

[perf] Assemble flat prompt top logprobs scheduler-side as numpy arrays (#32223)

2026-07-31 18:00:51 -07:00

tokenizer_control_mixin.py

Split #32584 into 2/2: [LoRA] Shard attention LoRA by attn-TP and allow dynamic LoRA with dp attention (#32708)

2026-07-31 15:37:13 -07:00

tokenizer_manager_score_mixin.py

Revert RuntimeContext config-namespace reads/roles (#31813–#31817) (#32100)

2026-07-22 11:52:41 -07:00

tokenizer_manager.py

[perf] Assemble flat prompt top logprobs scheduler-side as numpy arrays (#32223)

2026-07-31 18:00:51 -07:00

tp_worker.py

config: read resolved config via namespace accessors (#33013)

2026-07-31 15:06:59 -07:00

utils.py

support rust sglang server (#29799)

2026-07-31 11:56:31 -07:00