sglang

hf_transformers

model: support Step-3.7-Flash (#26565 )

2026-05-29 08:00:54 +08:00

__init__.py

…

aio_rwlock.py

…

async_probe.py

[Spec] Async-assert probes across EAGLE/MTP; zero tgt_cache_loc (#26335 )

2026-05-26 11:34:03 -07:00

auth.py

fix: preserve disconnect events in api key middleware (#17253 )

2026-01-26 22:48:24 -05:00

bench_utils.py

[CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119 )

2026-04-19 05:32:36 -07:00

common.py

Feat/add w4a16 moe support to nemotron (#25655 )

2026-06-02 22:42:26 -07:00

cuda_ipc_transport_utils.py

[VLM] Reduce GPU memory footprint of CUDA IPC MM feature transport (#22662 )

2026-04-17 10:38:36 +08:00

custom_op.py

[misc] clean up kernel API (#21325 )

2026-03-25 09:10:23 +08:00

device_timer.py

feat: emit per-iteration forward pass metrics via ZMQ PUB (#22789 )

2026-05-12 10:28:17 -07:00

field_validators.py

API Perf: Replace pydantic per-element validation with C loop validation (#26355 )

2026-05-27 02:04:07 -07:00

gauge_histogram.py

Tiny add gauge histogram abstraction for engine and router (#16848 )

2026-01-10 11:45:25 +08:00

hf_transformers_patches.py

Clean up noisy startup warnings from third-party deps (#23669 )

2026-04-27 03:10:46 -07:00

hf_transformers_utils.py

Upgrade transformers to 5.5.3 and refactor hf_transformers_utils into subpackage (#21569 )

2026-04-15 20:03:44 -07:00

host_shared_memory.py

…

http_middleware_patch.py

[Bug Fix] Fix non-streaming request abort failure when --enable-metrics is enabled (#20625 )

2026-03-22 19:58:49 -07:00

json_response.py

UX: clean loggings (#22174 )

2026-04-08 09:46:38 +08:00

log_utils.py

Improve metrics, observability, and PD deploy tooling (#24521 )

2026-05-06 11:27:35 -07:00

model_file_verifier.py

Add file size hints in bitwise model file verifier (#16735 )

2026-01-08 22:28:52 +08:00

multi_stream_utils.py

Reworked fast_pos_embed_interpolate() using torch (#10959 )

2025-12-30 14:45:34 +08:00

network.py

[Security] 1/N: Bind ZMQ sockets to localhost to prevent unauthenticated remote access (#21435 )

2026-03-26 23:33:49 -07:00

numa_utils.py

[NUMA+Ray] Fix NUMA NVML handle resolution under shuffled CUDA_VISIBLE_DEVICES (#24766 )

2026-05-09 21:18:39 -07:00

nvtx_pytorch_hooks.py

…

offloader.py

[Bug] Correct Weight Offloader's Attribute Name for torch.nn.Parameter (#25786 )

2026-05-19 22:28:59 -07:00

patch_tokenizer.py

Optimize detokenization without HF decode kwargs (#25309 )

2026-05-17 20:37:36 -07:00

patch_torch.py

[MUSA] Use MUSA-optimized operators in piecewise CUDA graph (#23633 )

2026-05-11 17:55:27 -07:00

phase_checker.py

Add a SimplePhaseChecker for execution-phase assertions (#26803 )

2026-05-31 09:51:39 +08:00

poll_based_barrier.py

…

profile_merger.py

…

profile_utils.py

Fix V2 trace filename collisions when DP/PP/EP enabled (#25446 )

2026-05-16 09:24:39 +08:00

request_logger.py

[EPD] Optimize the Mooncake backend (#22587 )

2026-05-29 10:42:24 +08:00

rpd_utils.py

Fix none-comparison (E711) warnings (#19745 )

2026-03-06 16:15:21 -08:00

runai_utils.py

chore: add vLLM SPDX copyright headers to ported files (#25182 )

2026-05-13 15:17:30 -07:00

scheduler_status_logger.py

Decouple scheduler log printing from metrics collection (#20107 )

2026-03-07 22:09:10 -08:00

slow_rank_detector.py

…

tensor_bridge.py

[MLX] Add native MLX execution backend for Apple Silicon Mac (#20342 )

2026-03-26 00:09:17 -07:00

torch_memory_saver_adapter.py

…

video_decoder.py

perf(mimo-v2-epd): enable GPU image preprocess and parallel video decode (#25588 )

2026-05-19 11:47:21 +08:00

watchdog.py

Remove logging for subprocess watchdog start (#21968 )

2026-04-02 11:30:33 -07:00

weight_checker.py

Fix weights_checker checksum for 0-dim tensors and multi-GPU (#26863 )

2026-05-31 21:27:03 -07:00