Zhiqiang Xie a480f388b2 [HiCache] L3 storage prefetch lifecycle metrics and cross-tier attribution fixes (#37503)

2026-09-03 16:00:04 -07:00

..

scheduler_components

[Fix] DP attention: correct the decode->extend prefix off-by-one (#37505)

2026-09-02 16:14:16 -07:00

test_batch_result_processor_hidden_states.py

[Speculative Decoding] Add native UNO serving support (#37667)

2026-09-03 20:08:41 +08:00

test_batch_result_processor_mamba_boundary.py

[Speculative Decoding] Add native UNO serving support (#37667)

2026-09-03 20:08:41 +08:00

test_batch_result_processor_spec_grammar.py

[Speculative Decoding] Add native UNO serving support (#37667)

2026-09-03 20:08:41 +08:00

test_customized_info_streaming.py

[AMD] Register 2 hardware-agnostic 1-GPU PR tests for AMD CI (#30207)

2026-07-07 14:46:22 -07:00

test_data_parallel_controller.py

[1/N] elastic-ep: Add runtime EP scale-up (#30164)

2026-07-16 15:53:44 -07:00

test_detailed_annotations.py

Profiling Enhancements [2/3]: detailed execution step annotations (#24911)

2026-08-18 01:09:07 -07:00

test_embed_overrides.py

Refactor server_args constants and layout (#36676)

2026-08-27 12:16:16 -07:00

test_fanout_communicator.py

[Fix] Serialize FanOutCommunicator queueing calls with a FIFO-fair asyncio.Lock (#30606)

2026-07-09 00:04:43 -07:00

test_finish_length_speculative.py

[bugfix] Stop/EOS inside a spec accept run beats the max_new_tokens finish (#33758)

2026-08-07 15:18:14 -07:00

test_flat_raw_top_logprobs.py

fix: preserve output logprobs without input logprobs (#34627)

2026-08-18 12:07:13 -05:00

test_generation_auxiliary_output.py

Add sampling observer auxiliary output hooks (#35747)

2026-08-21 19:28:18 -07:00

test_grammar_stop_speculative.py

Fix stop boundaries for grammar-constrained speculative decoding (#31738)

2026-07-20 17:55:27 -07:00

test_hidden_state_server_mode.py

config: the per-instance families read the bags (#35026)

2026-08-17 16:17:53 -07:00

test_hisparse_unit.py

[Fix] Use real ReqKvInfo in unit-test req mocks (#37339)

2026-08-31 20:25:51 -07:00

test_io_struct.py

[Rust] Keep sampling and scheduler wire schemas in sync (#37222)

2026-08-31 12:31:07 -07:00

test_kv_page_invariants.py

[PD] Optimize paged allocator free-list release (#37146)

2026-09-02 16:51:37 -07:00

test_load_inquirer.py

[Cache] Forward fast prefix matching capability (#37844)

2026-09-03 10:33:30 -07:00

test_load_snapshot_backends.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

test_loadstat_wire.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

test_lora_update_result_merge.py

Split #32584 into 2/2: [LoRA] Shard attention LoRA by attn-TP and allow dynamic LoRA with dp attention (#32708)

2026-07-31 15:37:13 -07:00

test_mamba_checkpoint_depth.py

[mem_cache] Move mamba state and retraction_backup into ReqKvInfo (#37164)

2026-08-30 22:03:01 -07:00

test_mm_embed_scatter.py

Scatter mm embeddings with row index_copy_ instead of masked_scatter_ to cut transient GPU memory (#37070)

2026-08-30 00:15:39 -07:00

test_mm_embedding_length.py

Register CPU CI for 17 e2e tests and partition xeon base-c suite (#35227)

2026-08-24 10:49:38 +08:00

test_mm_hashes.py

[VLM] add content-addressed preprocessing cache infrastructure (#34398)

2026-08-13 14:09:07 +08:00

test_mm_process_config.py

[vlm] fix: contain multimodal feature transport failures (#37047)

2026-09-01 13:46:38 +08:00

test_mm_shm_error_consensus.py

[vlm] fix: contain multimodal feature transport failures (#37047)

2026-09-01 13:46:38 +08:00

test_mm_utils_split.py

model: support nvidia/LocateAnything-3B (#28958)

2026-06-30 00:16:42 +08:00

test_msgpack_ipc_roundtrip.py

Report per-token weight-version spans in generation meta info (#35926)

2026-08-24 20:18:52 +08:00

test_multi_tokenizer_mixin.py

Report per-token weight-version spans in generation meta info (#35926)

2026-08-24 20:18:52 +08:00

test_multimodal_abort_cleanup.py

[vlm] fix: contain multimodal feature transport failures (#37047)

2026-09-01 13:46:38 +08:00

test_output_streamer_customized_info.py

[Feature] Beam search support (#31626)

2026-08-26 16:56:15 -07:00

test_output_streamer_logprobs.py

[Feature] Beam search support (#31626)

2026-08-26 16:56:15 -07:00

test_pp_cp_rank_offsets.py

[Fix] Apply the attention-CP broadcast result in PP dynamic-chunk profiling (#37669)

2026-09-02 17:20:07 -07:00

test_prefill_adder.py

[HiCache] L3 storage prefetch lifecycle metrics and cross-tier attribution fixes (#37503)

2026-09-03 16:00:04 -07:00

test_prefill_delayer_high_watermark.py

fix(scheduler): track max prefill batch size over recent real admissions (#34284)

2026-08-15 10:48:03 +08:00

test_priority_scheduling_disaggregation.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

test_profile_merger_http_api.py

[CI] Move CPU-only unit tests to the CPU suite and trim dead 5090 registrations (#33654)

2026-08-05 01:43:29 -07:00

test_retraction_order.py

config: project the config bags from the resolution result (#35906)

2026-08-23 01:18:24 -07:00

test_schedule_batch_convert_decode_to_extend.py

[Fix] DP attention: correct the decode->extend prefix off-by-one (#37505)

2026-09-02 16:14:16 -07:00

test_schedule_batch_out_of_place.py

[HiCache] L3 storage prefetch lifecycle metrics and cross-tier attribution fixes (#37503)

2026-09-03 16:00:04 -07:00

test_schedule_batch_prepare_for_decode.py

[mem_cache] Move kv_committed_len into ReqKvInfo (#37078)

2026-08-29 22:42:25 -07:00

test_schedule_batch_req_pool_indices.py

[mem_cache] Move req_pool_idx into ReqKvInfo (#37094)

2026-08-30 14:46:21 -07:00

test_schedule_policy_dfs_weight.py

[Radix Cache] Add Rust TreeCore backend with shared parity tests (#32710)

2026-09-01 00:26:20 +08:00

test_scheduler_chunked_req_gate.py

[mem_cache] Move mamba state and retraction_backup into ReqKvInfo (#37164)

2026-08-30 22:03:01 -07:00

test_scheduler_decision_batch_params.py

qwen 3.8 rebase (#35758)

2026-08-28 20:41:34 -07:00

test_scheduler_flush_cache.py

[CI] reduce CPU CI scope with base-c suite (#28623)

2026-06-24 16:18:06 +08:00

test_scheduler_hicache_attach.py

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

test_scheduler_init_req_max_new_tokens.py

config: the runner and scheduler read resolved config from the bags (#34095)

2026-08-09 14:45:11 -07:00

test_scheduler_internal_state_env_vars.py

config: a parallel size has one spelling; a patched scope declares its own (#36621)

2026-08-27 12:56:42 -07:00

test_scheduler_internal_state_world_size.py

config: a parallel size has one spelling; a patched scope declares its own (#36621)

2026-08-27 12:56:42 -07:00

test_scheduler_on_idle_load.py

Publish per-scheduler load on a dedicated socket for load-aware routers (#34608)

2026-08-27 19:33:18 +08:00

test_scheduler_pause_generation.py

Register CPU CI for 17 e2e tests and partition xeon base-c suite (#35227)

2026-08-24 10:49:38 +08:00

test_scheduler_prefill_decode_interval.py

[Scheduler] Add configurable decode interval after prefill (#35017)

2026-08-19 12:01:36 -07:00

test_scheduler_recv_skipper.py

config: the DP/EP topology reads come from the parallel bag (#35025)

2026-08-17 16:17:26 -07:00

test_scheduler_timeouts.py

[Unified Cache][5/N]: Integrate external linker mode end to end (#37381)

2026-09-04 02:02:58 +08:00

test_scheduler_uno_request_validation.py

[Speculative Decoding] Add native UNO serving support (#37667)

2026-09-03 20:08:41 +08:00

test_scheduler_weight_version_tracking.py

Report per-token weight-version spans in generation meta info (#35926)

2026-08-24 20:18:52 +08:00

test_stop_str_speculative.py

fix(schedule_batch): trim stop string when EOS matches in the same step (#28802)

2026-06-22 13:14:00 -07:00

test_tokenizer_config_updates.py

config: constructing a config no longer resolves it (#35907)

2026-08-23 01:18:53 -07:00

test_tokenizer_manager_rid_cleanup.py

Fix KeyError on batch requests whose state is freed before it is read (#36638)

2026-08-28 12:57:07 -07:00

test_trim_matched_stop.py

Fix spec v2 stop output boundary (#25980)

2026-06-09 00:32:21 -07:00

test_uno_token_accounting.py

[Speculative Decoding] Add native UNO serving support (#37667)

2026-09-03 20:08:41 +08:00

test_vocab_boundary_finish.py

[misc] Remove unit test cases that fail the admission criteria (round 3) (#30713)

2026-07-09 19:42:51 -07:00