Commit Graph

Select branches

Hide Pull Requests

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 18a7eb9e58 Move output streaming to SchedulerOutputStreamer (#25635) fzyzcjy 2026-05-18 18:44:07 +08:00
• dc88b4eeb4 Stand up SchedulerOutputStreamer; migrate output-streaming state to it (#25634) fzyzcjy 2026-05-18 18:43:48 +08:00
• 2cbe01d044 Move logprob assembly to SchedulerLogprobResultProcessor (#25633) fzyzcjy 2026-05-18 18:43:27 +08:00
• e737f61b29 Introduce SchedulerLogprobResultProcessor to own logprob state (#25632) fzyzcjy 2026-05-18 18:42:59 +08:00
• cf12070a0f Move idle-metrics logging to SchedulerMetricsReporter (#25631) fzyzcjy 2026-05-18 18:42:34 +08:00
• fd97fbb096 Move metrics reporting to SchedulerMetricsReporter and retire metrics mixin (#25630) fzyzcjy 2026-05-18 18:42:08 +08:00
• 780d969699 Add SchedulerMetricsReporter and route metrics state through it (#25629) fzyzcjy 2026-05-18 18:41:35 +08:00
• 8357d07569 Move queue-load reporting to SchedulerLoadInquirer (#25628) fzyzcjy 2026-05-18 18:41:12 +08:00
• bde932cbbb Carve out SchedulerLoadInquirer for queue-load state (#25627) fzyzcjy 2026-05-18 18:40:46 +08:00
• 1213277879 Move KV-cache event emission to SchedulerKvEventsPublisher (#25626) fzyzcjy 2026-05-18 18:40:20 +08:00
• 0f888442c2 Stand up SchedulerKvEventsPublisher; migrate KV-event state to it (#25625) fzyzcjy 2026-05-18 18:39:50 +08:00
• f3dce08283 Move invariant checks to SchedulerInvariantChecker and retire runtime_checker mixin (#25624) fzyzcjy 2026-05-18 18:39:24 +08:00
• 8a200464fd Introduce SchedulerInvariantChecker to own invariant-check state (#25623) fzyzcjy 2026-05-18 18:38:57 +08:00
• b463740953 Move create_scheduler_watchdog from runtime_checker mixin to scheduler.py (#25622) fzyzcjy 2026-05-18 18:38:26 +08:00
• ee392a1e14 Move pool-stats sampling to SchedulerPoolStatsObserver (#25621) fzyzcjy 2026-05-18 18:37:50 +08:00
• 9fdf73f393 Add SchedulerPoolStatsObserver and route pool-stats state through it (#25619) fzyzcjy 2026-05-18 18:36:36 +08:00
• c58b47bc86 Move PoolStats dataclass to scheduler_components.pool_stats_observer (#25618) fzyzcjy 2026-05-18 18:35:27 +08:00
• 95d86e5c43 Move on_idle from runtime_checker mixin into Scheduler (#25617) fzyzcjy 2026-05-18 18:34:58 +08:00
• 7851ba09f7 Move weight-update RPC handlers to SchedulerWeightUpdaterManager (#25616) fzyzcjy 2026-05-18 18:34:15 +08:00
• 56f27635b8 Carve out SchedulerWeightUpdaterManager for weight-update state (#25615) fzyzcjy 2026-05-18 18:33:48 +08:00
• a35690f070 Move profiler controls to SchedulerProfilerManager (#25614) fzyzcjy 2026-05-18 18:33:17 +08:00
• b0a511560c Stand up SchedulerProfilerManager; migrate profiler state to it (#25613) fzyzcjy 2026-05-18 18:32:46 +08:00
• 4d6eec7b32 Move DP-attention adapter methods to SchedulerDPAttnAdapter (#25612) fzyzcjy 2026-05-18 18:32:16 +08:00
• 8f37a8a3f3 Introduce SchedulerDPAttnAdapter to own DP-attention state (#25611) fzyzcjy 2026-05-18 18:31:45 +08:00
• 0e9eab19a9 Move request-ingress methods to SchedulerRequestReceiver (#25610) fzyzcjy 2026-05-18 18:31:17 +08:00
• e6f3dcd790 Add SchedulerRequestReceiver and route request-ingress state through it (#25609) fzyzcjy 2026-05-18 18:30:43 +08:00
• 768d347565 Pre-declare mode-conditional Scheduler fields with explicit defaults (#25608) fzyzcjy 2026-05-18 18:29:58 +08:00
• 3e3661fd2f Move build_kv_cache to mem_cache.kv_cache_builder (#25607) fzyzcjy 2026-05-18 18:29:30 +08:00
• fed1197474 Reshape init_cache_with_memory_pool to match the future build_kv_cache signature (#25606) fzyzcjy 2026-05-18 18:28:58 +08:00
• 60337abe24 Hoist hisparse and decode-offload setup out of init_cache_with_memory_pool (#25605) fzyzcjy 2026-05-18 18:28:26 +08:00
• 8692bdd3de Move maybe_register_hicache_draft to mem_cache.kv_cache_builder (#25604) fzyzcjy 2026-05-18 18:27:58 +08:00
• 189e0a4240 Decouple _maybe_register_hicache_draft from self (#25603) fzyzcjy 2026-05-18 18:27:29 +08:00
• 062f6f7ae8 Move get_draft_kv_pool to mem_cache.kv_cache_builder (#25602) fzyzcjy 2026-05-18 18:27:01 +08:00
• d1c04deba7 Decouple _get_draft_kv_pool from self before extraction (#25601) fzyzcjy 2026-05-18 18:26:20 +08:00
• abe2ec2aff [AMD] Enable shared-experts fusion with new KIMI-K2.5-MXFP4 model. (#25390) sogalin_codegen 2026-05-18 16:30:58 +08:00
• e5589843a3 feature: upstream cancel (#19524) 3 people 2026-05-18 01:20:09 -07:00
• 54eb2904a4 minor: docs include mac installation (#25178) 3 people 2026-05-18 13:18:59 +05:30
• 7adb37bb52 [AMD] fix moriep unittest oom on mi300x ci (#25301) billishyahaoandBingxu Chen 2026-05-18 15:42:11 +08:00
• 8d5ed330cc [XPU] Enable qwen3.5 on XPU (#21668) Xia WeiwenandMa Mingfei 2026-05-17 23:59:19 -07:00
• 1f9eda4ea1 Use DeepGEMM BF16 for unquantized DeepEP LL MoE (#25540) YAMY 2026-05-17 23:33:23 -07:00
• 6a21dd20b1 Fix EPLB mapping for TopK paths (#25285) xutizhou 2026-05-18 14:26:04 +08:00
• 6ccc5b807d Optimize detokenization without HF decode kwargs (#25309) maocheng23 2026-05-17 20:37:36 -07:00
• 784fe7e99b feat(mimo-v2): add EPD disaggregation support (#24931) Zhonghua Deng 2026-05-18 10:33:16 +08:00
• 43e133208a Quiet test_bs_1_speed CI log (#25548) Liangsheng Yin 2026-05-17 19:29:44 -07:00
• a080358cac [Refactor] Refactor DeepEP dispatcher (#22822) 3 people 2026-05-18 04:36:42 +03:00
• 5147de26e4 Fix AMX GQA extend attention (#25180) miamiaoxyzandMa Mingfei 2026-05-18 09:30:02 +08:00
• 2a357071ec [NPU]fix:NPUMLATokenToKVPool object has no attribute "kv_buffer" (#25249) chenxu214 2026-05-18 09:09:28 +08:00
• 58ece60703 refactor: remove ModelWorkerBatch indirection (#25516) Liangsheng Yin 2026-05-17 18:05:39 -07:00
• b3803164cb [diffusion] fix: fix unipc device placement + flowunipc sigma_min crash (#23294) jy-song-hub 2026-05-17 18:01:07 -07:00
• c67b287056 Enable trtllm_mha as gemma4 default attn backend. (#25006) Shu WangandKhoa Pham 2026-05-17 16:58:12 -05:00
• 7158a255eb [MoE Refactor] Migrate flashinfer_cutedsl + DeepEP to MoeRunner (#25525) Cheng WanandClaude Opus 4.7 2026-05-17 14:48:17 -07:00
• 89e501c5a8 [diffusion] CI: tighten selected perf baselines (#25510) Mick 2026-05-17 23:35:59 +08:00
• 3bf7e346fc [MUSA][Diffusion] Improve wan model inference speed using torch.compile (#25256) Qingfu WenandR0CKSTAR 2026-05-17 22:10:24 +08:00
• eccfd6dea7 [diffusion] feat: configure encoder as layerwise-offload by default (#25517) Mick 2026-05-17 20:47:48 +08:00
• be3c425788 [MoE] Unify DeepEPMoE+MoriEPMoE through AITER MoeRunner pre/post-permute (#23760) Cheng WanandClaude Opus 4.7 2026-05-17 02:25:52 -07:00
• 568ba7216a Fix logging for inplace setting in the flashInfer-trtllm backend (#25522) Cheng Wan 2026-05-17 02:20:14 -07:00
• e547f3f804 fix(unified radix cache w/ hicache): backup ancestor nodes before leaf in write_back eviction (#24585) Yongji WuandZhangheng 2026-05-17 00:58:46 -07:00
• 46e0f5007d Fix image (random multimodal) dataset token statistics (#22371) Bishwo Adhikari 2026-05-17 09:12:03 +03:00
• 52875ab6f4 [AMD][CI] Register Eagle constrained decoding test (#25260) 4 people 2026-05-17 14:02:35 +08:00
• 4ef9bad223 [AMD] ci: register 5 framework tests to run on AMD CI (#25208) MichaelandHAI 2026-05-17 13:56:57 +08:00
• c1d9e37a52 [diffusion] feat: add memory-aware component load order (#25457) Mick 2026-05-17 13:22:55 +08:00
• 6dcacb1159 [Doc] Fix several places for dpsk v4 cookbook (#25506) Baizhou Zhang 2026-05-16 21:54:15 -07:00
• 229cadec04 Update logging for inplace setting in MoE layer (#25499) Cheng Wan 2026-05-16 17:12:11 -07:00
• 0c017db916 Update kl_div_thres to 0.02 in swa_radix_cache (#25497) Cheng Wan 2026-05-16 16:43:12 -07:00
• 9869ef0849 Revert "[attn backend] avoid initing parent class's workspace buffer" (#25488) Qiaolin Yu 2026-05-16 13:05:42 -07:00
• 57eb5bdaf6 [Doc] DSV4 cookbook: clean up env vars, add MegaMoE toggle, unify docker image (#25412) Yuhao Yang 2026-05-17 02:28:05 +08:00
• 9f26697d6a [Docs] Update DeepSeek V4 cookbook to use the latest docker image (#25410) zijiexia 2026-05-16 11:17:51 -07:00
• 435ea41cf0 Delegate ModelExpress loading to package (#24723) Zheng Luo 2026-05-16 11:16:44 -07:00
• 0be539024f [BugFix]: Fix DeepSeek V4 HiCache layer count logic (#25477) Zhangheng 2026-05-16 23:50:01 +08:00
• 2fc217df4d [codex] Split diffusion quant CI coverage (#24599) Xiaoyu ZhangandCodex 2026-05-16 22:05:02 +08:00
• 596b45b373 [diffusion] fix: change default qwen-image vae precision to bf16 (#25411) Chi McIsaac 2026-05-16 09:55:31 -04:00
• 93bacc25ed [codex] Optimize LTX2 split rotary kernel (#24732) Xiaoyu Zhang 2026-05-16 20:58:38 +08:00
• 0f50ed86c9 fix(pd): fix kv pools without end_layer (#25476) ybyang 2026-05-16 19:49:26 +08:00
• 90d3d42ac1 pr-states: workflow_dispatch refresh on slash cmds (#25475) Liangsheng Yin 2026-05-16 03:34:52 -07:00
• 2f81718773 [attn backend] avoid initing parent class's workspace buffer (#25321) Qiaolin Yu 2026-05-16 03:30:33 -07:00
• aec4022e58 [Spec] Clean up draft-window-size handling; extract spec arg setup to arg_groups (#25424) Liangsheng Yin 2026-05-16 03:23:48 -07:00
• d1eb472a7a fix(overlap): skip empty future interval for dp attention idle ranks (#25473) Liangsheng Yin 2026-05-16 02:08:01 -07:00
• 7f37ffae9d [diffusion] CI: fix nightly CI (#25241) Mick 2026-05-16 16:55:30 +08:00
• af26b71ae8 [Misc] Update release branch cut script (#25468) Baizhou Zhang 2026-05-16 00:51:48 -07:00
• b2c6db0cc4 [MoE] Decouple Mega MoE from DeepEP backend (#25406) Yuhao Yang 2026-05-16 15:18:43 +08:00
• 162540e0a8 feat: add Pipeline Parallelism (PP) and PD support for DeepSeek-V4 (#24704) 3 people 2026-05-16 13:54:32 +08:00
• bda01d2435 [Disagg] Fix MegaMoE topk_ids dtype mismatch and FakeKVManager missing kv_args (#25380) JoeLee314andJoeLee314 2026-05-16 13:46:44 +08:00
• daade9cc00 [Fix] Probe speculative draft config via sglang get_config (#25428) Jimmy Shong 2026-05-15 22:01:44 -07:00
• 416fdbbb3d [diffusion] feat: generalize layerwise offload residency mixin to all components (#24593) Mick 2026-05-16 11:44:46 +08:00
• a741d0cc56 [CI] Lower mem-fraction-static for GLM-5.1 FP8 8-GPU test to 0.85 (#25453) Jimmy Shong 2026-05-15 20:14:47 -07:00
• ce2506e1c6 Deprecate record_nolora_graph dual MoE CUDA graph capture (#24314) Sam Shleifer 2026-05-15 22:20:58 -04:00
• b674007026 [CI] Show distinct run-name per event in pr-test workflow (#25452) Liangsheng Yin 2026-05-15 18:58:07 -07:00
• 4c6eb12dea Fix invalid suite name in test_multi_detokenizer (#25450) fzyzcjy 2026-05-16 09:42:11 +08:00
• 688b679af2 Convert discarded-value ternary to a plain if statement (#25449) fzyzcjy 2026-05-16 09:35:36 +08:00
• b7d62bd724 [CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420) Liangsheng Yin 2026-05-15 18:26:55 -07:00
• d0c38329b2 Inline the trivial _build_model_config wrapper (#25448) fzyzcjy 2026-05-16 09:25:48 +08:00
• 4190328767 Replace defensive getattr in pool_configurator with direct access (#25447) fzyzcjy 2026-05-16 09:25:14 +08:00
• 48f85d464f Fix V2 trace filename collisions when DP/PP/EP enabled (#25446) fzyzcjy 2026-05-16 09:24:39 +08:00
• b3059e2d1e Inject ParallelState into ProfilerV2 (#25445) fzyzcjy 2026-05-16 09:24:15 +08:00
• 43797cc804 Bundle Scheduler rank/size fields into a frozen ParallelState (#25444) fzyzcjy 2026-05-16 09:23:51 +08:00
• 7c716e73e0 Add mechanical-refactor-verify skill from miles (#25443) fzyzcjy 2026-05-16 09:23:06 +08:00
• fa8b7c9647 Lift forward_ct/cur_batch and use direct access in watchdog (#25442) fzyzcjy 2026-05-16 09:22:41 +08:00
• 72eb231d28 Annotate dead max_running_requests_under_SLO (#25441) fzyzcjy 2026-05-16 09:22:13 +08:00
• c8e5cf5768 Fix LoRA pool not appearing in /v1/loads (#25440) fzyzcjy 2026-05-16 09:21:27 +08:00
• 5c440cdc41 Lift running_batch / running_mbs access — direct + PP-explicit (#25439) fzyzcjy 2026-05-16 09:21:00 +08:00