 Liangsheng Yin
|
9e3bb9a307
|
[Spec] fold can_run_cuda_graph into EagleVerifyOutput; drop dead extend-after-decode check (#25566)
|
2026-05-18 14:24:54 -07:00 |
|
|
Qiaolin Yu
|
1f185c6ba8
|
Support draft extend cuda graph for tokenspeed_mla attention backend (#25489)
|
2026-05-18 11:26:16 -07:00 |
|
|
Qiaolin Yu
|
f5049709b3
|
fix(eagle3): drop +1 offset on aux layer ids when first id != 1 (#25454)
|
2026-05-18 11:25:51 -07:00 |
|
|
Shangming Cai
|
86c6c77f2f
|
[Bugfix] Fix missing group arg in get dp buffer (#25585)
|
2026-05-19 02:08:10 +08:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
b29e41e8b3
|
Respect user override for Gemma4 attention backend (#25547)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-18 10:46:25 -07:00 |
|
|
Lianmin Zheng
|
f21fe6ad4d
|
Fix PD disaggregation warmup: set request_name and improve error logging (#25542)
|
2026-05-18 09:49:56 -07:00 |
|
|
Gaoji Liu
|
3e2a109636
|
Add output_gate_type to Qwen3NextConfig and update models to utilize it (#25401)
|
2026-05-19 00:18:08 +08:00 |
|
|
|
d96e593fd0
|
[Benchmark] Add SGLANG_SIMULATE_UNIFORM_EXPERTS for balanced expert routing with dummy weights (#25571)
Co-authored-by: Byron Hsu <byronhsu@Byrons-MacBook-Pro.local>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-18 09:16:12 -07:00 |
|
|
+3
|
866793c502
|
Amd/deepseek v4 rebase main 0509 (#24933)
Co-authored-by: root <root@smci355-ccs-aus-m12-33.cs-aus.dcgpu>
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: amd-danli103 <danli103@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
Co-authored-by: yichiche@amd.com <jacky.cheng>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
|
2026-05-18 09:15:07 -07:00 |
|
|
Mick
|
110bbdcad7
|
[diffusion] fix: use dynamic LoRA for LTX2 original stage-two (#25591)
|
2026-05-18 23:05:29 +08:00 |
|
|
ybyang
|
d1acd62d29
|
fix(disagg): unstuck decode aborts under prealloc pressure (#25561)
|
2026-05-18 22:57:22 +08:00 |
|
|
Shangming Cai
|
f04c522534
|
[PD] Add conclude_state to fake KV backend (#25599)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-18 19:56:42 +08:00 |
|
|
fzyzcjy
|
be64d875ad
|
Fix flush_cache AttributeError on is_stats_logging_rank (#25641)
|
2026-05-18 19:23:48 +08:00 |
|
|
fzyzcjy
|
8b94e1d0cf
|
Delete the now-unused is_work_request from scheduler.py (#25639)
|
2026-05-18 18:50:23 +08:00 |
|
|
fzyzcjy
|
c54b34c007
|
Move module-level helpers out of scheduler.py (#25638)
|
2026-05-18 18:45:38 +08:00 |
|
|
fzyzcjy
|
99ad2b0894
|
Move batch-result processing to SchedulerBatchResultProcessor and retire output_processor mixin (#25637)
|
2026-05-18 18:45:01 +08:00 |
|
|
fzyzcjy
|
7d0b0b6991
|
Carve out SchedulerBatchResultProcessor for batch-result state (#25636)
|
2026-05-18 18:44:41 +08:00 |
|
|
fzyzcjy
|
18a7eb9e58
|
Move output streaming to SchedulerOutputStreamer (#25635)
|
2026-05-18 18:44:07 +08:00 |
|
|
fzyzcjy
|
dc88b4eeb4
|
Stand up SchedulerOutputStreamer; migrate output-streaming state to it (#25634)
|
2026-05-18 18:43:48 +08:00 |
|
|
fzyzcjy
|
2cbe01d044
|
Move logprob assembly to SchedulerLogprobResultProcessor (#25633)
|
2026-05-18 18:43:27 +08:00 |
|
|
fzyzcjy
|
e737f61b29
|
Introduce SchedulerLogprobResultProcessor to own logprob state (#25632)
|
2026-05-18 18:42:59 +08:00 |
|
|
fzyzcjy
|
cf12070a0f
|
Move idle-metrics logging to SchedulerMetricsReporter (#25631)
|
2026-05-18 18:42:34 +08:00 |
|
|
fzyzcjy
|
fd97fbb096
|
Move metrics reporting to SchedulerMetricsReporter and retire metrics mixin (#25630)
|
2026-05-18 18:42:08 +08:00 |
|
|
fzyzcjy
|
780d969699
|
Add SchedulerMetricsReporter and route metrics state through it (#25629)
|
2026-05-18 18:41:35 +08:00 |
|
|
fzyzcjy
|
8357d07569
|
Move queue-load reporting to SchedulerLoadInquirer (#25628)
|
2026-05-18 18:41:12 +08:00 |
|
|
fzyzcjy
|
bde932cbbb
|
Carve out SchedulerLoadInquirer for queue-load state (#25627)
|
2026-05-18 18:40:46 +08:00 |
|
|
fzyzcjy
|
1213277879
|
Move KV-cache event emission to SchedulerKvEventsPublisher (#25626)
|
2026-05-18 18:40:20 +08:00 |
|
|
fzyzcjy
|
0f888442c2
|
Stand up SchedulerKvEventsPublisher; migrate KV-event state to it (#25625)
|
2026-05-18 18:39:50 +08:00 |
|
|
fzyzcjy
|
f3dce08283
|
Move invariant checks to SchedulerInvariantChecker and retire runtime_checker mixin (#25624)
|
2026-05-18 18:39:24 +08:00 |
|
|
fzyzcjy
|
8a200464fd
|
Introduce SchedulerInvariantChecker to own invariant-check state (#25623)
|
2026-05-18 18:38:57 +08:00 |
|
|
fzyzcjy
|
b463740953
|
Move create_scheduler_watchdog from runtime_checker mixin to scheduler.py (#25622)
|
2026-05-18 18:38:26 +08:00 |
|
|
fzyzcjy
|
ee392a1e14
|
Move pool-stats sampling to SchedulerPoolStatsObserver (#25621)
|
2026-05-18 18:37:50 +08:00 |
|
|
fzyzcjy
|
9fdf73f393
|
Add SchedulerPoolStatsObserver and route pool-stats state through it (#25619)
|
2026-05-18 18:36:36 +08:00 |
|
|
fzyzcjy
|
c58b47bc86
|
Move PoolStats dataclass to scheduler_components.pool_stats_observer (#25618)
|
2026-05-18 18:35:27 +08:00 |
|
|
fzyzcjy
|
95d86e5c43
|
Move on_idle from runtime_checker mixin into Scheduler (#25617)
|
2026-05-18 18:34:58 +08:00 |
|
|
fzyzcjy
|
7851ba09f7
|
Move weight-update RPC handlers to SchedulerWeightUpdaterManager (#25616)
|
2026-05-18 18:34:15 +08:00 |
|
|
fzyzcjy
|
56f27635b8
|
Carve out SchedulerWeightUpdaterManager for weight-update state (#25615)
|
2026-05-18 18:33:48 +08:00 |
|
|
fzyzcjy
|
a35690f070
|
Move profiler controls to SchedulerProfilerManager (#25614)
|
2026-05-18 18:33:17 +08:00 |
|
|
fzyzcjy
|
b0a511560c
|
Stand up SchedulerProfilerManager; migrate profiler state to it (#25613)
|
2026-05-18 18:32:46 +08:00 |
|
|
fzyzcjy
|
4d6eec7b32
|
Move DP-attention adapter methods to SchedulerDPAttnAdapter (#25612)
|
2026-05-18 18:32:16 +08:00 |
|
|
fzyzcjy
|
8f37a8a3f3
|
Introduce SchedulerDPAttnAdapter to own DP-attention state (#25611)
|
2026-05-18 18:31:45 +08:00 |
|
|
fzyzcjy
|
0e9eab19a9
|
Move request-ingress methods to SchedulerRequestReceiver (#25610)
|
2026-05-18 18:31:17 +08:00 |
|
|
fzyzcjy
|
e6f3dcd790
|
Add SchedulerRequestReceiver and route request-ingress state through it (#25609)
|
2026-05-18 18:30:43 +08:00 |
|
|
fzyzcjy
|
768d347565
|
Pre-declare mode-conditional Scheduler fields with explicit defaults (#25608)
|
2026-05-18 18:29:58 +08:00 |
|
|
fzyzcjy
|
3e3661fd2f
|
Move build_kv_cache to mem_cache.kv_cache_builder (#25607)
|
2026-05-18 18:29:30 +08:00 |
|
|
fzyzcjy
|
fed1197474
|
Reshape init_cache_with_memory_pool to match the future build_kv_cache signature (#25606)
|
2026-05-18 18:28:58 +08:00 |
|
|
fzyzcjy
|
60337abe24
|
Hoist hisparse and decode-offload setup out of init_cache_with_memory_pool (#25605)
|
2026-05-18 18:28:26 +08:00 |
|
|
fzyzcjy
|
8692bdd3de
|
Move maybe_register_hicache_draft to mem_cache.kv_cache_builder (#25604)
|
2026-05-18 18:27:58 +08:00 |
|
|
fzyzcjy
|
189e0a4240
|
Decouple _maybe_register_hicache_draft from self (#25603)
|
2026-05-18 18:27:29 +08:00 |
|
|
fzyzcjy
|
062f6f7ae8
|
Move get_draft_kv_pool to mem_cache.kv_cache_builder (#25602)
|
2026-05-18 18:27:01 +08:00 |
|