Commit Graph
2581 Commits
Author SHA1 Message Date
fzyzcjy 18a7eb9e58 Move output streaming to SchedulerOutputStreamer (#25635) 2026-05-18 18:44:07 +08:00
fzyzcjy fd97fbb096 Move metrics reporting to SchedulerMetricsReporter and retire metrics mixin (#25630) 2026-05-18 18:42:08 +08:00
fzyzcjy 780d969699 Add SchedulerMetricsReporter and route metrics state through it (#25629) 2026-05-18 18:41:35 +08:00
fzyzcjy c58b47bc86 Move PoolStats dataclass to scheduler_components.pool_stats_observer (#25618) 2026-05-18 18:35:27 +08:00
fzyzcjy a35690f070 Move profiler controls to SchedulerProfilerManager (#25614) 2026-05-18 18:33:17 +08:00
fzyzcjy b0a511560c Stand up SchedulerProfilerManager; migrate profiler state to it (#25613) 2026-05-18 18:32:46 +08:00
fzyzcjy 4d6eec7b32 Move DP-attention adapter methods to SchedulerDPAttnAdapter (#25612) 2026-05-18 18:32:16 +08:00
billishyahaoandBingxu Chen 7adb37bb52 [AMD] fix moriep unittest oom on mi300x ci (#25301)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-05-18 00:42:11 -07:00
Xia WeiwenandMa Mingfei 8d5ed330cc [XPU] Enable qwen3.5 on XPU (#21668)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-18 14:59:19 +08:00
xutizhou 6a21dd20b1 Fix EPLB mapping for TopK paths (#25285) 2026-05-17 23:26:04 -07:00
maocheng23 6ccc5b807d Optimize detokenization without HF decode kwargs (#25309) 2026-05-17 20:37:36 -07:00
a080358cac [Refactor] Refactor DeepEP dispatcher (#22822)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-05-18 04:36:42 +03:00
miamiaoxyzandMa Mingfei 5147de26e4 Fix AMX GQA extend attention (#25180)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-18 09:30:02 +08:00
Liangsheng Yin 58ece60703 refactor: remove ModelWorkerBatch indirection (#25516) 2026-05-17 18:05:39 -07:00
Cheng WanandClaude Opus 4.7 7158a255eb [MoE Refactor] Migrate flashinfer_cutedsl + DeepEP to MoeRunner (#25525)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-17 14:48:17 -07:00
Yongji WuandZhangheng e547f3f804 fix(unified radix cache w/ hicache): backup ancestor nodes before leaf in write_back eviction (#24585)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-05-17 15:58:46 +08:00
52875ab6f4 [AMD][CI] Register Eagle constrained decoding test (#25260)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-05-16 23:02:35 -07:00
MichaelandHAI 4ef9bad223 [AMD] ci: register 5 framework tests to run on AMD CI (#25208)
Co-authored-by: HAI <hixiao@gmail.com>
2026-05-16 22:56:57 -07:00
Cheng Wan 0c017db916 Update kl_div_thres to 0.02 in swa_radix_cache (#25497) 2026-05-16 16:43:12 -07:00
Zheng Luo 435ea41cf0 Delegate ModelExpress loading to package (#24723)
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
2026-05-16 11:16:44 -07:00
Zhangheng 0be539024f [BugFix]: Fix DeepSeek V4 HiCache layer count logic (#25477) 2026-05-16 23:50:01 +08:00
Liangsheng Yin aec4022e58 [Spec] Clean up draft-window-size handling; extract spec arg setup to arg_groups (#25424) 2026-05-16 03:23:48 -07:00
Yuhao Yang b2c6db0cc4 [MoE] Decouple Mega MoE from DeepEP backend (#25406) 2026-05-16 00:18:43 -07:00
Jimmy Shong a741d0cc56 [CI] Lower mem-fraction-static for GLM-5.1 FP8 8-GPU test to 0.85 (#25453) 2026-05-15 20:14:47 -07:00
fzyzcjy 4c6eb12dea Fix invalid suite name in test_multi_detokenizer (#25450) 2026-05-16 09:42:11 +08:00
Liangsheng Yin b7d62bd724 [CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420) 2026-05-15 18:26:55 -07:00
fzyzcjy 43797cc804 Bundle Scheduler rank/size fields into a frozen ParallelState (#25444) 2026-05-16 09:23:51 +08:00
5ba69f50fb Add multi-detokenizer support (#24944)
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-05-15 17:26:26 -07:00
Liangsheng Yin 494ee71189 split test_dsa_models_mtp into 4 files (#25318) 2026-05-15 14:16:57 -07:00
Liangsheng Yin f9caf43095 [CI] slash handler: lookup runs_on from runner_configs.yml (#25394) 2026-05-15 13:59:00 -07:00
Alex Nails 4df42da658 Introduce CudaDeviceMixin and CudaSRTPlatform (#24096) 2026-05-15 10:59:02 -07:00
Zhangheng 21b3ac52b4 [UnifiedTree]: Fix UnifiedRadixCache device match semantics with HiCache (#25277) 2026-05-16 00:40:55 +08:00
liuxianglong17 eec5ba26cf Fix incorrect import in test case (#25080) 2026-05-15 17:35:57 +08:00
Zhangheng fe7a5dd3bf [UnifiedTree]: Add nightly hicache ci for dsa model (#25348) 2026-05-15 16:54:50 +08:00
zhaochen zhang 12408ec668 [Disagg] Add retry with exponential backoff for prefill bootstrap reg… (#25125) 2026-05-15 16:38:51 +08:00
0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
2026-05-15 01:04:56 -07:00
d9fa84b25b [UnifiedTree]: Support HiCache For DeepSeek_V4 (#24691)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
2026-05-14 20:20:52 -07:00
Kangyan-Zhou 974948a701 fix: strip "[asctime]" prefix when parsing JSON log lines in nightly tests (#25340) 2026-05-14 20:17:13 -07:00
Liangsheng Yin d89b678d69 move dead sglang.test files to test/manual (#25316) 2026-05-14 20:02:44 -07:00
Cheng WanandClaude Opus 4.7 1913cb4dbb Skip CI tests added in #24816 (broken on main) (#25329)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-14 18:12:13 -07:00
ba214ef3d3 ci: tag-gated nightly migration — foundation + 40 whole-file moves (#24725)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-14 16:11:15 -07:00
Liangsheng Yin 67096f48bf Revert "[MoE] Decouple Mega MoE from DeepEP backend" (#25317) 2026-05-14 16:00:41 -07:00
Liangsheng Yin 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) 2026-05-14 15:28:58 -07:00
Yuhao Yang 37f030a0de [MoE] Decouple Mega MoE from DeepEP backend (#24884) 2026-05-15 02:01:44 +08:00
Jae B. 90afd680f3 [Apple Silicon] [MLX] Auto-detect MLX-format quantization_config dict (#25191) 2026-05-14 09:55:37 -07:00
Liangsheng Yin 4593bbdf31 ci: dynamic partition + LPT from live sglang-ci-stats model (#25263) 2026-05-14 02:35:59 -07:00
Xingyu Liu 2279b79f35 Add --model-config-parser registry for pluggable config formats (#25050)
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
2026-05-14 01:54:06 -07:00
Alison Shao 36c9495aaa ci: H200 conditional split + dsv4 est_time recalibration (h200 partition 6→2) (#25236) 2026-05-13 22:28:37 -07:00
Ke Bao e4378ff37f [UnifiedRadixCache] Fix HiCache load back start node (#25088) 2026-05-14 13:18:12 +08:00
c701a08765 feat: [2/2][DeepEP] Add waterfill load balancing for shared expert dispatch (#19290)
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
Co-authored-by: root <aichenf@nvidia.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-05-13 19:23:41 -07:00