f4d9d2e670
[RL] Add RL weight-update sessions and support updating spec draft runners ( #40777 )
...
Co-authored-by: Jiajun Li <guapisolo@gmail.com >
Co-authored-by: Nan Jiang <59716405+nanjiangwill@users.noreply.github.com >
Co-authored-by: maocheng23 <maocheng@berkeley.edu >
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai >
Co-authored-by: JD-ETH <jaedon.guo@gmail.com >
Co-authored-by: Letian Ruan <ruanlt420@gmail.com >
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
2026-09-23 20:04:57 -07:00
Cheng Wan
db272201a2
[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement ( #38375 )
2026-09-08 16:42:12 -07:00
Xiaoyu Zhang and Mick Qian
4d23a4fa6d
[Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) ( #37436 )
...
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com >
2026-09-07 15:13:59 +08:00
sglang-bot and sglang-bot
6252993afe
chore: update CI test est_time values ( #38238 )
...
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com >
2026-09-06 17:49:41 -07:00
55bf3380e0
Support Hy4-preview ( #36805 )
...
Co-authored-by: BBuf <1182563586@qq.com >
Co-authored-by: alphabetc1 <2508695655@qq.com >
2026-09-04 18:03:49 -07:00
jundu and Ma Mingfei
8770c1db1f
[CPU][CI]: rename Xeon CPU CI suites to stage-*-intel ( #37395 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-09-04 10:08:41 +08:00
Alex Nails and Alison Shao
28262c20df
[CI][RFC] Replace black-jupyter with ruff-format ( #37210 )
...
Co-authored-by: Alison Shao <a.shao@wustl.edu >
2026-09-02 19:46:08 -07:00
Ziang Li
9a85473a89
[FlashInfer v0.6.18] add FlashInfer CuTe DSL NVFP4 W4A16 mode ( #35120 )
2026-08-31 18:47:30 -07:00
Yuzhen Zhou and Jiajun Li
8a87079dbb
Fix stale GLM MoE routing after runtime weight updates ( #35883 )
...
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai >
2026-08-30 14:13:34 -07:00
fzyzcjy
3b24d8981b
Report per-token weight-version spans in generation meta info ( #35926 )
2026-08-24 20:18:52 +08:00
514b997e6c
Register CPU CI for 17 e2e tests and partition xeon base-c suite ( #35227 )
...
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com >
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-08-24 10:49:38 +08:00
Liangsheng Yin
ccbe380028
[CI] Trim the base-c 4-gpu-h100 stage from 5 shards to 4 ( #35407 )
2026-08-19 00:48:07 -07:00
Ziang Li
9d34c2809f
[FlashInfer v0.6.16] Support FlashInfer CuTe DSL NVFP4 MoE quantization ( #28354 )
2026-08-13 17:33:46 -07:00
ilyasher-harmonic
9ced8d0981
Optimize FP32 LM head for bf16/fp16 ( #32370 )
2026-08-11 15:14:50 -07:00
Liangsheng Yin
7c90840bad
[CI] Key scheduled CUDA suites by runner_config instead of hand-written jobs ( #34186 )
2026-08-09 16:44:53 -07:00
Baizhou Zhang
eb3cc879e0
Install DeepEP from release wheels ( #33932 )
2026-08-07 15:38:44 -07:00
Cheng Wan
9b44695713
test: recover the config-namespace-migration deferrals ( #33171 )
...
The module-skipped tests injected config by faking get_server_args (a
SimpleNamespace stand-in patched onto the module) or by writing fields
onto a ServerArgs instance post-publish — both invisible to the namespace
accessors the production code now reads. Re-enable them by publishing the
config they need (get_context().override_server_args seeding, scoped per
test), asserting bag state where the old assertions checked instance
write-through (declare_load_time_override is bag-only), and extending the
per-runner stubs the code genuinely reads (kv_cache_dtype_str,
max_total_tokens, context_len).
The unified-radix-cache file (which grew a large hicache/insert-walk suite
while skipped) is recovered in the same change:
- test_cache_finished_req_strips_thinking (19 parametrized classes) wrote
strip_thinking_cache onto the ServerArgs instance; the cache reads
get_serving().strip_thinking_cache — use the serving bag's scoped
override.
- test_shallower_crossing_backs_up_above_backuped_middle staged its
broken-backup-continuity setup through insert_host, which now
deliberately drops refills below an un-backed-up node under
write-through (host_insert_dropped). Build the same tree state through
an explicit backup + device eviction.
Every config-namespace-migration deferral is recovered, so the deferral
ratchet (test_migration_deferral_ratchet.py) has done its job and is
retired.
2026-08-01 08:59:27 -07:00
Ethan (Yusheng) Su
0a49226d19
[LoRA] 1/n Per-rank tensor serialization for load_lora_adapter_from_tensors under dp_size > 1 ( #32580 )
2026-07-28 14:28:56 -07:00
Cheng Wan
e1479cc966
config: route runtime config adjustments through the namespace bags ( #31812 )
2026-07-22 01:17:22 -07:00
fzyzcjy
6507d4a090
Introduce WeightUpdater and WeightExporter components ( #31148 )
2026-07-14 15:53:33 +08:00
Mohammad Miadh Angkad
96a04cb13f
Fix DeepEP CI test registration ( #30873 )
2026-07-12 05:54:50 -07:00
Cheng Wan
1f15308dca
[refactor] Retire the legacy config accessor and the remaining process singletons ( #30493 )
2026-07-09 02:10:47 -07:00
Cheng Wan
be32c57598
[refactor] Read resolved config from server_args fields; retire the flags mirror tier ( #30346 )
2026-07-07 21:28:34 -07:00
Cheng Wan
8fb99bbaf8
[refactor] Config resolution pipeline: full-stack review (10-PR series, review only) ( #30137 )
2026-07-05 00:00:07 -07:00
Xiaoyu Zhang
b276a9acee
chore: cleanup garbage code ( #29770 )
2026-07-02 16:14:01 +08:00
Zhihao Wang
779ea4a9b5
[RL] fix deepseek v4 MXFP8 flashinfer_trtllm_routed MoE weight update ( #28676 )
...
Signed-off-by: zhihaow6 <zhihaow6@illinois.edu >
2026-07-01 12:29:08 -07:00
Liangsheng Yin
909123ddb8
[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs ( #29591 )
2026-06-28 18:38:28 -07:00
jundu
e04ed05193
[CI] reduce CPU CI scope with base-c suite ( #28623 )
2026-06-24 16:18:06 +08:00
Ziang Li
3fb65ebabd
[RL] Fix FlashInfer TRTLLM MXFP8 dense weight layout ( #28459 )
2026-06-17 10:33:35 +00:00
Michael
a2aa51c818
[AMD] register 4 2-gpu tests to stage-b-test-2-gpu-large-amd ( #28344 )
2026-06-16 21:58:34 -07:00
2495c02c2c
[Refactor] Cuda Graph Runner/Backend Refactor ( #23906 )
...
Co-authored-by: BBuf <1182563586@qq.com >
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com >
2026-06-09 21:36:57 -07:00
Liangsheng Yin
1c79015434
Drop dead ScheduleBatch return_routed_experts/return_indexer_topk fields ( #26760 )
2026-05-29 23:16:09 -07:00
6f1c9fc77b
[RL] Fix crash when the reqs in a batch have a mix of return_routed_experts = True and False. ( #26423 )
...
Co-authored-by: root <root@slurm-h200-209-231.slurm-compute.tenant-slurm.svc.cluster.local >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
2026-05-29 20:46:10 -07:00
MingxuZh
21ba329dac
[Xeon] CPU CI enhancement for Intel Xeon platforms ( #24649 )
2026-05-28 10:49:04 +08:00
Liangsheng Yin
b7d62bd724
[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI ( #25420 )
2026-05-15 18:26:55 -07:00
ba214ef3d3
ci: tag-gated nightly migration — foundation + 40 whole-file moves ( #24725 )
...
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com >
2026-05-14 16:11:15 -07:00
Alison Shao
1e308aec66
ci: B200 conditional split + LPT_SLOP removal (stage-c partition 8→3) ( #25203 )
2026-05-13 18:40:45 -07:00
Liangsheng Yin
22d3f3996c
ci: decouple stage and runner for cuda registry ( #25197 )
2026-05-13 17:28:21 -07:00
Mick
ff70aeac30
[diffusion] feat: add performance mode server args ( #24491 )
2026-05-14 00:57:46 +08:00
d82e339ce2
[Session R3] Add routed_experts_start_len for absolute routing slice control ( #24851 )
...
Co-authored-by: Byron Hsu <byron@periodiclabs.ai >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: zyzshishui <zyzshishui@gmail.com >
Co-authored-by: Yuzhen Zhou <82826991+zyzshishui@users.noreply.github.com >
2026-05-10 10:04:43 -07:00
Liangsheng Yin
44a527f6f4
fix patch_torch test queue race ( #24739 )
2026-05-08 20:25:59 -07:00
fzyzcjy
9ba4aac47b
Fix weight_checker e2e OOM on 32GB GPU + move to nightly ( #24559 )
2026-05-06 21:06:04 -07:00
Baizhou Zhang
9e1336d406
[Misc] Fix breaking weight checker test ( #24553 )
2026-05-06 15:42:54 -07:00
fzyzcjy
c4c5541618
Support getting checksums in weight checker ( #24537 )
2026-05-06 22:59:28 +08:00
fzyzcjy
800deaaefa
Add unit and end-to-end tests for weight checker ( #24536 )
2026-05-06 22:48:48 +08:00
b2420d72ff
[RL] DeepEP support for --enable-return-routed-experts ( #16859 )
...
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
Co-authored-by: Junrong Lin <33685709+ocss884@users.noreply.github.com >
2026-05-05 20:01:07 -07:00
08d4c2072b
move topk capturers to srt/state_capturer/ ( #24450 )
...
Co-authored-by: Yueming Yuan <yym022502@gmail.com >
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com >
Co-authored-by: Ziang Li <ziangli@umich.edu >
2026-05-05 15:54:01 -07:00
Kangyan-Zhou and Claude Opus 4.7
cd27baaffd
[ci][cu13] Bump torch_memory_saver to 0.0.9.post1; restore manual tests ( #23182 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-05-01 22:50:38 -07:00
Alison Shao and Alison Shao
694ef516cb
Revert "[ci] split stage-c-test-4-gpu-b200 to enable a low-disk runner pool" ( #24163 )
...
Co-authored-by: Alison Shao <alisonshao@radixark.ai >
2026-04-30 15:57:19 -07:00
sglang-bot and sglang-bot
da175b964d
chore: update CI test est_time values ( #23785 )
...
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com >
2026-04-26 20:17:50 -07:00