Commit Graph
23 Commits
Author SHA1 Message Date
Zilin Zhu 8e3663d4e8 Add default enable_memory_saver to HybridLinearKVPool (#13371) 2025-11-16 22:35:13 +08:00
Zilin Zhu 9edb0e0da3 Add SGLANG_ENABLE_REQ_POOL_LEAK_STRICT_CHECK to bypass mem leak check (#13339) 2025-11-16 22:02:22 +08:00
Zilin Zhu 9509c4ccd3 [RL] enable offloading hybrid linear attn model (#13336) 2025-11-16 17:12:52 +08:00
Zilin Zhu bc083521a8 [RL] support update_weights_from_tensor for mtp (#7415) 2025-11-15 16:57:01 +08:00
Zilin Zhu f0b5ccf5f5 [RL] Allow bypassing /health check (#13320) 2025-11-15 16:33:54 +08:00
Zilin Zhu 56fc483073 [RL] support only do cpu backup on draft model (#13318) 2025-11-15 16:31:57 +08:00
Zilin Zhu 34851471b2 Add more statistics for spec decoding (#13317) 2025-11-15 14:20:28 +08:00
Zilin Zhu e68a2b5b2f [RL] use cpu group to prepare_mlp_sync_batch_raw when the server is offloaded (#10152) 2025-10-18 14:29:35 +08:00
Zilin Zhu 31b9f19e54 [RL] support weight update with DP attention (#11669) 2025-10-18 14:26:19 +08:00
Zilin Zhu 69fe3c9726 Manually flip deepep_mode for cuda_graph (#11666) 2025-10-18 08:05:48 +08:00
Zilin Zhu dd650e0e21 [RL] fix skip_server_warmup and rl health_generate logic (#8757) 2025-08-08 04:34:38 -07:00
Zilin Zhu 3435a24e81 [RL] fix update weight for FusedMoE with EP (#8676) 2025-08-03 10:20:39 -07:00
Zilin Zhu af46f299f9 [RL] add pause and continue generation for async rl training (#7419) 2025-07-04 18:49:49 -07:00
Zilin Zhu 16a6b1d83a [RL] Add --nccl-port to prevent port conflict (#7418) 2025-07-04 18:48:57 -07:00
Zilin Zhu 82f021e22e [router] add --log-level to sgl-router (#6512) 2025-07-02 19:33:04 -07:00
Zilin Zhu 0626f678de [RL] support update_weights_from_distributed with different group and multiple weights (#7292) 2025-07-02 19:29:11 -07:00
Zilin Zhu 09e699bba4 [RL] add --skip-warmup (#7416) 2025-07-02 18:50:43 -07:00
Zilin Zhu 51cdd81f97 [fix][RL] Fix DeepSeekV3ForCausalLM.post_load_weights for multiple update weight (#6265) 2025-05-29 16:28:10 -07:00
Zilin Zhu e9feb48838 [RL] Remove the w13 weight_scale and input_scale for UnquantizedEPMoE… (#6308) 2025-05-21 22:03:15 -07:00
Zilin Zhu 7c347259ff [RL] allow weight updation with dp attention enabled (#6311) 2025-05-21 01:58:55 -07:00
Zilin Zhu 669caa0a3f [router] support http2 in router (#6487) 2025-05-21 01:42:45 -07:00
Zilin Zhu e3bed74afb [router] Add /list_workers endpoint to router (#6366) 2025-05-17 09:49:02 -07:00
Zilin Zhu 44a3783d13 [fix][RL] Remove the incorrect barrier in init_weights_update_group (#5914) 2025-05-14 19:15:21 -07:00