 Yoray Zack
|
62d0f81f16
|
[2/N] elastic-ep: Enable EPLB after scale-up (#30553)
|
2026-07-30 01:06:56 +08:00 |
|
|
icarus_zh
|
e8a635a412
|
Load initial expert location metadata on CPU (#32435)
|
2026-07-26 20:44:25 +08:00 |
|
|
Cheng Wan
|
f5dcbe8f14
|
Revert RuntimeContext config-namespace reads/roles (#31813–#31817) (#32100)
|
2026-07-22 11:52:41 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
74338e94f1
|
[Kernel] Phase 4 batch-3: migrate tangled JIT subsystems + new groups into kernels.ops (RFC #29630) (#32045)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-22 21:15:03 +08:00 |
|
|
Cheng Wan
|
11a4c2d057
|
config: read resolved config via namespace accessors (#31814)
|
2026-07-22 01:18:05 -07:00 |
|
|
Yoray Zack
|
77d23a796e
|
[1/N] elastic-ep: Add runtime EP scale-up (#30164)
|
2026-07-16 15:53:44 -07:00 |
|
|
fzyzcjy
|
54f99a21d5
|
Narrow component dependencies to injected fields instead of ModelRunner (#31166)
|
2026-07-14 16:03:07 +08:00 |
|
|
fzyzcjy
|
6999007a13
|
Drop ModelRunner's duplicated parallel-degree fields and read them via self.ps (#31165)
|
2026-07-14 16:02:40 +08:00 |
|
|
fzyzcjy
|
08798dba0d
|
Extract MoE/EP setup into a moe_ep_setup module (#31159)
|
2026-07-14 16:00:24 +08:00 |
|
|
fzyzcjy
|
c9b4081016
|
Extract expert location updating into EPLBManager (#31149)
|
2026-07-14 15:54:40 +08:00 |
|
|
Liangsheng Yin
|
348e6fd29b
|
[Fix] Guard kernel OOB accesses and harden runtime edge cases (#30847)
|
2026-07-11 14:22:13 -05:00 |
|
|
Lucia Fang
|
51c5ddbe65
|
[eplb] chunk expert-weight P2P on CUDA to prevent NCCL rebalance hang (#30829)
|
2026-07-10 21:45:17 -07:00 |
|
|
Lianmin ZhengandYonghao Zhuang
|
3dc93a12ca
|
Improve EPLB dispatch handling and diagnostics (#30646)
Co-authored-by: Yonghao Zhuang <yhzhuang@meta.com>
|
2026-07-10 10:40:19 -07:00 |
|
|
Cheng Wan
|
1f15308dca
|
[refactor] Retire the legacy config accessor and the remaining process singletons (#30493)
|
2026-07-09 02:10:47 -07:00 |
|
|
Cheng Wan
|
7709a1f358
|
[refactor] ctx.resources: named slots, stream leases, and workspace buffer leases (#30348)
|
2026-07-07 21:30:10 -07:00 |
|
|
Xiaoyu Zhang
|
b276a9acee
|
chore: cleanup garbage code (#29770)
|
2026-07-02 16:14:01 +08:00 |
|
|
Liangsheng Yin
|
8e1988b746
|
[Perf] Overlap result D2H copy with the next forward step (#29075)
|
2026-06-24 01:34:02 -07:00 |
|
|
Rita BrugarolasandClaude Opus 4.6
|
d6d06cdc17
|
[AMD] Fix no-op dtype cast in _topk_ids_logical_to_physical_dynamic on HIP (#28074)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-06-20 11:07:22 -07:00 |
|
|
feliang-gitandxutizhou
|
92b42c8d8a
|
LPLB: linear-programming load balancer for MoE expert parallelism (#24515)
Co-authored-by: xutizhou <xutingz@nvidia.com>
|
2026-06-16 10:19:42 -07:00 |
|
|
Cheng Wan
|
97a0031799
|
[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984)
|
2026-06-11 17:38:05 -07:00 |
|
|
billishyahaoandHAI
|
0ae27405d0
|
[AMD] Support eplb for moriep (#22985)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-06-10 10:23:51 -07:00 |
|
|
ZeyuanChen2000
|
1d7e2f6fb8
|
[NPU] fix normal DeepEP mode num_tokens_per_rdma_rank error caused by none (#22972)
|
2026-06-01 15:32:14 +08:00 |
|
|
Dongjun Na
|
9d50cd9742
|
[observability] add ServerArgs.stat_loggers for pluggable metrics backend (#24610)
Signed-off-by: Dongjun Na <kmu5544616@gmail.com>
|
2026-05-24 22:41:28 +08:00 |
|
|
Kalyan KumarandMa Mingfei
|
8a9e424faa
|
Replace hardcoded CUDA device with get_device() for XPU support (#13599)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-05-01 07:13:46 +08:00 |
|
|
Xun Sun
|
9a53ab3d6d
|
[6/N] (Elastic EP) Recover failed ranks (#15771)
|
2026-04-28 00:44:26 -07:00 |
|
|
Bi Xue
|
070c6a2489
|
[sgl] perf optimization for eplb (#21232)
|
2026-04-14 22:52:17 +08:00 |
|
|
|
549fbcc864
|
[5/N] (Elastic EP) Use GPU P2P to exchange expert weights during EPLB as much as possible (#12068)
Co-authored-by: Hank Han <hanhan.hank@bytedance.com>
Co-authored-by: Hank Han <hanhan7630@outlook.com>
|
2026-03-16 18:40:58 +08:00 |
|
|
Yoray ZackandBarak Biber
|
9991debde3
|
[Feature] Integrate Elastic NIXL-EP into SGLang (#19248)
Signed-off-by: Barak Biber <bbiber@nvidia.com>
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Barak Biber <bbiber@nvidia.com>
|
2026-03-11 17:37:43 +08:00 |
|
|
Feng Su
|
3b89302277
|
Refactor: observability code cleanup (#17862)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
|
2026-02-24 18:07:29 -08:00 |
|
|
Xun Sun
|
9f5cd80a8d
|
Re-introduce the unit test of test_mooncake_ep_small (#16019)
|
2026-01-12 17:01:24 +08:00 |
|
|
fzyzcjy
|
88a405cc10
|
Support EPLB balancedness prometheus metric without GPU->CPU synchronize (#15401)
|
2025-12-18 22:24:23 +08:00 |
|
|
Even Zhou
|
894c0dc57c
|
[NPU][1/N] NPU basic functions refactor and new modelslim quant type (#13359)
|
2025-12-04 16:15:31 +08:00 |
|
|
Shu Wang
|
a56f770277
|
Fix global scaling factor loading hang (#13484)
|
2025-11-21 16:07:06 -08:00 |
|
|
Qiaolin YuandKangyan-Zhou
|
78a4b446c6
|
Fix dpsk-r1-fp4 tp8 by reverting two commits (#13162 and #13341) (#13348)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-11-15 21:31:36 -08:00 |
|
|
Shu Wang
|
7aa443903d
|
Fix nan in global scaling factor for large scale nvfp4 EP (#13162)
|
2025-11-12 15:32:23 -08:00 |
|
|
Baizhou Zhang
|
99e25805f5
|
[Fix] Fix nan error for large scale ep (#12866)
|
2025-11-11 14:44:57 -08:00 |
|
|
hzh0425
|
ed5e905c89
|
[HotFix]: Add missing SGLANG_EPLB_HEATMAP_COLLECTION_INTERVAL env var (#12776)
|
2025-11-06 18:58:44 -08:00 |
|
|
Yingchun Lai
|
ec92b0cefe
|
EPLB: prefer to use physical experts in the same gpu or node (#10874)
|
2025-10-28 21:01:11 -07:00 |
|
|
Yingchun Lai
|
5e36a0b455
|
[metrics][EPLB]: Support selected count of physical experts on each GPU (#9825)
|
2025-10-28 20:56:19 -07:00 |
|
|
fzyzcjy
|
29195aaa6e
|
Super tiny fix expert distribution dump error (#12271)
|
2025-10-28 15:20:55 -07:00 |
|
|
vipwangerxiaoandPeng Wang
|
8982418957
|
Fix 'KeyError' for per_token expert distribution recorder (#9501)
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>
Co-authored-by: Peng Wang <rocking@linux.alibaba.com>
|
2025-10-25 03:28:50 +00:00 |
|
|
|
904655c5fd
|
[2/N] Added the core structure of elastic EP and the eplb algorithm with faulty rank (#10606)
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-22 01:13:31 -07:00 |
|
|
Chang Su
|
627974405d
|
[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)
|
2025-10-17 16:49:46 -07:00 |
|
|
Liangsheng Yin
|
acc2327bbd
|
Move deep gemm related arguments to sglang.srt.environ (#11547)
|
2025-10-14 00:34:35 +08:00 |
|
|
Liangsheng Yin
|
516738b096
|
Depreate global_server_args_dict (#11528)
|
2025-10-13 19:34:43 +08:00 |
|
|
Cheng Wan
|
1bdd010291
|
Revert "Deprecate global_server_args_dict" (#11520)
|
2025-10-12 17:40:40 -07:00 |
|
|
Liangsheng Yin
|
1083e7e3df
|
Deprecate global_server_args_dict (#11331)
|
2025-10-13 01:20:47 +08:00 |
|
|
Yingchun Lai
|
9d7e82a0ab
|
EPLB: prefer to use physical experts in the same node (#9849)
|
2025-09-22 00:34:30 -07:00 |
|
|
Even Zhou
|
5b64f006ec
|
[Feature] Support DeepEP normal & Redundant Experts on NPU (#9881)
|
2025-09-10 20:35:26 -07:00 |
|
|
Cheng Wan
|
3fa62da78c
|
[7/N] MoE Refactor: the implementation of new framework (#9269)
|
2025-09-05 21:09:09 -07:00 |
|