 fzyzcjy
|
d1c04deba7
|
Decouple _get_draft_kv_pool from self before extraction (#25601)
|
2026-05-18 18:26:20 +08:00 |
|
|
sogalin_codegen
|
abe2ec2aff
|
[AMD] Enable shared-experts fusion with new KIMI-K2.5-MXFP4 model. (#25390)
|
2026-05-18 01:30:58 -07:00 |
|
|
Xia WeiwenandMa Mingfei
|
8d5ed330cc
|
[XPU] Enable qwen3.5 on XPU (#21668)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-05-18 14:59:19 +08:00 |
|
|
YAMY
|
1f9eda4ea1
|
Use DeepGEMM BF16 for unquantized DeepEP LL MoE (#25540)
|
2026-05-17 23:33:23 -07:00 |
|
|
xutizhou
|
6a21dd20b1
|
Fix EPLB mapping for TopK paths (#25285)
|
2026-05-17 23:26:04 -07:00 |
|
|
maocheng23
|
6ccc5b807d
|
Optimize detokenization without HF decode kwargs (#25309)
|
2026-05-17 20:37:36 -07:00 |
|
|
Zhonghua Deng
|
784fe7e99b
|
feat(mimo-v2): add EPD disaggregation support (#24931)
|
2026-05-18 10:33:16 +08:00 |
|
|
Liangsheng Yin
|
43e133208a
|
Quiet test_bs_1_speed CI log (#25548)
|
2026-05-17 19:29:44 -07:00 |
|
|
|
a080358cac
|
[Refactor] Refactor DeepEP dispatcher (#22822)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-05-18 04:36:42 +03:00 |
|
|
chenxu214
|
2a357071ec
|
[NPU]fix:NPUMLATokenToKVPool object has no attribute "kv_buffer" (#25249)
|
2026-05-18 09:09:28 +08:00 |
|
|
Liangsheng Yin
|
58ece60703
|
refactor: remove ModelWorkerBatch indirection (#25516)
|
2026-05-17 18:05:39 -07:00 |
|
|
jy-song-hub
|
b3803164cb
|
[diffusion] fix: fix unipc device placement + flowunipc sigma_min crash (#23294)
|
2026-05-18 09:01:07 +08:00 |
|
|
Shu WangandKhoa Pham
|
c67b287056
|
Enable trtllm_mha as gemma4 default attn backend. (#25006)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
|
2026-05-17 14:58:12 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
7158a255eb
|
[MoE Refactor] Migrate flashinfer_cutedsl + DeepEP to MoeRunner (#25525)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-17 14:48:17 -07:00 |
|
|
Mick
|
89e501c5a8
|
[diffusion] CI: tighten selected perf baselines (#25510)
|
2026-05-17 23:35:59 +08:00 |
|
|
Qingfu WenandR0CKSTAR
|
3bf7e346fc
|
[MUSA][Diffusion] Improve wan model inference speed using torch.compile (#25256)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-05-17 22:10:24 +08:00 |
|
|
Mick
|
eccfd6dea7
|
[diffusion] feat: configure encoder as layerwise-offload by default (#25517)
|
2026-05-17 20:47:48 +08:00 |
|
|
Cheng WanandClaude Opus 4.7
|
be3c425788
|
[MoE] Unify DeepEPMoE+MoriEPMoE through AITER MoeRunner pre/post-permute (#23760)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-17 02:25:52 -07:00 |
|
|
Cheng Wan
|
568ba7216a
|
Fix logging for inplace setting in the flashInfer-trtllm backend (#25522)
|
2026-05-17 02:20:14 -07:00 |
|
|
Yongji WuandZhangheng
|
e547f3f804
|
fix(unified radix cache w/ hicache): backup ancestor nodes before leaf in write_back eviction (#24585)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-05-17 15:58:46 +08:00 |
|
|
Bishwo Adhikari
|
46e0f5007d
|
Fix image (random multimodal) dataset token statistics (#22371)
|
2026-05-16 23:12:03 -07:00 |
|
|
Mick
|
c1d9e37a52
|
[diffusion] feat: add memory-aware component load order (#25457)
|
2026-05-17 13:22:55 +08:00 |
|
|
Cheng Wan
|
229cadec04
|
Update logging for inplace setting in MoE layer (#25499)
|
2026-05-16 17:12:11 -07:00 |
|
|
Qiaolin Yu
|
9869ef0849
|
Revert "[attn backend] avoid initing parent class's workspace buffer" (#25488)
|
2026-05-16 13:05:42 -07:00 |
|
|
Zheng Luo
|
435ea41cf0
|
Delegate ModelExpress loading to package (#24723)
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
|
2026-05-16 11:16:44 -07:00 |
|
|
Zhangheng
|
0be539024f
|
[BugFix]: Fix DeepSeek V4 HiCache layer count logic (#25477)
|
2026-05-16 23:50:01 +08:00 |
|
|
Xiaoyu ZhangandCodex
|
2fc217df4d
|
[codex] Split diffusion quant CI coverage (#24599)
Co-authored-by: Codex <codex@example.com>
|
2026-05-16 22:05:02 +08:00 |
|
|
Chi McIsaac
|
596b45b373
|
[diffusion] fix: change default qwen-image vae precision to bf16 (#25411)
|
2026-05-16 21:55:31 +08:00 |
|
|
Xiaoyu Zhang
|
93bacc25ed
|
[codex] Optimize LTX2 split rotary kernel (#24732)
|
2026-05-16 20:58:38 +08:00 |
|
|
ybyang
|
0f50ed86c9
|
fix(pd): fix kv pools without end_layer (#25476)
|
2026-05-16 19:49:26 +08:00 |
|
|
Qiaolin Yu
|
2f81718773
|
[attn backend] avoid initing parent class's workspace buffer (#25321)
|
2026-05-16 03:30:33 -07:00 |
|
|
Liangsheng Yin
|
aec4022e58
|
[Spec] Clean up draft-window-size handling; extract spec arg setup to arg_groups (#25424)
|
2026-05-16 03:23:48 -07:00 |
|
|
Liangsheng Yin
|
d1eb472a7a
|
fix(overlap): skip empty future interval for dp attention idle ranks (#25473)
|
2026-05-16 02:08:01 -07:00 |
|
|
Mick
|
7f37ffae9d
|
[diffusion] CI: fix nightly CI (#25241)
|
2026-05-16 16:55:30 +08:00 |
|
|
Yuhao Yang
|
b2c6db0cc4
|
[MoE] Decouple Mega MoE from DeepEP backend (#25406)
|
2026-05-16 00:18:43 -07:00 |
|
|
|
162540e0a8
|
feat: add Pipeline Parallelism (PP) and PD support for DeepSeek-V4 (#24704)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: xuyongfei <xuyongfei.xyf@antgroup.com>
|
2026-05-15 22:54:32 -07:00 |
|
|
JoeLee314andJoeLee314
|
bda01d2435
|
[Disagg] Fix MegaMoE topk_ids dtype mismatch and FakeKVManager missing kv_args (#25380)
Co-authored-by: JoeLee314 <liqichao@baidu.com>
|
2026-05-15 22:46:44 -07:00 |
|
|
Jimmy Shong
|
daade9cc00
|
[Fix] Probe speculative draft config via sglang get_config (#25428)
|
2026-05-15 22:01:44 -07:00 |
|
|
Mick
|
416fdbbb3d
|
[diffusion] feat: generalize layerwise offload residency mixin to all components (#24593)
|
2026-05-16 11:44:46 +08:00 |
|
|
Sam Shleifer
|
ce2506e1c6
|
Deprecate record_nolora_graph dual MoE CUDA graph capture (#24314)
|
2026-05-15 19:20:58 -07:00 |
|
|
fzyzcjy
|
688b679af2
|
Convert discarded-value ternary to a plain if statement (#25449)
|
2026-05-16 09:35:36 +08:00 |
|
|
Liangsheng Yin
|
b7d62bd724
|
[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420)
|
2026-05-15 18:26:55 -07:00 |
|
|
fzyzcjy
|
d0c38329b2
|
Inline the trivial _build_model_config wrapper (#25448)
|
2026-05-16 09:25:48 +08:00 |
|
|
fzyzcjy
|
4190328767
|
Replace defensive getattr in pool_configurator with direct access (#25447)
|
2026-05-16 09:25:14 +08:00 |
|
|
fzyzcjy
|
48f85d464f
|
Fix V2 trace filename collisions when DP/PP/EP enabled (#25446)
|
2026-05-16 09:24:39 +08:00 |
|
|
fzyzcjy
|
b3059e2d1e
|
Inject ParallelState into ProfilerV2 (#25445)
|
2026-05-16 09:24:15 +08:00 |
|
|
fzyzcjy
|
43797cc804
|
Bundle Scheduler rank/size fields into a frozen ParallelState (#25444)
|
2026-05-16 09:23:51 +08:00 |
|
|
fzyzcjy
|
fa8b7c9647
|
Lift forward_ct/cur_batch and use direct access in watchdog (#25442)
|
2026-05-16 09:22:41 +08:00 |
|
|
fzyzcjy
|
72eb231d28
|
Annotate dead max_running_requests_under_SLO (#25441)
|
2026-05-16 09:22:13 +08:00 |
|
|
fzyzcjy
|
c8e5cf5768
|
Fix LoRA pool not appearing in /v1/loads (#25440)
|
2026-05-16 09:21:27 +08:00 |
|