Commit Graph
12204 Commits
Author SHA1 Message Date
ebbaab5597 [NPU] Add GitHub test summary and deduplicate test code. Part 1 (#23835)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-05-02 14:18:18 +03:00
3259a2c789 Encode routed_experts in the detokenizer, off the tokenizer hot path (#24263)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Yueming Yuan <yym022502@gmail.com>
2026-05-02 02:44:32 -07:00
Xiaoyu Zhang 589f90b368 [diffusion] chore: use lmsys as org for modelopt checkpoints (#23924) 2026-05-02 17:18:58 +08:00
Alison Shao f3dbadb82b fix: accept 0-indexed safetensors shard names in CI weight validator (#24237) 2026-05-02 00:58:15 -07:00
Kangyan-ZhouandClaude Opus 4.7 2e72a36420 [CI] Restore SMG e2e on 2-gpu-h100 / 4-gpu-h100 runners (#24222)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 23:55:20 -07:00
billishyahao b939d5410f [AMD] enable sdma for moriep unittest (#24259) 2026-05-01 23:34:53 -07:00
Clayandchengyusong1 5ec3b26799 [diffusion] model: support JoyAI-Image-Edit (#22625)
Co-authored-by: chengyusong1 <chengyusong1@jd.com>
2026-05-02 14:08:57 +08:00
Kangyan-ZhouandClaude Opus 4.7 cd27baaffd [ci][cu13] Bump torch_memory_saver to 0.0.9.post1; restore manual tests (#23182)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 22:50:38 -07:00
Kangyan-ZhouandClaude Opus 4.7 674a80d5d8 [CI] Add 1-gpu-h100-h200 to rerun-test runner_label choices (#24264)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 22:45:48 -07:00
Mick b7d4647568 [diffusion] CI: change ground truth repo (#24219) 2026-05-01 21:25:40 -07:00
Sam Shleifer 63f225ca2e [session] fix mamba pool leak in StreamingSession.release_session + plumb idle leak check (#23496) 2026-05-02 11:38:08 +08:00
d41e8c459d Support RunAI loading for quantized checkpoints (#23850)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Sam Shleifer <sam@thinkingmachines.ai>
2026-05-02 11:11:40 +08:00
Xiaoyu Zhang 321298da75 [SKILL] Upgrade sglang profile and auto_benchmark skills (#24250) 2026-05-02 10:12:47 +08:00
Johnsonms 4c2ed9a254 Flux2 nvfp4 quantization correctness on Blackwell (B200) (#23625) 2026-05-02 09:57:35 +08:00
Aurick Qiao bfccc8e504 Allow configuring NIXL backend parameters from env (#24169) 2026-05-01 18:30:43 -07:00
Mick 193b977572 [diffusion] chore: clean scheduler (#24229) 2026-05-02 09:30:06 +08:00
Liangsheng Yin cb8fbd53fc Reserve slot 0 as padding in all req pools (#24243) 2026-05-01 16:41:36 -07:00
Cheng Wan b47fab6f5d [bugfix] Support MIXED forward mode in TBO splitter for DP attention (#24241) 2026-05-01 16:01:23 -07:00
Lucia Fang 05de73efd1 [core/model] Use explicit model arch for Llama4 attention backend auto-selection (#24232) 2026-05-01 15:49:30 -07:00
Liangsheng Yin 8a530468fd [Bug] Size mamba mappings from req pool, not mamba pool (#24244) 2026-05-01 15:45:20 -07:00
Yuxuan Zhang 79bc2505a5 [Bug Fix] Resolve EAGLE cuda graph IMA under PD + DP + MTP with GLM-5.1 (#23037) 2026-05-01 13:53:52 -07:00
Lucia Fang b58fa60a1f [core/attention] Add SGLANG_FLASHINFER_USE_PAGED env to force paged wrapper (#24165) 2026-05-01 12:52:46 -07:00
Lianmin Zheng c7566a860b Add CI permissions for user luccafong, 842974287 (#24238) 2026-05-01 12:50:36 -07:00
Lianmin Zheng ece8a1a788 Refactor device timer, clean up metrics collector, and add fwd occupancy metric (#24197) 2026-05-01 10:25:25 -07:00
4a50cd781e [BugFix][HiMamba] Fix host-protected node deletion in HiMamba tombstone del (#23696)
Co-authored-by: diemchai <diemchai@tencent.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-05-01 21:57:47 +08:00
ishandhanani 5b7ce417d0 [P/D disagg] - support decode side radix cache (#19746) 2026-05-01 21:55:34 +08:00
Qiaolin Yu 4197c55968 [spec decoding] add tests for chain-style multi layer eagle + return_logprob (#24192) 2026-05-01 01:48:48 -07:00
HAI 7e17a7a1e8 Upd: AITER->(#2879)a6bb499 (#24218) 2026-05-01 01:26:08 -07:00
Cheng Wan d48095ba53 Bypass torch.cuda.use_mem_pool generator-CM in SymmetricMemoryContext (#24190) 2026-05-01 01:25:49 -07:00
d9e8a4a7f8 [SWA] Ensure we use pre-computed SWA cache location during prefill (#24138)
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Yinghai Lu <yinghai@meta.com>
2026-05-01 00:01:49 -07:00
Clint 87dad74b33 Add benchmark/hicache/bench_warm_cache.py for exact warm-cache shared-prefix benchmarking (#24083) 2026-04-30 23:48:32 -07:00
billishyahao a578bf814c [AMD] fix moriep unittest failure (#24205) 2026-04-30 23:36:20 -07:00
Mick 6fa499cd6d [diffusion] CI: remove parametrized-only from diffusion PR test (#24202) 2026-05-01 14:15:22 +08:00
Yanbin Jiang 8975479f87 [LoRA][MOE] Fix EP correctness in MoE LoRA slicing and virtual-experts kernels (#24171) 2026-04-30 22:42:10 -07:00
Baizhou ZhangandClaude Opus 4.7 7bc7775260 [CI] Fix stage-b-test-4-gpu-b200 silently skipped, hanging wait-for-stage-b (#24208)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-30 22:29:08 -07:00
Alison Shao 357e3789ea ci: limit nightly test parallelism to 1 job per hardware type (#23314) 2026-04-30 21:49:18 -07:00
AlecandKangyan-Zhou 9d95783603 Add Docker image provenance metadata (#24090)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-04-30 21:40:42 -07:00
Mick 9d84268705 [diffusion] refactor: introduce component residency manager (#23771) 2026-05-01 11:10:41 +08:00
Cheng WanandClaude Opus 4.7 108bfd8b6a [MoE] Add Aiter MoE runner backend and purge aiter.fused_moe from quant methods (#23597)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-30 19:50:52 -07:00
Yihao Wang 0acc569edd [Bench] extend MMMU answer extractor with explicit-commit patterns (#24084) 2026-04-30 19:08:08 -07:00
Baizhou ZhangandClaude Opus 4.7 1742bfb610 [CI] release-whl-kernel: skip musa wheels in update_kernel_whl_index (#24191)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-30 17:17:50 -07:00
Kangyan-ZhouandClaude Opus 4.7 cf346bb15d [CI] Skip worker-dependent SMG e2e tests pending runner-image debug (#24166)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-30 16:45:10 -07:00
Baizhou Zhang 5f88c8593a [Misc] Redirect default sglang nightly wheel to cuda 130 (#24183) 2026-04-30 16:32:50 -07:00
Yilong Zhao f67292539f spec: gate dp mlp sync with server args (#24177) 2026-04-30 16:29:41 -07:00
da7f890788 [Intel GPU] Integrate flash_mla_decode in Intel XPU attention backend (#23557)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-01 07:21:28 +08:00
e35ac95cdc [Test] Add XPU device support to unit tests (#22236)
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-01 07:18:51 +08:00
zijiexia 8b23d32ec1 feat: implement workflow to sync LMSYS SGLang blog (#23438) 2026-04-30 16:17:29 -07:00
Alison Shao 918f910cf0 ci: temporarily disable multimodal-gen-test-1-b200 (#24174) 2026-04-30 16:16:43 -07:00
9c5cad3914 Use device-agnostic helpers for Mamba tests and core ops (#20234)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-01 07:14:53 +08:00
Kalyan KumarandMa Mingfei 8a9e424faa Replace hardcoded CUDA device with get_device() for XPU support (#13599)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-01 07:13:46 +08:00