Commit Graph
100 Commits
Author SHA1 Message Date
Mick 62004fd2be [diffusion] UX: improve logging (#18122) 2026-02-03 10:35:05 +08:00
Mick c84cd4b5ff [diffusion] fix: fix missing component names for VAELoader (#18069) 2026-02-02 09:48:17 +08:00
Mick 977096ae03 [diffusion] cli: introduce generic attention backend configuration in ServerArgs (#18036) 2026-02-02 09:47:40 +08:00
Mick 1a006c2a0d [diffusion] refactor: split component_loader into component-wise files (#17820) 2026-01-31 20:22:31 +08:00
Mick 2573a262af [diffusion] doc: fix wrong docker run command (#17856) 2026-01-28 14:52:33 +08:00
Mick 88fcd8535f [diffusion] feat: add an arg for controlling the number of prefetched layers in layerwise-offload (#17693) 2026-01-28 09:34:27 +08:00
Mick 1507dc6cdf [diffusion] fix: fix suppressing error log on non-main ranks (#17712) 2026-01-28 09:29:19 +08:00
Mick b105dad5da [diffusion] refactor: remove useless lazy-import cache-dit codes (#17659) 2026-01-25 22:43:22 +08:00
MickandXiaoyu Zhang 51f147ada3 Update CODEOWNERS for multimodal_gen (#17308)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-01-19 08:39:20 +08:00
Mick 09491a9bcd cli: support sglang version (#17250) 2026-01-18 13:20:24 +08:00
Mick dc743fe4ba [diffusion] chore: clean srt imports (#17252) 2026-01-17 15:47:49 +08:00
Mick eb768189ee [diffusion] doc: add instruction for adding performance baseline of new model (#17249) 2026-01-17 12:24:59 +08:00
Mick 16831ab6d7 [diffusion] fix: fix using upstream flash_attn on blackwell (#17111) 2026-01-15 22:30:48 +08:00
Mick 68e8d0f68d [diffusion] CI: add testcase for cfg parallel (#17056) 2026-01-15 13:13:31 +08:00
Mick a5348eac4c [diffusion] chore: avoid raising error when output resolution is not optimal (#17030) 2026-01-14 11:36:27 +08:00
Mick 9524040220 [diffusion] chore: refactor warmup logic (#17027) 2026-01-14 11:35:06 +08:00
Mick 7a869045b6 [diffusion] chore: clean excessive document (#16986) 2026-01-13 21:33:50 +08:00
Mick 47d485f35f [diffusion] fix: fix not respecting dit_layerwise_offload server arg (#16252) 2026-01-13 09:29:07 +08:00
Mick 2b42309955 [diffusion] UX: provide solutions for OOM (#16940) 2026-01-13 09:25:27 +08:00
Mick badcd02896 [diffusion] chore: automatically enable dit_layerwise_offload for Wan (#16499) 2026-01-07 10:22:08 +08:00
Mick ca922d4b05 [diffusion] feat: support warmup with resolutions (#16434) 2026-01-06 10:32:18 +08:00
Mick 9a8ba3c189 [diffusion] feat: support warmup with resolutions (#16330) 2026-01-05 10:16:26 +08:00
Mick 2c09de343e [diffusion] improve: skip loading vision module for text encoders (#16304) 2026-01-03 19:30:45 +08:00
Mickandgemini-code-assist[bot] 38d48de93d [diffusion] CI: simplify warmup (#16303)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-03 18:09:38 +08:00
Mickandgemini-code-assist[bot] f26f6c2c99 [diffusion] fix: make lora compatible with layerwise-offload (#16298)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-02 22:33:26 +08:00
Mick 5062537b67 [diffusion] feat: support lightweight e2e warmup for benchmarking (#16213) 2026-01-02 20:10:27 +08:00
Mick 21de3e1406 [diffusion] webui: tiny fix loading output image (#16251) 2026-01-01 14:34:49 +08:00
Mickandgemini-code-assist[bot] 5bf0d862dd [diffusion] CI: fix generate mode and add cli test (#16174)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-31 09:51:48 +08:00
Mick 3449806727 [diffusion] feat: generalize layer-wise-offload to all supported models (#16150) 2025-12-30 22:06:57 +08:00
Mick 1e45320198 [diffusion] improve: tiny improve layerwise offload manager by consolidating weights per layer (#16081) 2025-12-30 11:31:00 +08:00
Mick 26e17f9076 [diffusion] improve: tiny speedup qwen-image-edit-2511 by avoiding unnecessary calculation (#15896) 2025-12-30 10:10:32 +08:00
MickandXiaoyu Zhang 8e08207c18 [diffusion] fix: fix serving with dit-layerwise-offload enabled (#16066)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2025-12-30 00:21:42 +08:00
Mick b5d9fc873b [diffusion] chore: minor refactor by streamlining the VAE class hierarchy (#16069) 2025-12-29 23:37:59 +08:00
Mick d7a3336ebe [diffusion] fix: fix stages not logged when perf_dump_path is provided (#16016) 2025-12-28 23:17:43 +08:00
Mick 9f8e23071a [diffusion] chore: fix default offload setting for image generation model (#15928) 2025-12-28 20:45:33 +08:00
Mick 3881bc8d0b [diffusion] CI: relax threshold by supporting different profiles (#16002) 2025-12-28 20:05:07 +08:00
Mick b4a00ed2d9 [diffusion] chore: clean ComposedPipelineBase (#15937) 2025-12-28 11:43:25 +08:00
Mick 39d56196a0 [diffusion] logging: log available gpu mem while loading and generating (#15936) 2025-12-28 00:34:58 +08:00
Mick aa89c6a7e2 [diffusion] refactor: unify model loading and offloading behavior (#15923) 2025-12-27 16:18:24 +08:00
Mickandgemini-code-assist[bot] b70914969b [diffusion] CI: support returning request id from endpoint (#15844)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-26 23:38:03 +08:00
Mick 8dc6f0fc4d [diffusion] refactor: centralize hardware platform detection and streamline environment variable management (#15842) 2025-12-26 22:16:18 +08:00
Mick a355911909 [diffusion] improve: improve post-processing by moving compute-intensive tasks to GPU (#15822) 2025-12-26 01:29:04 +08:00
Mick 2a8a785634 [diffusion] log: avoid logging in hot path if unnecessary (#15818) 2025-12-25 18:42:52 +08:00
Mick 2c5679f314 [diffusion] refactor: unify the profiling api for all executors (#15718) 2025-12-24 23:26:09 +08:00
Mick dfb5357448 [diffusion] http-server: relax openai image endpoint's strict content_type limit (#15717) 2025-12-24 13:26:13 +08:00
Mick 1ed946680a [diffusion] bench: improve bench_serving by adding more controlling args (#15554) 2025-12-21 13:37:45 +08:00
Mick d7fbe73bf2 [diffusion] chore: minor improvements and typo-fixing (#15556) 2025-12-21 13:37:10 +08:00
Mick bc18cb8631 [diffusion] refactor: change zmq socket type to router for scheduler (#15479) 2025-12-21 00:39:54 +08:00
Mick 41bd76e18b [diffusion] log: fix wrong use of suppress_other_loggers (#15534) 2025-12-20 23:43:55 +08:00
Mick c6ca1b3afc [diffusion] chore: allow all attention backends if not specified (#15530) 2025-12-20 23:14:55 +08:00
Mickandgemini-code-assist[bot] c0f9b51992 [diffusion] refactor: deprecate workloadtype (#15267)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-20 11:24:31 +08:00
Mick ff1e2ce24d [diffusion] fix: fix wrong validation on 2k resolution (#15478) 2025-12-19 21:28:45 +08:00
Mick a0985dd5e5 [diffusion] profiling: add bench_serving.py and VBench (#15410) 2025-12-19 10:57:39 +08:00
Mick f95729b06f [diffusion] doc: update profiling.md (#15270) 2025-12-16 23:48:32 +08:00
Mickandgemini-code-assist[bot] 1dedb63860 [diffusion] chore: minor code cleanups (#15190)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-15 23:57:02 +08:00
MickandBrain97 b098b1ae24 [diffusion] fix: fix video model sp when resolution is not specified (#15047)
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
2025-12-15 20:25:43 +08:00
Mick c20d43d2e6 [diffusion] doc: update profiling.md with output location details (#15072) 2025-12-13 23:15:23 +08:00
Mick 875f84db7b [diffusion] fix: use NDRotaryEmbedding in flux_2 (#15034) 2025-12-13 13:42:38 +08:00
Mick c7c837cd1d Update CODEOWNERS for multimodal_gen (#14995) 2025-12-12 22:08:16 +08:00
Mick 82e33170e1 [diffusion] chore: minor code cleanups and improve logging (#14916) 2025-12-12 18:48:07 +08:00
Mick ca1144212a [diffusion] UX: suppress excessive loggers (#14900) 2025-12-11 22:10:22 +08:00
Mick 5d804a3767 [diffusion] feat: support sageattn & sageattn3 backend (#14878) 2025-12-11 20:59:44 +08:00
Mick d659873762 [diffusion] CI: use unified sampling_params for CI (#14045) 2025-12-11 01:18:56 +08:00
Mick 6c5ebc0ef7 [diffusion] parallel: pad tokens for video models under sp (#14833) 2025-12-11 01:15:37 +08:00
Mick 87dbdddc93 [diffusion] profile: early exit when enough steps are captured to reduce the size of the trace file (#14803) 2025-12-10 16:11:22 +08:00
Mick 8810152e88 vlm: Use fa3 as the default backend for qwen3 vl (#14634) 2025-12-08 12:56:20 -08:00
Mickandgemini-code-assist[bot] 80cfca50bc [diffusion] chore: further refine output resolution adjustment logic (#14558)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-08 19:08:38 +08:00
Mick 35a9a07370 [diffusion] refactor: simplify sampling params' override logic (#14539) 2025-12-06 20:23:49 +08:00
Mick d881f31488 [diffusion] chore: temporarily upgrade diffusers to make Z-image compatible with Cache-DiT (#14530) 2025-12-06 12:39:37 +08:00
Mick a89045603b [diffusion] chore: set allowing overriding protected fields of sampling params as default behavior (#14471) 2025-12-06 00:22:42 +08:00
Mick beec8eed6a [diffusion] chore: further improve model searching logic (#14484) 2025-12-05 15:04:55 +08:00
Mick 84e0abb7b1 Update CODEOWNERS for multimodal (#14329) 2025-12-03 11:04:40 +08:00
Mick 9530b76630 [diffusion] refactor: simplify DmdDenoisingStage (#14269) 2025-12-02 18:59:40 +08:00
Mick 9c9d7091cb Update CODEOWNERS for multimodal_gen (#14286) 2025-12-02 16:15:19 +08:00
Mick 1f930cd23d [diffusion] CI: add testcase-wise retry mechanism (#14261) 2025-12-02 11:06:12 +08:00
Mickandgemini-code-assist[bot] 3ab8ae6847 [diffusion] fix: fix Flux.2 condition image resize (#14232)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-02 10:05:44 +08:00
Mickandgemini-code-assist[bot] 7ce8faae28 [diffusion] refactor: remove hard-code of instanceof on PipelineConfig (#14186)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-01 16:35:34 +08:00
Mick c6a52f4411 [diffusion] chore: add resolution shortcuts for sampling params (#14129) 2025-11-29 18:00:21 +08:00
Mick 0a362d653f [diffusion] log: unify generation performance logging (#14117) 2025-11-29 12:21:59 +08:00
Mick 0e8ce1e832 [diffusion] refactor: clean useless files (#14094) 2025-11-28 18:14:00 +08:00
Mick 951028968c [diffusion] refactor: refactor ComponentLoader and support loading native models from diffusers and transformers (#13205) 2025-11-28 14:17:32 +08:00
Mick 3543a04a48 [diffusion] refactor: refactor condition image resize logic (#14079) 2025-11-28 14:06:34 +08:00
Mick 6edffc6391 [diffusion] perf: improve black-forest-labs/FLUX.2-dev (#14040) 2025-11-27 14:49:52 +08:00
Mick 5102d00901 [diffusion] model: support black-forest-labs/FLUX.2-dev (#14000) 2025-11-27 01:49:40 +08:00
Mick dfd7ab9682 [diffusion] feat: support LoRA (#13859) 2025-11-26 00:21:33 +08:00
Mick 46673b4224 [diffusion] doc: add doc for LoRA usage (#13931) 2025-11-26 00:02:14 +08:00
Mick 6f094deff0 [diffusion] CI: minor refactor CI for less code duplication (#13905) 2025-11-25 18:44:11 +08:00
Mick 9384fa2729 [diffusion] refactor: remove training-related code (#13860) 2025-11-25 11:38:50 +08:00
Mickandgemini-code-assist[bot] 414248e0d0 [diffusion] doc: minor update contributing.md with test section (#13792)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-24 13:00:08 +08:00
Mick dd70cf99c1 [diffusion] CI: add run_suite to multimodal_gen CI (#13791) 2025-11-23 21:27:33 +08:00
Mick d4593964fe [diffusion] feat: support sp for image models (#13180) 2025-11-23 18:11:42 +08:00
Mick ca548d8324 [diffusion] refactor: refactor sampling params (#13706) 2025-11-22 22:43:04 +08:00
Mick aa6e2c8aa0 [diffusion] log: minor improve logging (#13735) 2025-11-21 23:01:23 +08:00
Mick 323fed5cfd [diffusion] doc: add contributing.md (#13649) 2025-11-21 19:00:27 +08:00
Mick 5e7f91d451 [diffusion] profile: support performance metric dumping and comparison (#13630) 2025-11-21 18:47:16 +08:00
Mick eda2f70033 [diffusion] doc: minor update docs (#13177) 2025-11-21 14:35:29 +08:00
Mick c0a2513b07 [diffusion] CI: improve validation method (#13627) 2025-11-21 09:13:13 +08:00
Mick 4a8442af1b diffusion: improve baseline performance monitor (#13614) 2025-11-20 14:29:56 +08:00
Mick bc42c8c415 [diffusion] refactor: refactor pipeline folders (#13253) 2025-11-20 12:56:51 +08:00
Mick 2e3a69ae05 [diffusion] refactor: remove PreprocessorConfig (#13248) 2025-11-20 12:53:26 +08:00