 Mick
|
43a9249e7c
|
CI: update CI_PERMISSIONS.json (#19744)
|
2026-03-02 22:34:41 -08:00 |
|
|
Mick
|
2e15c015c0
|
[diffusion] feat: Add --model-id for config resolution; deprecate model_detectors (#19607)
|
2026-03-02 16:39:53 +08:00 |
|
|
Mick
|
a75840b373
|
[diffusion] CI: create and refactor UT (#19619)
|
2026-03-01 19:38:20 +08:00 |
|
|
Mick
|
d098c8dab0
|
[diffusion] add .claude and update contributing with attitude towards vibe-pr (#19511)
|
2026-03-01 14:41:55 +08:00 |
|
|
Mick
|
471acd98b9
|
[diffusion] logging: improve logging (#19312)
|
2026-02-25 23:00:35 +08:00 |
|
|
Mick
|
9840cd3f68
|
[diffusion] chore: enable sequence shard for wan by default (#19311)
|
2026-02-25 18:21:44 +08:00 |
|
|
Mick
|
aff2f130ec
|
[diffusion] CI: fix pr-test workflow file to include changes in jit kernels (#19285)
|
2026-02-25 14:08:55 +08:00 |
|
|
Mick
|
241ee90164
|
[diffusion] chore: tiny fix pyproject.toml (#19256)
|
2026-02-25 11:57:53 +08:00 |
|
|
Mick
|
0ede5c54a8
|
[diffusion] logging: improve request and component load logs (#19253)
|
2026-02-25 09:32:36 +08:00 |
|
|
Mickandzyzshishui
|
2e053d6eb6
|
[diffusion] quant: support quant for all dits (#19156)
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
|
2026-02-24 14:20:54 +08:00 |
|
|
Mick
|
45095bac70
|
[diffusion] refactor: rename quantized model path server arg (#19142)
|
2026-02-22 23:18:35 +08:00 |
|
|
Mick
|
7d4860bc5e
|
[diffusion] CI: relax perf check threshold (#19154)
|
2026-02-22 20:02:12 +08:00 |
|
|
Mick
|
87823722b3
|
[diffusion] chore: minor cleanups (#19123)
|
2026-02-22 19:07:25 +08:00 |
|
|
Mick
|
6503f94211
|
[diffusion] feat: support passing component path via server args (#19108)
|
2026-02-21 21:22:47 +08:00 |
|
|
Mick
|
b89ca65789
|
[diffusion] refactor: reduce redundancy and improve stage api (#19060)
|
2026-02-21 16:35:47 +08:00 |
|
|
Mick
|
8d789b5c3d
|
[diffusion] feat: support nunchaku for Z-Image-Turbo and flux.1 (int4) (#18959)
|
2026-02-20 21:16:08 +08:00 |
|
|
Mick
|
38a69652e6
|
[diffusion] logging: log available mem when each stage starts in debug level (#18998)
|
2026-02-20 19:57:06 +08:00 |
|
|
Mick
|
3207427d6d
|
[diffusion] CI: enable warmup as default (#19010)
|
2026-02-19 23:27:23 +08:00 |
|
|
Mick
|
d73f06f091
|
[diffusion] chore: improve memory usage on consumer-level GPU (#18997)
|
2026-02-19 21:59:49 +08:00 |
|
|
Mick
|
420a611275
|
[diffusion] refactor: unify SamplingParams construction and improve DiffGenerator return types (#18928)
|
2026-02-18 14:56:58 +08:00 |
|
|
Mick
|
bfe34c90ff
|
Revert "[diffusion] operator: unify rotary embedding impl" (#18929)
|
2026-02-17 22:56:04 +08:00 |
|
|
Mick
|
de833f9e8e
|
Revert "[diffusion]: Improve layerwise offload buffer reuse and shared-storage handling" (#18866)
|
2026-02-16 18:00:58 +08:00 |
|
|
Mick
|
d0c94e136a
|
[diffusion] logging: improve peak vram logging (#18865)
|
2026-02-16 16:44:37 +08:00 |
|
|
Mick
|
0af9dcc407
|
[diffusion] refactor: refactor server_args adjust and validate logics (#18863)
|
2026-02-16 11:49:06 +08:00 |
|
|
Mick
|
78b4c9e248
|
[diffusion] fix: avoid saving output for warmup requests (#18867)
|
2026-02-16 11:48:28 +08:00 |
|
|
|
3feb48139e
|
[diffusion] quant: add support for svdquant and nunchaku (#18549)
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <53300651@qq.com>
|
2026-02-15 20:43:00 +08:00 |
|
|
Mick
|
37273408eb
|
[diffusion] chore: use batched P2P ops in VAE parallel decoding (#18728)
|
2026-02-13 22:11:20 +08:00 |
|
|
Mick
|
efdd676d56
|
[diffusion] refactor: merge redundant default_dtype and param_dtype parameters in FSDP loader (#18789)
|
2026-02-13 21:18:02 +08:00 |
|
|
Mick
|
efcdda0176
|
[diffusion] fix: fix fsdp (#18187)
|
2026-02-10 20:22:20 +08:00 |
|
|
Mick
|
4f7da5ad0f
|
[diffusion] chore: fix unclean shutdown and resource leaks (#18477)
|
2026-02-09 22:32:08 +08:00 |
|
|
Mick
|
6601bc24da
|
[diffusion] chore: revise process title (#18446)
|
2026-02-09 00:14:06 +08:00 |
|
|
Mick
|
a41aff1243
|
[diffusion] refactor: group component loaders under the component_loaders/ directory (#18438)
|
2026-02-08 23:02:27 +08:00 |
|
|
Mick
|
31d4cd2ffd
|
[diffusion] fix: respect dist_timeout option (#18386)
|
2026-02-07 20:56:04 +08:00 |
|
|
Mick
|
f218234e4f
|
[diffusion] chore: prohibit Chinese characters usage (#18249)
|
2026-02-05 09:22:26 +08:00 |
|
|
Mick
|
36a3e78af9
|
[diffusion] refactor: move model_stages into stages folder (#18248)
|
2026-02-05 00:23:31 +08:00 |
|
|
Mick
|
62004fd2be
|
[diffusion] UX: improve logging (#18122)
|
2026-02-03 10:35:05 +08:00 |
|
|
Mick
|
c84cd4b5ff
|
[diffusion] fix: fix missing component names for VAELoader (#18069)
|
2026-02-02 09:48:17 +08:00 |
|
|
Mick
|
977096ae03
|
[diffusion] cli: introduce generic attention backend configuration in ServerArgs (#18036)
|
2026-02-02 09:47:40 +08:00 |
|
|
Mick
|
1a006c2a0d
|
[diffusion] refactor: split component_loader into component-wise files (#17820)
|
2026-01-31 20:22:31 +08:00 |
|
|
Mick
|
2573a262af
|
[diffusion] doc: fix wrong docker run command (#17856)
|
2026-01-28 14:52:33 +08:00 |
|
|
Mick
|
88fcd8535f
|
[diffusion] feat: add an arg for controlling the number of prefetched layers in layerwise-offload (#17693)
|
2026-01-28 09:34:27 +08:00 |
|
|
Mick
|
1507dc6cdf
|
[diffusion] fix: fix suppressing error log on non-main ranks (#17712)
|
2026-01-28 09:29:19 +08:00 |
|
|
Mick
|
b105dad5da
|
[diffusion] refactor: remove useless lazy-import cache-dit codes (#17659)
|
2026-01-25 22:43:22 +08:00 |
|
|
MickandXiaoyu Zhang
|
51f147ada3
|
Update CODEOWNERS for multimodal_gen (#17308)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-01-19 08:39:20 +08:00 |
|
|
Mick
|
09491a9bcd
|
cli: support sglang version (#17250)
|
2026-01-18 13:20:24 +08:00 |
|
|
Mick
|
dc743fe4ba
|
[diffusion] chore: clean srt imports (#17252)
|
2026-01-17 15:47:49 +08:00 |
|
|
Mick
|
eb768189ee
|
[diffusion] doc: add instruction for adding performance baseline of new model (#17249)
|
2026-01-17 12:24:59 +08:00 |
|
|
Mick
|
16831ab6d7
|
[diffusion] fix: fix using upstream flash_attn on blackwell (#17111)
|
2026-01-15 22:30:48 +08:00 |
|
|
Mick
|
68e8d0f68d
|
[diffusion] CI: add testcase for cfg parallel (#17056)
|
2026-01-15 13:13:31 +08:00 |
|
|
Mick
|
a5348eac4c
|
[diffusion] chore: avoid raising error when output resolution is not optimal (#17030)
|
2026-01-14 11:36:27 +08:00 |
|
|
Mick
|
9524040220
|
[diffusion] chore: refactor warmup logic (#17027)
|
2026-01-14 11:35:06 +08:00 |
|
|
Mick
|
7a869045b6
|
[diffusion] chore: clean excessive document (#16986)
|
2026-01-13 21:33:50 +08:00 |
|
|
Mick
|
47d485f35f
|
[diffusion] fix: fix not respecting dit_layerwise_offload server arg (#16252)
|
2026-01-13 09:29:07 +08:00 |
|
|
Mick
|
2b42309955
|
[diffusion] UX: provide solutions for OOM (#16940)
|
2026-01-13 09:25:27 +08:00 |
|
|
Mick
|
badcd02896
|
[diffusion] chore: automatically enable dit_layerwise_offload for Wan (#16499)
|
2026-01-07 10:22:08 +08:00 |
|
|
Mick
|
ca922d4b05
|
[diffusion] feat: support warmup with resolutions (#16434)
|
2026-01-06 10:32:18 +08:00 |
|
|
Mick
|
9a8ba3c189
|
[diffusion] feat: support warmup with resolutions (#16330)
|
2026-01-05 10:16:26 +08:00 |
|
|
Mick
|
2c09de343e
|
[diffusion] improve: skip loading vision module for text encoders (#16304)
|
2026-01-03 19:30:45 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
38d48de93d
|
[diffusion] CI: simplify warmup (#16303)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-03 18:09:38 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
f26f6c2c99
|
[diffusion] fix: make lora compatible with layerwise-offload (#16298)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-02 22:33:26 +08:00 |
|
|
Mick
|
5062537b67
|
[diffusion] feat: support lightweight e2e warmup for benchmarking (#16213)
|
2026-01-02 20:10:27 +08:00 |
|
|
Mick
|
21de3e1406
|
[diffusion] webui: tiny fix loading output image (#16251)
|
2026-01-01 14:34:49 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
5bf0d862dd
|
[diffusion] CI: fix generate mode and add cli test (#16174)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-31 09:51:48 +08:00 |
|
|
Mick
|
3449806727
|
[diffusion] feat: generalize layer-wise-offload to all supported models (#16150)
|
2025-12-30 22:06:57 +08:00 |
|
|
Mick
|
1e45320198
|
[diffusion] improve: tiny improve layerwise offload manager by consolidating weights per layer (#16081)
|
2025-12-30 11:31:00 +08:00 |
|
|
Mick
|
26e17f9076
|
[diffusion] improve: tiny speedup qwen-image-edit-2511 by avoiding unnecessary calculation (#15896)
|
2025-12-30 10:10:32 +08:00 |
|
|
MickandXiaoyu Zhang
|
8e08207c18
|
[diffusion] fix: fix serving with dit-layerwise-offload enabled (#16066)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-12-30 00:21:42 +08:00 |
|
|
Mick
|
b5d9fc873b
|
[diffusion] chore: minor refactor by streamlining the VAE class hierarchy (#16069)
|
2025-12-29 23:37:59 +08:00 |
|
|
Mick
|
d7a3336ebe
|
[diffusion] fix: fix stages not logged when perf_dump_path is provided (#16016)
|
2025-12-28 23:17:43 +08:00 |
|
|
Mick
|
9f8e23071a
|
[diffusion] chore: fix default offload setting for image generation model (#15928)
|
2025-12-28 20:45:33 +08:00 |
|
|
Mick
|
3881bc8d0b
|
[diffusion] CI: relax threshold by supporting different profiles (#16002)
|
2025-12-28 20:05:07 +08:00 |
|
|
Mick
|
b4a00ed2d9
|
[diffusion] chore: clean ComposedPipelineBase (#15937)
|
2025-12-28 11:43:25 +08:00 |
|
|
Mick
|
39d56196a0
|
[diffusion] logging: log available gpu mem while loading and generating (#15936)
|
2025-12-28 00:34:58 +08:00 |
|
|
Mick
|
aa89c6a7e2
|
[diffusion] refactor: unify model loading and offloading behavior (#15923)
|
2025-12-27 16:18:24 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
b70914969b
|
[diffusion] CI: support returning request id from endpoint (#15844)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-26 23:38:03 +08:00 |
|
|
Mick
|
8dc6f0fc4d
|
[diffusion] refactor: centralize hardware platform detection and streamline environment variable management (#15842)
|
2025-12-26 22:16:18 +08:00 |
|
|
Mick
|
a355911909
|
[diffusion] improve: improve post-processing by moving compute-intensive tasks to GPU (#15822)
|
2025-12-26 01:29:04 +08:00 |
|
|
Mick
|
2a8a785634
|
[diffusion] log: avoid logging in hot path if unnecessary (#15818)
|
2025-12-25 18:42:52 +08:00 |
|
|
Mick
|
2c5679f314
|
[diffusion] refactor: unify the profiling api for all executors (#15718)
|
2025-12-24 23:26:09 +08:00 |
|
|
Mick
|
dfb5357448
|
[diffusion] http-server: relax openai image endpoint's strict content_type limit (#15717)
|
2025-12-24 13:26:13 +08:00 |
|
|
Mick
|
1ed946680a
|
[diffusion] bench: improve bench_serving by adding more controlling args (#15554)
|
2025-12-21 13:37:45 +08:00 |
|
|
Mick
|
d7fbe73bf2
|
[diffusion] chore: minor improvements and typo-fixing (#15556)
|
2025-12-21 13:37:10 +08:00 |
|
|
Mick
|
bc18cb8631
|
[diffusion] refactor: change zmq socket type to router for scheduler (#15479)
|
2025-12-21 00:39:54 +08:00 |
|
|
Mick
|
41bd76e18b
|
[diffusion] log: fix wrong use of suppress_other_loggers (#15534)
|
2025-12-20 23:43:55 +08:00 |
|
|
Mick
|
c6ca1b3afc
|
[diffusion] chore: allow all attention backends if not specified (#15530)
|
2025-12-20 23:14:55 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
c0f9b51992
|
[diffusion] refactor: deprecate workloadtype (#15267)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-20 11:24:31 +08:00 |
|
|
Mick
|
ff1e2ce24d
|
[diffusion] fix: fix wrong validation on 2k resolution (#15478)
|
2025-12-19 21:28:45 +08:00 |
|
|
Mick
|
a0985dd5e5
|
[diffusion] profiling: add bench_serving.py and VBench (#15410)
|
2025-12-19 10:57:39 +08:00 |
|
|
Mick
|
f95729b06f
|
[diffusion] doc: update profiling.md (#15270)
|
2025-12-16 23:48:32 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
1dedb63860
|
[diffusion] chore: minor code cleanups (#15190)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-15 23:57:02 +08:00 |
|
|
MickandBrain97
|
b098b1ae24
|
[diffusion] fix: fix video model sp when resolution is not specified (#15047)
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
|
2025-12-15 20:25:43 +08:00 |
|
|
Mick
|
c20d43d2e6
|
[diffusion] doc: update profiling.md with output location details (#15072)
|
2025-12-13 23:15:23 +08:00 |
|
|
Mick
|
875f84db7b
|
[diffusion] fix: use NDRotaryEmbedding in flux_2 (#15034)
|
2025-12-13 13:42:38 +08:00 |
|
|
Mick
|
c7c837cd1d
|
Update CODEOWNERS for multimodal_gen (#14995)
|
2025-12-12 22:08:16 +08:00 |
|
|
Mick
|
82e33170e1
|
[diffusion] chore: minor code cleanups and improve logging (#14916)
|
2025-12-12 18:48:07 +08:00 |
|
|
Mick
|
ca1144212a
|
[diffusion] UX: suppress excessive loggers (#14900)
|
2025-12-11 22:10:22 +08:00 |
|
|
Mick
|
5d804a3767
|
[diffusion] feat: support sageattn & sageattn3 backend (#14878)
|
2025-12-11 20:59:44 +08:00 |
|
|
Mick
|
d659873762
|
[diffusion] CI: use unified sampling_params for CI (#14045)
|
2025-12-11 01:18:56 +08:00 |
|
|
Mick
|
6c5ebc0ef7
|
[diffusion] parallel: pad tokens for video models under sp (#14833)
|
2025-12-11 01:15:37 +08:00 |
|
|
Mick
|
87dbdddc93
|
[diffusion] profile: early exit when enough steps are captured to reduce the size of the trace file (#14803)
|
2025-12-10 16:11:22 +08:00 |
|