 Mick
|
f95729b06f
|
[diffusion] doc: update profiling.md (#15270)
|
2025-12-16 23:48:32 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
1dedb63860
|
[diffusion] chore: minor code cleanups (#15190)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-15 23:57:02 +08:00 |
|
|
MickandBrain97
|
b098b1ae24
|
[diffusion] fix: fix video model sp when resolution is not specified (#15047)
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
|
2025-12-15 20:25:43 +08:00 |
|
|
Mick
|
c20d43d2e6
|
[diffusion] doc: update profiling.md with output location details (#15072)
|
2025-12-13 23:15:23 +08:00 |
|
|
Mick
|
875f84db7b
|
[diffusion] fix: use NDRotaryEmbedding in flux_2 (#15034)
|
2025-12-13 13:42:38 +08:00 |
|
|
Mick
|
c7c837cd1d
|
Update CODEOWNERS for multimodal_gen (#14995)
|
2025-12-12 22:08:16 +08:00 |
|
|
Mick
|
82e33170e1
|
[diffusion] chore: minor code cleanups and improve logging (#14916)
|
2025-12-12 18:48:07 +08:00 |
|
|
Mick
|
ca1144212a
|
[diffusion] UX: suppress excessive loggers (#14900)
|
2025-12-11 22:10:22 +08:00 |
|
|
Mick
|
5d804a3767
|
[diffusion] feat: support sageattn & sageattn3 backend (#14878)
|
2025-12-11 20:59:44 +08:00 |
|
|
Mick
|
d659873762
|
[diffusion] CI: use unified sampling_params for CI (#14045)
|
2025-12-11 01:18:56 +08:00 |
|
|
Mick
|
6c5ebc0ef7
|
[diffusion] parallel: pad tokens for video models under sp (#14833)
|
2025-12-11 01:15:37 +08:00 |
|
|
Mick
|
87dbdddc93
|
[diffusion] profile: early exit when enough steps are captured to reduce the size of the trace file (#14803)
|
2025-12-10 16:11:22 +08:00 |
|
|
Mick
|
8810152e88
|
vlm: Use fa3 as the default backend for qwen3 vl (#14634)
|
2025-12-08 12:56:20 -08:00 |
|
|
Mickandgemini-code-assist[bot]
|
80cfca50bc
|
[diffusion] chore: further refine output resolution adjustment logic (#14558)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-08 19:08:38 +08:00 |
|
|
Mick
|
35a9a07370
|
[diffusion] refactor: simplify sampling params' override logic (#14539)
|
2025-12-06 20:23:49 +08:00 |
|
|
Mick
|
d881f31488
|
[diffusion] chore: temporarily upgrade diffusers to make Z-image compatible with Cache-DiT (#14530)
|
2025-12-06 12:39:37 +08:00 |
|
|
Mick
|
a89045603b
|
[diffusion] chore: set allowing overriding protected fields of sampling params as default behavior (#14471)
|
2025-12-06 00:22:42 +08:00 |
|
|
Mick
|
beec8eed6a
|
[diffusion] chore: further improve model searching logic (#14484)
|
2025-12-05 15:04:55 +08:00 |
|
|
Mick
|
84e0abb7b1
|
Update CODEOWNERS for multimodal (#14329)
|
2025-12-03 11:04:40 +08:00 |
|
|
Mick
|
9530b76630
|
[diffusion] refactor: simplify DmdDenoisingStage (#14269)
|
2025-12-02 18:59:40 +08:00 |
|
|
Mick
|
9c9d7091cb
|
Update CODEOWNERS for multimodal_gen (#14286)
|
2025-12-02 16:15:19 +08:00 |
|
|
Mick
|
1f930cd23d
|
[diffusion] CI: add testcase-wise retry mechanism (#14261)
|
2025-12-02 11:06:12 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
3ab8ae6847
|
[diffusion] fix: fix Flux.2 condition image resize (#14232)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-02 10:05:44 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
7ce8faae28
|
[diffusion] refactor: remove hard-code of instanceof on PipelineConfig (#14186)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-01 16:35:34 +08:00 |
|
|
Mick
|
c6a52f4411
|
[diffusion] chore: add resolution shortcuts for sampling params (#14129)
|
2025-11-29 18:00:21 +08:00 |
|
|
Mick
|
0a362d653f
|
[diffusion] log: unify generation performance logging (#14117)
|
2025-11-29 12:21:59 +08:00 |
|
|
Mick
|
0e8ce1e832
|
[diffusion] refactor: clean useless files (#14094)
|
2025-11-28 18:14:00 +08:00 |
|
|
Mick
|
951028968c
|
[diffusion] refactor: refactor ComponentLoader and support loading native models from diffusers and transformers (#13205)
|
2025-11-28 14:17:32 +08:00 |
|
|
Mick
|
3543a04a48
|
[diffusion] refactor: refactor condition image resize logic (#14079)
|
2025-11-28 14:06:34 +08:00 |
|
|
Mick
|
6edffc6391
|
[diffusion] perf: improve black-forest-labs/FLUX.2-dev (#14040)
|
2025-11-27 14:49:52 +08:00 |
|
|
Mick
|
5102d00901
|
[diffusion] model: support black-forest-labs/FLUX.2-dev (#14000)
|
2025-11-27 01:49:40 +08:00 |
|
|
Mick
|
dfd7ab9682
|
[diffusion] feat: support LoRA (#13859)
|
2025-11-26 00:21:33 +08:00 |
|
|
Mick
|
46673b4224
|
[diffusion] doc: add doc for LoRA usage (#13931)
|
2025-11-26 00:02:14 +08:00 |
|
|
Mick
|
6f094deff0
|
[diffusion] CI: minor refactor CI for less code duplication (#13905)
|
2025-11-25 18:44:11 +08:00 |
|
|
Mick
|
9384fa2729
|
[diffusion] refactor: remove training-related code (#13860)
|
2025-11-25 11:38:50 +08:00 |
|
|
Mickandgemini-code-assist[bot]
|
414248e0d0
|
[diffusion] doc: minor update contributing.md with test section (#13792)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-11-24 13:00:08 +08:00 |
|
|
Mick
|
dd70cf99c1
|
[diffusion] CI: add run_suite to multimodal_gen CI (#13791)
|
2025-11-23 21:27:33 +08:00 |
|
|
Mick
|
d4593964fe
|
[diffusion] feat: support sp for image models (#13180)
|
2025-11-23 18:11:42 +08:00 |
|
|
Mick
|
ca548d8324
|
[diffusion] refactor: refactor sampling params (#13706)
|
2025-11-22 22:43:04 +08:00 |
|
|
Mick
|
aa6e2c8aa0
|
[diffusion] log: minor improve logging (#13735)
|
2025-11-21 23:01:23 +08:00 |
|
|
Mick
|
323fed5cfd
|
[diffusion] doc: add contributing.md (#13649)
|
2025-11-21 19:00:27 +08:00 |
|
|
Mick
|
5e7f91d451
|
[diffusion] profile: support performance metric dumping and comparison (#13630)
|
2025-11-21 18:47:16 +08:00 |
|
|
Mick
|
eda2f70033
|
[diffusion] doc: minor update docs (#13177)
|
2025-11-21 14:35:29 +08:00 |
|
|
Mick
|
c0a2513b07
|
[diffusion] CI: improve validation method (#13627)
|
2025-11-21 09:13:13 +08:00 |
|
|
Mick
|
4a8442af1b
|
diffusion: improve baseline performance monitor (#13614)
|
2025-11-20 14:29:56 +08:00 |
|
|
Mick
|
bc42c8c415
|
[diffusion] refactor: refactor pipeline folders (#13253)
|
2025-11-20 12:56:51 +08:00 |
|
|
Mick
|
2e3a69ae05
|
[diffusion] refactor: remove PreprocessorConfig (#13248)
|
2025-11-20 12:53:26 +08:00 |
|
|
MickandAdarsh Shirawalmath
|
127d59cd2c
|
[diffusion] CI: improve diffusion CI (#13562)
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
|
2025-11-20 10:54:13 +08:00 |
|
|
Mick
|
ff00b6adbe
|
diffusion: fix loading with local model_path (#13445)
|
2025-11-18 00:56:30 +08:00 |
|
|
|
7afff8fd1a
|
diffusion: fix wan2.2 ti2v num_frames adjust logic (#13379)
Co-authored-by: adarshxs <adarsh.shirawalmath@gmail.com>
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
|
2025-11-17 20:53:15 +08:00 |
|
|
Mick
|
191f5c7795
|
diffusion: correct check-changes for multimodal_gen (#13375)
|
2025-11-16 20:32:33 +08:00 |
|
|
Mick
|
922525ee6d
|
fix: fix serve command without diffusion dependency (#13246)
|
2025-11-14 10:24:18 +08:00 |
|
|
Mick
|
33d1aeb07f
|
diffusion: refactor task type of models (#13118)
|
2025-11-12 12:39:34 +08:00 |
|
|
Mick
|
60cb716720
|
[diffusion] log: improve logging while multiprocessing (#12997)
|
2025-11-12 12:08:37 +08:00 |
|
|
Mick
|
2f9952cdbf
|
diffusion: remove unused workflows folder (#13114)
|
2025-11-12 11:51:24 +08:00 |
|
|
Mick
|
6a7322ffbc
|
[diffusion] doc: add support_new_models.md (#13043)
|
2025-11-11 12:49:48 +08:00 |
|
|
Mick
|
ddfcb7c8ab
|
minor: fix notebook bug with new model_info fields added for warmup (#13005)
|
2025-11-11 00:46:12 +08:00 |
|
|
Mick
|
5639145fac
|
diffusion: reduce effort of supporting new model (#12982)
|
2025-11-10 21:20:33 +08:00 |
|
|
Mick
|
95876d75cb
|
chore: include a minimum image for vlms when warming-up (#9528)
|
2025-11-10 14:56:59 +08:00 |
|
|
Mick
|
e123648b36
|
diffusion: fix wan-2.2-TI2V and support sp (#12926)
|
2025-11-10 14:37:57 +08:00 |
|
|
Mick
|
307e7a6128
|
diffusion: fix detected file changes rule in CI (#12943)
|
2025-11-10 13:37:16 +08:00 |
|
|
Mick
|
83f89cc615
|
diffusion: skip full CI suite for multimodal_gen changes (#12940)
|
2025-11-10 10:46:24 +08:00 |
|
|
Mick
|
f5b3ccd9a5
|
feat: basic support for server-level multimodal cache (#10775)
|
2025-11-10 00:27:50 +08:00 |
|
|
MickandXinyuan Tong
|
e316bcacb1
|
update multimodal_gen readme (#12825)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-11-07 09:04:44 -08:00 |
|
|
Mick
|
73e9a2ef5c
|
fix: tiny fix cli (#12744)
|
2025-11-06 14:45:50 +08:00 |
|
|
+9
|
7bc1dae095
|
WIP: initial multimodal-gen support (#12484)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: JiLi <leege233@gmail.com>
Co-authored-by: CHEN Xi <78632976+RubiaCx@users.noreply.github.com>
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: jzhang38 <a1286225768@gmail.com>
Co-authored-by: BrianChen1129 <yongqichcd@gmail.com>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: Jinzhe Pan <48981407+eigensystem@users.noreply.github.com>
Co-authored-by: foreverpiano <pianoqwz@qq.com>
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: PorridgeSwim <yz3883@columbia.edu>
Co-authored-by: Jiali Chen <90408393+gary-chenjl@users.noreply.github.com>
|
2025-11-05 12:28:52 -08:00 |
|
|
MickandLianmin Zheng
|
823b442945
|
lang: support direct video inference (#9936)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-10-23 18:12:39 -07:00 |
|
|
|
770529a731
|
model: support deepseek-ocr (#11891)
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-10-24 03:15:17 +08:00 |
|
|
Mick
|
8bd26dd4e6
|
ci: fix night-ci with push retry mechanism (#11765)
|
2025-10-23 11:31:05 -07:00 |
|
|
Mick
|
3e4c7da2f5
|
ci: reduce and refactor vlm ut and combine test files (#11062)
|
2025-10-17 15:24:50 +00:00 |
|
|
MickandXinyuan Tong
|
86b04d25b3
|
model: qwen3-omni (thinker-only) (#10911)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-10-16 13:20:38 -07:00 |
|
|
Mick
|
f35f120d70
|
fix: fix video input for qwen3-vl (#11442)
|
2025-10-13 09:30:43 -07:00 |
|
|
Mick
|
0c0779d667
|
ci: improve nightly-ci (#11385)
|
2025-10-12 21:19:34 -07:00 |
|
|
MickandLianmin Zheng
|
9f2b457cbe
|
doc: add doc for adding new models into nightly-ci (#11443)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-10-12 08:35:10 -07:00 |
|
|
Mick
|
a1a20b4c7c
|
fix: fix video input for qwen3-vl (#11361)
|
2025-10-10 04:35:35 -07:00 |
|
|
Mick
|
a3c2ea4451
|
fix: fix revision for sgl-flash-attn in sgl-kernel (#11327)
|
2025-10-08 15:50:44 -07:00 |
|
|
Mick
|
64d1505c0a
|
ci: unify the model launch method of nightly ci (#11230)
|
2025-10-07 18:13:14 -07:00 |
|
|
Mick
|
97d966a7f8
|
ci: make find_local_hf_snapshot_dir more robust (#11248)
|
2025-10-05 19:50:11 -07:00 |
|
|
Mick
|
9de1320b63
|
fix: fp8 mllama4 without vision modules being quantized (#10611)
|
2025-09-29 21:17:12 +00:00 |
|
|
Mick
|
43fa9f22bd
|
fix: check if weights are already local before downloading (#11015)
|
2025-09-28 20:11:33 -07:00 |
|
|
Mick
|
2e7633982c
|
fix: show failed models in nightly ci (#10986)
|
2025-09-28 12:38:29 -07:00 |
|
|
Mick
|
777eb53897
|
ci: refactor nightly test (#10495)
|
2025-09-26 15:24:30 -07:00 |
|
|
Mick
|
fff7fbabe6
|
ci: fix rate-limit of huggingface with hf auth login (#10947)
|
2025-09-26 11:02:44 -07:00 |
|
|
Mick
|
0549f21c60
|
fix: fix max_new_tokens uninitialized error (#9343)
|
2025-09-15 12:06:55 +08:00 |
|
|
Mickandyhyang201
|
16a6d21b95
|
chore: enhance bench_serving for vlms with a new dataset of configurable image count and resolution (#9583)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
|
2025-08-26 17:42:54 -07:00 |
|
|
Mick
|
a1f011d09a
|
minor: determine mm attn backend based on platforms (#9303)
|
2025-08-22 01:08:41 -07:00 |
|
|
Mick
|
ef3004d90a
|
misc: parse bench_serving result as markdown table (#9377)
|
2025-08-20 16:44:20 -07:00 |
|
|
Mick
|
1df84ff414
|
ci: simplify multi-modality tests by using mixins (#9006)
|
2025-08-16 22:25:02 -07:00 |
|
|
Mick
|
584e1ab2d0
|
fix: fix unsupported palette mode of images in bench_serving for mmmu (#9206)
|
2025-08-14 18:44:46 -07:00 |
|
|
Mick
|
41d71ca488
|
fix: fix obsolete qwen-audio processor arg (#9003)
|
2025-08-09 13:18:36 -07:00 |
|
|
Mickandzhyncs
|
01c99a9959
|
chore: update Dockerfile (#8872)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-08-06 09:30:33 -07:00 |
|
|
MickandXinyuan Tong
|
1992ef9ba7
|
fix: temporarily disable cuda-ipc for mm data tensor (#8431)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-29 22:42:03 +00:00 |
|
|
Mick
|
0bcc195f4e
|
fix: minor fix TransportProxyTensor under tp (#8382)
|
2025-07-27 00:38:49 -07:00 |
|
|
MickandXinyuan Tong
|
3212c2ad3f
|
vlm: optimize tensor transport (#6003)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-07-26 17:41:01 +08:00 |
|
|
Mick
|
534756749a
|
chore: improvements on mm_utils (#7737)
|
2025-07-26 17:38:56 +08:00 |
|
|
MickandXinyuan Tong
|
4fa44d63c6
|
chore: improve mmmu benchmark (#7000)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-07-26 16:19:45 +08:00 |
|
|
Mick
|
3964b352c3
|
chore: tune mem fraction static for vlm (#6881)
|
2025-07-18 17:19:27 -07:00 |
|
|
Mick
|
e1020dc588
|
refactor: simply MultimodalTokens logic (#7924)
|
2025-07-17 17:59:15 -07:00 |
|
|
Mick
|
4395c87a9b
|
refactor: unify names of the feature field of MultimodalDataItem (#8075)
|
2025-07-16 17:52:38 -07:00 |
|
|
Mick
|
497efe747d
|
Revert "feat: replace Decord with video_reader-rs" (#8077)
|
2025-07-15 20:04:56 -07:00 |
|