73ce178021
Remove redundancy in mmdit.py ( #3685 )
9 months ago
8c4a9befa7
SD3 Support.
9 months ago
0920e0e5fe
Remove some unused imports.
9 months ago
8508df2569
Work around black image bug on Mac 14.5 by forcing attention upcasting.
9 months ago
83d969e397
Disable xformers when tracing model.
9 months ago
1900e5119f
Fix potential issue.
9 months ago
0bdc2b15c7
Cleanup.
9 months ago
98f828fad9
Remove unnecessary code.
9 months ago
46daf0a9a7
Add debug options to force on and off attention upcasting.
9 months ago
ec6f16adb6
Fix SAG.
10 months ago
bb4940d837
Only enable attention upcasting on models that actually need it.
10 months ago
b0ab31d06c
Refactor attention upcasting code part 1.
10 months ago
2aed53c4ac
Workaround xformers bug.
10 months ago
d7897fff2c
Move cascade scale factor from stage_a to latent_formats.py
11 months ago
2a813c3b09
Switch some more prints to logging.
12 months ago
5f60ee246e
Support loading the sr cascade controlnet.
12 months ago
03e6e81629
Set upscale algorithm to bilinear for stable cascade controlnet.
12 months ago
03e83bb5d0
Support stable cascade canny controlnet.
12 months ago
cb7c3a2921
Allow image_only_indicator to be None.
1 year ago
b3e97fc714
Koala 700M and 1B support.
...
Use the UNET Loader node to load the unet file to use them.
1 year ago
e93cdd0ad0
Remove print.
1 year ago
a7b5eaa7e3
Forgot to commit this.
1 year ago
6bcf57ff10
Fix attention masks properly for multiple batches.
1 year ago
11e3221f1f
fp8 weight support for Stable Cascade.
1 year ago
f8706546f3
Fix attention mask batch size in some attention functions.
1 year ago
3b9969c1c5
Properly fix attention masks in CLIP with batches.
1 year ago
805c36ac9c
Make Stable Cascade work on old pytorch 2.0
1 year ago
667c92814e
Stable Cascade Stage B.
1 year ago
f83109f09b
Stable Cascade Stage C.
1 year ago
5e06baf112
Stable Cascade Stage A.
1 year ago
c661a8b118
Don't use numpy for calculating sigmas.
1 year ago
89507f8adf
Remove some unused imports.
1 year ago
2395ae740a
Make unclip more deterministic.
...
Pass a seed argument note that this might make old unclip images different.
1 year ago
6a7bc35db8
Use basic attention implementation for small inputs on old pytorch.
1 year ago
c6951548cf
Update optimized_attention_for_device function for new functions that
...
support masked attention.
1 year ago
aaa9017302
Add attention mask support to sub quad attention.
1 year ago
0c2c9fbdfa
Support attention mask in split attention.
1 year ago
3ad0191bfb
Implement attention mask on xformers.
1 year ago
8c6493578b
Implement noise augmentation for SD 4X upscale model.
1 year ago
79f73a4b33
Remove useless code.
1 year ago
61b3f15f8f
Fix lowvram mode not working with unCLIP and Revision code.
1 year ago
d0165d819a
Fix SVD lowvram mode.
1 year ago
261bcbb0d9
A few missing comfy ops in the VAE.
1 year ago
a5056cfb1f
Remove useless code.
1 year ago
77755ab8db
Refactor comfy.ops
...
comfy.ops -> comfy.ops.disable_weight_init
This should make it more clear what they actually do.
Some unused code has also been removed.
1 year ago
fbdb14d4c4
Cleaner CLIP text encoder implementation.
...
Use a simple CLIP model implementation instead of the one from
transformers.
This will allow some interesting things that would too hackish to implement
using the transformers implementation.
1 year ago
1bbd65ab30
Missed this one.
1 year ago
31b0f6f3d8
UNET weights can now be stored in fp8.
...
--fp8_e4m3fn-unet and --fp8_e5m2-unet are the two different formats
supported by pytorch.
1 year ago
af365e4dd1
All the unet ops with weights are now handled by comfy.ops
1 year ago
39e75862b2
Fix regression from last commit.
1 year ago
Dango233
comfyanonymous