6bcf57ff10
Fix attention masks properly for multiple batches.
1 year ago
11e3221f1f
fp8 weight support for Stable Cascade.
1 year ago
f8706546f3
Fix attention mask batch size in some attention functions.
1 year ago
3b9969c1c5
Properly fix attention masks in CLIP with batches.
1 year ago
805c36ac9c
Make Stable Cascade work on old pytorch 2.0
1 year ago
667c92814e
Stable Cascade Stage B.
1 year ago
f83109f09b
Stable Cascade Stage C.
1 year ago
5e06baf112
Stable Cascade Stage A.
1 year ago
c661a8b118
Don't use numpy for calculating sigmas.
1 year ago
89507f8adf
Remove some unused imports.
1 year ago
2395ae740a
Make unclip more deterministic.
...
Pass a seed argument note that this might make old unclip images different.
1 year ago
6a7bc35db8
Use basic attention implementation for small inputs on old pytorch.
1 year ago
c6951548cf
Update optimized_attention_for_device function for new functions that
...
support masked attention.
1 year ago
aaa9017302
Add attention mask support to sub quad attention.
1 year ago
0c2c9fbdfa
Support attention mask in split attention.
1 year ago
3ad0191bfb
Implement attention mask on xformers.
1 year ago
8c6493578b
Implement noise augmentation for SD 4X upscale model.
1 year ago
79f73a4b33
Remove useless code.
1 year ago
61b3f15f8f
Fix lowvram mode not working with unCLIP and Revision code.
1 year ago
d0165d819a
Fix SVD lowvram mode.
1 year ago
261bcbb0d9
A few missing comfy ops in the VAE.
1 year ago
a5056cfb1f
Remove useless code.
1 year ago
77755ab8db
Refactor comfy.ops
...
comfy.ops -> comfy.ops.disable_weight_init
This should make it more clear what they actually do.
Some unused code has also been removed.
1 year ago
fbdb14d4c4
Cleaner CLIP text encoder implementation.
...
Use a simple CLIP model implementation instead of the one from
transformers.
This will allow some interesting things that would too hackish to implement
using the transformers implementation.
1 year ago
1bbd65ab30
Missed this one.
1 year ago
31b0f6f3d8
UNET weights can now be stored in fp8.
...
--fp8_e4m3fn-unet and --fp8_e5m2-unet are the two different formats
supported by pytorch.
1 year ago
af365e4dd1
All the unet ops with weights are now handled by comfy.ops
1 year ago
39e75862b2
Fix regression from last commit.
1 year ago
50dc39d6ec
Clean up the extra_options dict for the transformer patches.
...
Now everything in transformer_options gets put in extra_options.
1 year ago
3e5ea74ad3
Make buggy xformers fall back on pytorch attention.
1 year ago
871cc20e13
Support SVD img2vid model.
1 year ago
72741105a6
Remove useless code.
1 year ago
7e3fe3ad28
Make deep shrink behave like it should.
1 year ago
7ea6bb038c
Print warning when controlnet can't be applied instead of crashing.
1 year ago
94cc718e9c
Add a way to add patches to the input block.
1 year ago
794dd2064d
Fix typo.
1 year ago
a527d0c795
Code refactor.
1 year ago
2a23ba0b8c
Fix unet ops not entirely on GPU.
1 year ago
a268a574fa
Remove a bunch of useless code.
...
DDIM is the same as euler with a small difference in the inpaint code.
DDIM uses randn_like but I set a fixed seed instead.
I'm keeping it in because I'm sure if I remove it people are going to
complain.
1 year ago
c837a173fa
Fix some memory issues in sub quad attention.
1 year ago
125b03eead
Fix some OOM issues with split attention.
1 year ago
6ec3f12c6e
Support SSD1B model and make it easier to support asymmetric unets.
1 year ago
a373367b0c
Fix some OOM issues with split and sub quad attention.
1 year ago
8b65f5de54
attention_basic now works with hypertile.
1 year ago
e6bc42df46
Make sub_quad and split work with hypertile.
1 year ago
9906e3efe3
Make xformers work with hypertile.
1 year ago
d44a2de49f
Make VAE code closer to sgm.
1 year ago
23680a9155
Refactor the attention stuff in the VAE.
1 year ago
bb064c9796
Add a separate optimized_attention_masked function.
1 year ago
9a55dadb4c
Refactor code so model can be a dtype other than fp32 or fp16.
1 year ago
comfyanonymous