e8c499ddd4
Split optimization for VAE attention block.
2 years ago
5b4e312749
Use inplace operations for less OOM issues.
2 years ago
3fd87cbd21
Slightly smarter batching behaviour.
...
Try to keep batch sizes more consistent which seems to improve things on
AMD GPUs.
2 years ago
bbdcf0b737
Use relative imports for k_diffusion.
2 years ago
708138c77d
Remove print.
2 years ago
047775615b
Lower the chances of an OOM.
2 years ago
853e96ada3
Increase it/s by batching together some stuff sent to unet.
2 years ago
c92633eaa2
Auto calculate amount of memory to use for --lowvram
2 years ago
534736b924
Add some low vram modes: --lowvram and --novram
2 years ago
a84cd0d1ad
Don't unload/reload model from CPU uselessly.
2 years ago
b1a7c9ebf6
Embeddings/textual inversion support for SD2.x
2 years ago
1de5aa6a59
Add a CLIPLoader node to load standalone clip weights.
...
Put them in models/clip
2 years ago
56d802e1f3
Use transformers CLIP instead of open_clip for SD2.x
...
This should make things a bit cleaner.
2 years ago
bf9ccffb17
Small fix for SD2.x loras.
2 years ago
678105fade
SD2.x CLIP support for Loras.
2 years ago
ef90e9c376
Add a LoraLoader node to apply loras to models and clip.
...
The models are modified in place before being used and unpatched after.
I think this is better than monkeypatching since it might make it easier
to use faster non pytorch unet inference in the future.
2 years ago
69df7eba94
Add KSamplerAdvanced node.
...
This node exposes more sampling options and makes it possible for example
to sample the first few steps on the latent image, do some operations on it
and then do the rest of the sampling steps. This can be achieved using the
start_at_step and end_at_step options.
2 years ago
1daccf3678
Run softmax in place if it OOMs.
2 years ago
f73e57d881
Add support for textual inversion embedding for SD1.x CLIP.
2 years ago
50db297cf6
Try to fix OOM issues with cards that have less vram than mine.
2 years ago
73f60740c8
Slightly cleaner code.
2 years ago
0108616b77
Fix issue with some models.
2 years ago
2973ff24c5
Round CLIP position ids to fix float issues in some checkpoints.
2 years ago
c4b02059d0
Add ConditioningSetArea node.
...
to apply conditioning/prompts only to a specific area of the image.
Add ConditioningCombine node.
so that multiple conditioning/prompts can be applied to the image at the
same time
2 years ago
acdc6f42e0
Fix loading some malformed checkpoints?
2 years ago
051f472e8f
Fix sub quadratic attention for SD2 and make it the default optimization.
2 years ago
220afe3310
Initial commit.
2 years ago
comfyanonymous