4b0239066d
Always use fp16 for the text encoders.
1 year ago
da7a8df0d2
Put VAE key name in model config.
1 year ago
89507f8adf
Remove some unused imports.
1 year ago
05cd00695a
typo fix - calculate_sigmas_scheduler ( #2619 )
...
self.scheduler -> scheduler_name
Co-authored-by: Lt.Dr.Data <lt.dr.data@gmail.com>
1 year ago
4871a36458
Cleanup some unused imports.
1 year ago
78a70fda87
Remove useless import.
1 year ago
d76a04b6ea
Add unfinished ImageOnlyCheckpointSave node to save a SVD checkpoint.
...
This node is unfinished, SVD checkpoints saved with this node will
work with ComfyUI but not with anything else.
1 year ago
f9e55d8463
Only auto enable bf16 VAE on nvidia GPUs that actually support it.
1 year ago
2395ae740a
Make unclip more deterministic.
...
Pass a seed argument note that this might make old unclip images different.
1 year ago
53c8a99e6c
Make server storage the default.
...
Remove --server-storage argument.
1 year ago
977eda19a6
Don't round noise mask.
1 year ago
10f2609fdd
Add InpaintModelConditioning node.
...
This is an alternative to VAE Encode for inpaint that should work with
lower denoise.
This is a different take on #2501
1 year ago
1a57423d30
Fix issue when using multiple t2i adapters with batched images.
1 year ago
6a7bc35db8
Use basic attention implementation for small inputs on old pytorch.
1 year ago
235727fed7
Store user settings/data on the server and multi user support ( #2160 )
...
* wip per user data
* Rename, hide menu
* better error
rework default user
* store pretty
* Add userdata endpoints
Change nodetemplates to userdata
* add multi user message
* make normal arg
* Fix tests
* Ignore user dir
* user tests
* Changed to default to browser storage and add server-storage arg
* fix crash on empty templates
* fix settings added before load
* ignore parse errors
1 year ago
c6951548cf
Update optimized_attention_for_device function for new functions that
...
support masked attention.
1 year ago
aaa9017302
Add attention mask support to sub quad attention.
1 year ago
0c2c9fbdfa
Support attention mask in split attention.
1 year ago
3ad0191bfb
Implement attention mask on xformers.
1 year ago
8c6493578b
Implement noise augmentation for SD 4X upscale model.
1 year ago
ef4f6037cb
Fix model patches not working in custom sampling scheduler nodes.
1 year ago
a7874d1a8b
Add support for the stable diffusion x4 upscaling model.
...
This is an old model.
Load the checkpoint like a regular one and use the new
SD_4XUpscale_Conditioning node.
1 year ago
2c4e92a98b
Fix regression.
1 year ago
5eddfdd80c
Refactor VAE code.
...
Replace constants with downscale_ratio and latent_channels.
1 year ago
a47f609f90
Auto detect out_channels from model.
1 year ago
79f73a4b33
Remove useless code.
1 year ago
1b103e0cb2
Add argument to run the VAE on the CPU.
1 year ago
12e822c6c8
Use function to calculate model size in model patcher.
1 year ago
e1e322cf69
Load weights that can't be lowvramed to target device.
1 year ago
c782144433
Fix clip vision lowvram mode not working.
1 year ago
f21bb41787
Fix taesd VAE in lowvram mode.
1 year ago
61b3f15f8f
Fix lowvram mode not working with unCLIP and Revision code.
1 year ago
d0165d819a
Fix SVD lowvram mode.
1 year ago
a252963f95
--disable-smart-memory now unloads everything like it did originally.
1 year ago
36a7953142
Greatly improve lowvram sampling speed by getting rid of accelerate.
...
Let me know if this breaks anything.
1 year ago
261bcbb0d9
A few missing comfy ops in the VAE.
1 year ago
9a7619b72d
Fix regression with inpaint model.
1 year ago
571ea8cdcc
Fix SAG not working with cfg 1.0
1 year ago
8cf1daa108
Fix SDXL area composition sometimes not using the right pooled output.
1 year ago
2258f85159
Support stable zero 123 model.
...
To use it use the ImageOnlyCheckpointLoader to load the checkpoint and
the new Stable_Zero123 node.
1 year ago
2f9d6a97ec
Add --deterministic option to make pytorch use deterministic algorithms.
1 year ago
e45d920ae3
Don't resize clip vision image when the size is already good.
1 year ago
13e6d5366e
Switch clip vision to manual cast.
...
Make it use the same dtype as the text encoder.
1 year ago
719fa0866f
Set clip vision model in eval mode so it works without inference mode.
1 year ago
574363a8a6
Implement Perp-Neg
1 year ago
a5056cfb1f
Remove useless code.
1 year ago
329c571993
Improve code legibility.
1 year ago
6c5990f7db
Fix cfg being calculated more than once if sampler_cfg_function.
1 year ago
ba04a87d10
Refactor and improve the sag node.
...
Moved all the sag related code to comfy_extras/nodes_sag.py
1 year ago
6761233e9d
Implement Self-Attention Guidance ( #2201 )
...
* First SAG test
* need to put extra options on the model instead of patcher
* no errors and results seem not-broken
* Use @ashen-uncensored formula, which works better!!!
* Fix a crash when using weird resolutions. Remove an unnecessary UNet call
* Improve comments, optimize memory in blur routine
* SAG works with sampler_cfg_function
1 year ago
b454a67bb9
Support segmind vega model.
1 year ago
824e4935f5
Add dtype parameter to VAE object.
1 year ago
32b7e7e769
Add manual cast to controlnet.
1 year ago
3152023fbc
Use inference dtype for unet memory usage estimation.
1 year ago
77755ab8db
Refactor comfy.ops
...
comfy.ops -> comfy.ops.disable_weight_init
This should make it more clear what they actually do.
Some unused code has also been removed.
1 year ago
b0aab1e4ea
Add an option --fp16-unet to force using fp16 for the unet.
1 year ago
ba07cb748e
Use faster manual cast for fp8 in unet.
1 year ago
57926635e8
Switch text encoder to manual cast.
...
Use fp16 text encoder weights for CPU inference to lower memory usage.
1 year ago
340177e6e8
Disable non blocking on mps.
1 year ago
614b7e731f
Implement GLora.
1 year ago
cb63e230b4
Make lora code a bit cleaner.
1 year ago
174eba8e95
Use own clip vision model implementation.
1 year ago
97015b6b38
Cleanup.
1 year ago
a4ec54a40d
Add linear_start and linear_end to model_config.sampling_settings
1 year ago
9ac0b487ac
Make --gpu-only put intermediate values in GPU memory instead of cpu.
1 year ago
efb704c758
Support attention masking in CLIP implementation.
1 year ago
fbdb14d4c4
Cleaner CLIP text encoder implementation.
...
Use a simple CLIP model implementation instead of the one from
transformers.
This will allow some interesting things that would too hackish to implement
using the transformers implementation.
1 year ago
2db86b4676
Slightly faster lora applying.
1 year ago
1bbd65ab30
Missed this one.
1 year ago
9b655d4fd7
Fix memory issue with control loras.
1 year ago
26b1c0a771
Fix control lora on fp8.
1 year ago
be3468ddd5
Less useless downcasting.
1 year ago
ca82ade765
Use .itemsize to get dtype size for fp8.
1 year ago
31b0f6f3d8
UNET weights can now be stored in fp8.
...
--fp8_e4m3fn-unet and --fp8_e5m2-unet are the two different formats
supported by pytorch.
1 year ago
af365e4dd1
All the unet ops with weights are now handled by comfy.ops
1 year ago
61a123a1e0
A different way of handling multiple images passed to SVD.
...
Previously when a list of 3 images [0, 1, 2] was used for a 6 frame video
they were concated like this:
[0, 1, 2, 0, 1, 2]
now they are concated like this:
[0, 0, 1, 1, 2, 2]
1 year ago
c97be4db91
Support SD2.1 turbo checkpoint.
1 year ago
983ebc5792
Use smart model management for VAE to decrease latency.
1 year ago
c45d1b9b67
Add a function to load a unet from a state dict.
1 year ago
f30b992b18
.sigma and .timestep now return tensors on the same device as the input.
1 year ago
13fdee6abf
Try to free memory for both cond+uncond before inference.
1 year ago
be71bb5e13
Tweak memory inference calculations a bit.
1 year ago
39e75862b2
Fix regression from last commit.
1 year ago
50dc39d6ec
Clean up the extra_options dict for the transformer patches.
...
Now everything in transformer_options gets put in extra_options.
1 year ago
5d6dfce548
Fix importing diffusers unets.
1 year ago
3e5ea74ad3
Make buggy xformers fall back on pytorch attention.
1 year ago
871cc20e13
Support SVD img2vid model.
1 year ago
410bf07771
Make VAE memory estimation take dtype into account.
1 year ago
32447f0c39
Add sampling_settings so models can specify specific sampling settings.
1 year ago
c3ae99a749
Allow controlling downscale and upscale methods in PatchModelAddDownscale.
1 year ago
72741105a6
Remove useless code.
1 year ago
6a491ebe27
Allow model config to preprocess the vae state dict on load.
1 year ago
cd4fc77d5f
Add taesd and taesdxl to VAELoader node.
...
They will show up if both the taesd_encoder and taesd_decoder or taesdxl
model files are present in the models/vae_approx directory.
1 year ago
ce67dcbcda
Make it easy for models to process the unet state dict on load.
1 year ago
d9d8702d8d
percent_to_sigma now returns a float instead of a tensor.
1 year ago
0cf4e86939
Add some command line arguments to store text encoder weights in fp8.
...
Pytorch supports two variants of fp8:
--fp8_e4m3fn-text-enc (the one that seems to give better results)
--fp8_e5m2-text-enc
1 year ago
107e78b1cb
Add support for loading SSD1B diffusers unet version.
...
Improve diffusers model detection.
1 year ago
7e3fe3ad28
Make deep shrink behave like it should.
1 year ago
9f00a18095
Fix potential issues.
1 year ago
7ea6bb038c
Print warning when controlnet can't be applied instead of crashing.
1 year ago
comfyanonymous
Dr.Lt.Data
pythongosssss
Hari
Rafie Walker