05676942b7
Add some more transformer hooks and move tomesd to comfy_extras.
...
Tomesd now uses q instead of x to decide which tokens to merge because
it seems to give better results.
2 years ago
8607c2d42d
Move latent scale factor from VAE to model.
2 years ago
30a3861946
Fix bug when yaml config has no clip params.
2 years ago
9e37f4c7d5
Fix error with ClipVision loader node.
2 years ago
9f83b098c9
Don't merge weights when shapes don't match and print a warning.
2 years ago
f87ec10a97
Support base SDXL and SDXL refiner models.
...
Large refactor of the model detection and loading code.
2 years ago
51581dbfa9
Fix last commits causing an issue with the text encoder lora.
2 years ago
8125b51a62
Keep a set of model_keys for faster add_patches.
2 years ago
45beebd33c
Add a type of model patch useful for model merging.
2 years ago
8883cb0f67
Add a way to set patches that modify the attn2 output.
...
Change the transformer patches function format to be more future proof.
2 years ago
fb4bf7f591
This is not needed anymore and causes issues with alphas_cumprod.
2 years ago
f7edcfd927
Add a --gpu-only argument to keep and run everything on the GPU.
...
Make the CLIP model work on the GPU.
2 years ago
6b774589a5
Set model to fp16 before loading the state dict to lower ram bump.
2 years ago
388567f20b
sampler_cfg_function now uses a dict for the argument.
...
This means arguments can be added without issues.
2 years ago
ff9b22d79e
Turn on safe load for a few models.
2 years ago
f0a2b81cd0
Cleanup: Remove a bunch of useless files.
2 years ago
f8c5931053
Split the batch in VAEEncode if there's not enough memory.
2 years ago
c069fc0730
Auto switch to tiled VAE encode if regular one runs out of memory.
2 years ago
de142eaad5
Simpler base model code.
2 years ago
0e425603fb
Small refactor.
2 years ago
700491d81a
Implement global average pooling for controlnet.
2 years ago
03da8a3426
This is useless for inference.
2 years ago
eb448dd8e1
Auto load model in lowvram if not enough memory.
2 years ago
a532888846
Support VAEs in diffusers format.
2 years ago
19c014f429
comment out annoying print statement
2 years ago
d9e088ddfd
minor changes for tiled sampler
2 years ago
bae4fb4a9d
Fix imports.
2 years ago
fcf513e0b6
Refactor.
2 years ago
5eeecf3fd5
remove unused import
2 years ago
8912623ea9
use comfy progress bar
2 years ago
fdf57325f4
Merge remote-tracking branch 'origin/master' into tiled-progress
2 years ago
27df74101e
reduce duplication
2 years ago
06ad35b493
added progress to encode + upscale
2 years ago
9c335a553f
LoKR support.
2 years ago
c8c9926eeb
Add progress to vae decode tiled
2 years ago
5282f56434
Implement Linear hypernetworks.
...
Add a HypernetworkLoader node to use hypernetworks.
2 years ago
3696d1699a
Add support for GLIGEN textbox model.
2 years ago
884ea653c8
Add a way for nodes to set a custom CFG function.
2 years ago
73c3e11e83
Fix model_management import so it doesn't get executed twice.
2 years ago
81d1f00df3
Some refactoring: from_tokens -> encode_from_tokens
2 years ago
da115bd78d
ensure backwards compat with optional args
2 years ago
73175cf58c
split tokenizer from encoder
2 years ago
809bcc8ceb
Add support for unCLIP SD2.x models.
...
See _for_testing/unclip in the UI for the new nodes.
unCLIPCheckpointLoader is used to load them.
unCLIPConditioning is used to add the image cond and takes as input a
CLIPVisionEncode output which has been moved to the conditioning section.
2 years ago
18a6c1db33
Add a TomePatchModel node to the _for_testing section.
...
Tome increases sampling speed at the expense of quality.
2 years ago
b2554bc4dd
Split VAE decode batches depending on free memory.
2 years ago
dd095efc2c
Support loha that use cp decomposition.
2 years ago
94a7c895f4
Add loha support.
2 years ago
3ed4a4e4e6
Try again with vae tiled decoding if regular fails because of OOM.
2 years ago
4039616ca6
Less seams in tiled outputs at the cost of more processing.
2 years ago
cc309568e1
Add support for locon mid weights.
2 years ago
edfc4ca663
Try to fix a vram issue with controlnets.
2 years ago
2e73367f45
Merge T2IAdapterLoader and ControlNetLoader.
...
Workflows will be auto updated.
2 years ago
0e836d525e
use half() on fp16 models loaded with config.
2 years ago
986dd820dc
Use half() function on model when loading in fp16.
2 years ago
54dbfaf2ec
Remove omegaconf dependency and some ci changes.
2 years ago
e33dc2b33b
Add a VAEEncodeTiled node.
2 years ago
9db2e97b47
Tiled upscaling with the upscale models.
2 years ago
cd64111c83
Add locon support.
2 years ago
c70f0ac64b
SD2.x controlnets now work.
2 years ago
19415c3ace
Relative imports to test something.
2 years ago
501f19eec6
Fix clip_skip no longer being loaded from yaml file.
2 years ago
afff30fc0a
Add --cpu to use the cpu for inference.
2 years ago
47acb3d73e
Implement support for t2i style model.
...
It needs the CLIPVision model so I added CLIPVisionLoader and CLIPVisionEncode.
Put the clip vision model in models/clip_vision
Put the t2i style model in models/style_models
StyleModelLoader to load it, StyleModelApply to apply it
ConditioningAppend to append the conditioning it outputs to a positive one.
2 years ago
16130c7546
Add support for new colour T2I adapter model.
2 years ago
4215206281
Add a node to set CLIP skip.
...
Use a more simple way to detect if the model is -v prediction.
2 years ago
fed315a76a
To be really simple CheckpointLoaderSimple should pick the right type.
2 years ago
94bb0375b0
New CheckpointLoaderSimple to load checkpoints without a config.
2 years ago
b31daadc03
Try to improve memory issues with del.
2 years ago
9f4214e534
Preparing to add another function to load checkpoints.
2 years ago
dfb397e034
Fix multiple controlnets not working.
2 years ago
af3cc1b5fb
Fixed issue when batched image was used as a controlnet input.
2 years ago
d2da346b0b
Fix missing variable.
2 years ago
4e6b83a80a
Add a T2IAdapterLoader node to load T2I-Adapter models.
...
They are loaded as CONTROL_NET objects because they are similar.
2 years ago
fcb25d37db
Prepare for t2i adapter.
2 years ago
87b00b37f6
Added an experimental VAEDecodeTiled.
...
This decodes the image with the VAE in tiles which should be faster and
use less vram.
It's in the _for_testing section so I might change/remove it or even
add the functionality to the regular VAEDecode node depending on how
well it performs which means don't depend too much on it.
2 years ago
62df8dd62a
Add a node to load diff controlnets.
2 years ago
d80af7ca30
ControlNetApply now stacks.
...
It can be used to apply multiple control nets at the same time.
2 years ago
d66415c021
Low vram mode for controlnets.
2 years ago
220a72d36b
Use fp16 for fp16 control nets.
2 years ago
6135a21ee8
Add a way to control controlnet strength.
2 years ago
4efa67fa12
Add ControlNet support.
2 years ago
a84cd0d1ad
Don't unload/reload model from CPU uselessly.
2 years ago
b1a7c9ebf6
Embeddings/textual inversion support for SD2.x
2 years ago
1de5aa6a59
Add a CLIPLoader node to load standalone clip weights.
...
Put them in models/clip
2 years ago
56d802e1f3
Use transformers CLIP instead of open_clip for SD2.x
...
This should make things a bit cleaner.
2 years ago
bf9ccffb17
Small fix for SD2.x loras.
2 years ago
678105fade
SD2.x CLIP support for Loras.
2 years ago
ef90e9c376
Add a LoraLoader node to apply loras to models and clip.
...
The models are modified in place before being used and unpatched after.
I think this is better than monkeypatching since it might make it easier
to use faster non pytorch unet inference in the future.
2 years ago
f73e57d881
Add support for textual inversion embedding for SD1.x CLIP.
2 years ago
73f60740c8
Slightly cleaner code.
2 years ago
0108616b77
Fix issue with some models.
2 years ago
2973ff24c5
Round CLIP position ids to fix float issues in some checkpoints.
2 years ago
acdc6f42e0
Fix loading some malformed checkpoints?
2 years ago
220afe3310
Initial commit.
2 years ago
comfyanonymous
BlenderNeko
pythongosssss