e11052afcf
Add ipndm sampler.
8 months ago
3914d5a2ae
Support full SD3 loras.
8 months ago
a45df69570
Basic tiled decoding for audio VAE.
8 months ago
b7c473d1ab
Fix lora keys for SimpleTuner ( #3759 )
8 months ago
6425252c4f
Use fp16 as the default vae dtype for the audio VAE.
8 months ago
8ddc151a4c
Squash depreciation warning on new pytorch.
8 months ago
ca9d300a80
Better estimation for memory usage during audio VAE encoding/decoding.
8 months ago
746a0410d4
Fix VAEEncode with taesd3.
8 months ago
04e8798c37
Improvements to the TAESD3 implementation.
8 months ago
df7db0e027
support TAESD3 ( #3738 )
8 months ago
bb1969cab7
Initial support for the stable audio open model.
8 months ago
1281f933c1
Small optimization.
8 months ago
f2e844e054
Optimize some unneeded if conditions in the sampling code.
8 months ago
0ec513d877
Add a --force-channels-last to inference models in channel last mode.
8 months ago
0e06b370db
Print key names for easier debugging.
8 months ago
5eb98f0092
Exempt IPEX from non_blocking previews fixing segmentation faults. ( #3708 )
8 months ago
ac151ac169
Support SD3 diffusers lora.
8 months ago
37a08a41b3
Support setting weight offsets in weight patcher.
9 months ago
605e64f6d3
Fix lowvram issue.
9 months ago
1ddf512fdc
Don't auto convert clip and vae weights to fp16 when saving checkpoint.
9 months ago
694e0b48e0
SD3 better memory usage estimation.
9 months ago
69c8d6d8a6
Single and dual clip loader nodes support SD3.
...
You can use the CLIPLoader to use the t5xxl only or the DualCLIPLoader to
use CLIP-L and CLIP-G only for sd3.
9 months ago
0e49211a11
Load the SD3 T5xxl model in the same dtype stored in the checkpoint.
9 months ago
5889b7ca0a
Support multiple text encoder configurations on SD3.
9 months ago
9424522ead
Reuse code.
9 months ago
73ce178021
Remove redundancy in mmdit.py ( #3685 )
9 months ago
a82fae2375
Fix bug with cosxl edit model.
9 months ago
8c4a9befa7
SD3 Support.
9 months ago
a5e6a632f9
Support sampling non 2D latents.
9 months ago
742d5720d1
Support zeroing out text embeddings with the attention mask.
9 months ago
6cd8ffc465
Reshape the empty latent image to the right amount of channels if needed.
9 months ago
56333d4850
Use the end token for the text encoder attention mask.
9 months ago
104fcea0c8
Add function to get the list of currently loaded models.
9 months ago
b1fd26fe9e
pytorch xpu should be flash or mem efficient attention?
9 months ago
809cc85a8e
Remove useless code.
9 months ago
b249862080
Add an annoying print to a function I want to remove.
9 months ago
bf3e334d46
Disable non_blocking when --deterministic or directml.
9 months ago
b26da2245f
Fix UnetParams annotation typo ( #3589 )
9 months ago
0920e0e5fe
Remove some unused imports.
9 months ago
ffc4b7c30e
Fix DORA strength.
...
This is a different version of #3298 with more correct behavior.
9 months ago
efa5a711b2
Reduce memory usage when applying DORA: #3557
9 months ago
6c23854f54
Fix OSX latent2rgb previews.
9 months ago
7718ada4ed
Add type annotation UnetWrapperFunction ( #3531 )
...
* Add type annotation UnetWrapperFunction
* nit
* Add types.py
9 months ago
8508df2569
Work around black image bug on Mac 14.5 by forcing attention upcasting.
9 months ago
83d969e397
Disable xformers when tracing model.
9 months ago
1900e5119f
Fix potential issue.
9 months ago
09e069ae6c
Log the pytorch version.
9 months ago
11a2ad5110
Fix controlnet not upcasting on models that have it enabled.
9 months ago
0bdc2b15c7
Cleanup.
9 months ago
98f828fad9
Remove unnecessary code.
9 months ago
19300655dd
Don't automatically switch to lowvram mode on GPUs with low memory.
9 months ago
46daf0a9a7
Add debug options to force on and off attention upcasting.
9 months ago
2d41642716
Fix lowvram dora issue.
9 months ago
ec6f16adb6
Fix SAG.
9 months ago
bb4940d837
Only enable attention upcasting on models that actually need it.
10 months ago
b0ab31d06c
Refactor attention upcasting code part 1.
10 months ago
f509c6fe21
Fix Intel GPU memory allocation accuracy and documentation update. ( #3459 )
...
* Change calculation of memory total to be more accurate, allocated is actually smaller than reserved.
* Update README.md install documentation for Intel GPUs.
10 months ago
fa6dd7e5bb
Fix lowvram issue with saving checkpoints.
...
The previous fix didn't cover the case where the model was loaded in
lowvram mode right before.
10 months ago
49c20cdc70
No longer necessary.
10 months ago
e1489ad257
Fix issue with lowvram mode breaking model saving.
10 months ago
93e876a3be
Remove warnings that confuse people.
10 months ago
cd07340d96
Typo fix.
10 months ago
c61eadf69a
Make the load checkpoint with config function call the regular one.
...
I was going to completely remove this function because it is unmaintainable
but I think this is the best compromise.
The clip skip and v_prediction parts of the configs should still work but
not the fp16 vs fp32.
10 months ago
a56d02efc7
Change torch.xpu to ipex.optimize, xpu device initialization and remove workaround for text node issue from older IPEX. ( #3388 )
10 months ago
f81a6fade8
Fix some edge cases with samplers and arrays with a single sigma.
10 months ago
2aed53c4ac
Workaround xformers bug.
10 months ago
bacce529fb
Add TLS Support ( #3312 )
...
* Add TLS Support
* Add to readme
* Add guidance for windows users on generating certificates
* Add guidance for windows users on generating certificates
* Fix typo
10 months ago
7990ae18c1
Fix error when more cond masks passed in than batch size ( #3353 )
10 months ago
8dc19e40d1
Don't init a VAE model when there are no VAE weights.
10 months ago
c59fe9f254
Support VAE without quant_conv.
10 months ago
719fb2c81d
Add basic PAG node.
10 months ago
258dbc06c3
Fix some memory related issues.
11 months ago
58812ab8ca
Support SDXS 512 model.
11 months ago
831511a1ee
Fix issue with sampling_settings persisting across models.
11 months ago
30abc324c2
Support properly saving CosXL checkpoints.
11 months ago
0a03009808
Fix issue with controlnet models getting loaded multiple times.
11 months ago
38ed2da2dd
Fix typo in lowvram patcher ( #3209 )
11 months ago
1088d1850f
Support for CosXL models.
11 months ago
41ed7e85ea
Fix object_patches_backup not being the same object across clones.
11 months ago
0f5768e038
Fix missing arguments in cfg_function.
11 months ago
1f4fc9ea0c
Fix issue with get_model_object on patched model.
11 months ago
1a0486bb96
Fix model needing to be loaded on GPU to generate the sigmas.
11 months ago
c6bd456c45
Make zero denoise a NOP.
11 months ago
fcfd2bdf8a
Small cleanup.
11 months ago
0542088ef8
Refactor sampler code for more advanced sampler nodes part 2.
11 months ago
57753c964a
Refactor sampling code for more advanced sampler nodes.
11 months ago
6c6a39251f
Fix saving text encoder in fp8.
11 months ago
e6482fbbfc
Refactor calc_cond_uncond_batch into calc_cond_batch.
...
calc_cond_batch can take an arbitrary amount of cond inputs.
Added a calc_cond_uncond_batch wrapper with a warning so custom nodes
won't break.
11 months ago
575acb69e4
IP2P model loading support.
...
This is the code to load the model and inference it with only a text
prompt. This commit does not contain the nodes to properly use it with an
image input.
This supports both the original SD1 instructpix2pix model and the
diffusers SDXL one.
11 months ago
94a5a67c32
Cleanup to support different types of inpaint models.
11 months ago
5d8898c056
Fix some performance issues with weight loading and unloading.
...
Lower peak memory usage when changing model.
Fix case where model weights would be unloaded and reloaded.
11 months ago
327ca1313d
Support SDXS 0.9
11 months ago
ae77590b4e
dora_scale support for lora file.
11 months ago
c6de09b02e
Optimize memory unload strategy for more optimized performance.
11 months ago
0624838237
Add inverse noise scaling function.
11 months ago
5d875d77fe
Fix regression with lcm not working with batches.
11 months ago
4b9005e949
Fix regression with model merging.
11 months ago
c18a203a8a
Don't unload model weights for non weight patches.
11 months ago
150a3e946f
Make LCM sampler use the model noise scaling function.
11 months ago
40e124c6be
SV3D support.
11 months ago
cacb022c4a
Make saved SD1 checkpoints match more closely the official one.
11 months ago
d7897fff2c
Move cascade scale factor from stage_a to latent_formats.py
11 months ago
f2fe635c9f
SamplerDPMAdaptative node to test the different options.
11 months ago
448d9263a2
Fix control loras breaking.
12 months ago
db8b59ecff
Lower memory usage for loras in lowvram mode at the cost of perf.
12 months ago
2a813c3b09
Switch some more prints to logging.
12 months ago
0ed72befe1
Change log levels.
...
Logging level now defaults to info. --verbose sets it to debug.
12 months ago
65397ce601
Replace prints with logging and add --verbose argument.
12 months ago
5f60ee246e
Support loading the sr cascade controlnet.
12 months ago
03e6e81629
Set upscale algorithm to bilinear for stable cascade controlnet.
12 months ago
03e83bb5d0
Support stable cascade canny controlnet.
12 months ago
10860bcd28
Add compression_ratio to controlnet code.
12 months ago
478f71a249
Remove useless check.
12 months ago
12c1080ebc
Simplify differential diffusion code.
12 months ago
727021bdea
Implement Differential Diffusion ( #2876 )
...
* Implement Differential Diffusion
* Cleanup.
* Fix.
* Masks should be applied at full strength.
* Fix colors.
* Register the node.
* Cleaner code.
* Fix issue with getting unipc sampler.
* Adjust thresholds.
* Switch to linear thresholds.
* Only calculate nearest_idx on valid thresholds.
12 months ago
1abf8374ec
utils.set_attr can now be used to set any attribute.
...
The old set_attr has been renamed to set_attr_param.
12 months ago
dce3555339
Add some tesla pascal GPUs to the fp16 working but slower list.
12 months ago
51df846598
Let conditioning specify custom concat conds.
12 months ago
9f71e4b62d
Let model patches patch sub objects.
12 months ago
00425563c0
Cleanup: Use sampling noise scaling function for inpainting.
12 months ago
c62e836167
Move noise scaling to object with sampling math.
12 months ago
cb7c3a2921
Allow image_only_indicator to be None.
1 year ago
b3e97fc714
Koala 700M and 1B support.
...
Use the UNET Loader node to load the unet file to use them.
1 year ago
37a86e4618
Remove duplicate text_projection key from some saved models.
1 year ago
8daedc5bf2
Auto detect playground v2.5 model.
1 year ago
d46583ecec
Playground V2.5 support with ModelSamplingContinuousEDM node.
...
Use ModelSamplingContinuousEDM with edm_playground_v2.5 selected.
1 year ago
1e0fcc9a65
Make XL checkpoints save in a more standard format.
1 year ago
b416be7d78
Make the text projection saved in the checkpoint the right format.
1 year ago
03c47fc0f2
Add a min_length property to tokenizer class.
1 year ago
8ac69f62e5
Make return_projected_pooled setable from the __init__
1 year ago
ca7c310a0e
Support loading old CLIP models saved with CLIPSave.
1 year ago
c2cb8e889b
Always return unprojected pooled output for gligen.
1 year ago
1cb3f6a83b
Move text projection into the CLIP model code.
...
Fix issue with not loading the SSD1B clip correctly.
1 year ago
6533b172c1
Support text encoder text_projection in lora.
1 year ago
1e5f0f66be
Support lora keys with lora_prior_unet_ and lora_prior_te_
1 year ago
e1cb93c383
Fix model and cond transformer options merge
1 year ago
10847dfafe
Cleanup uni_pc inpainting.
...
This causes some small changes to the uni pc inpainting behavior but it
seems to improve results slightly.
1 year ago
18c151b3e3
Add some latent2rgb matrices for previews.
1 year ago
0d0fbabd1d
Pass pooled CLIP to stage b.
1 year ago
c6b7a157ed
Align simple scheduling closer to official stable cascade scheduler.
1 year ago
88f300401c
Enable fp16 by default on mps.
1 year ago
e93cdd0ad0
Remove print.
1 year ago
3711b31dff
Support Stable Cascade in checkpoint format.
1 year ago
d91f45ef28
Some cleanups to how the text encoders are loaded.
1 year ago
a7b5eaa7e3
Forgot to commit this.
1 year ago
3b2e579926
Support loading the Stable Cascade effnet and previewer as a VAE.
...
The effnet can be used to encode images for img2img with Stage C.
1 year ago
dccca1daa5
Fix gligen lowvram mode.
1 year ago
8b60d33bb7
Add ModelSamplingStableCascade to control the shift sampling parameter.
...
shift is 2.0 by default on Stage C and 1.0 by default on Stage B.
1 year ago
6bcf57ff10
Fix attention masks properly for multiple batches.
1 year ago
11e3221f1f
fp8 weight support for Stable Cascade.
1 year ago
f8706546f3
Fix attention mask batch size in some attention functions.
1 year ago
3b9969c1c5
Properly fix attention masks in CLIP with batches.
1 year ago
5b40e7a5ed
Implement shift schedule for cascade stage C.
1 year ago
929e266f3e
Manual cast for bf16 on older GPUs.
1 year ago
6c875d846b
Fix clip attention mask issues on some hardware.
1 year ago
805c36ac9c
Make Stable Cascade work on old pytorch 2.0
1 year ago
f2d1d16f4f
Support Stable Cascade Stage B lite.
1 year ago
0b3c50480c
Make --force-fp32 disable loading models in bf16.
1 year ago
97d03ae04a
StableCascade CLIP model support.
1 year ago
667c92814e
Stable Cascade Stage B.
1 year ago
f83109f09b
Stable Cascade Stage C.
1 year ago
5e06baf112
Stable Cascade Stage A.
1 year ago
aeaeca10bd
Small refactor of is_device_* functions.
1 year ago
38b7ac6e26
Don't init the CLIP model when the checkpoint has no CLIP weights.
1 year ago
7dd352cbd7
Merge branch 'feature_expose_discard_penultimate_sigma' of https://github.com/blepping/ComfyUI
1 year ago
f44225fd5f
Fix infinite while loop being possible in ddim_scheduler
1 year ago
25a4805e51
Add a way to set different conditioning for the controlnet.
1 year ago
a352c021ec
Allow custom samplers to request discard penultimate sigma
1 year ago
c661a8b118
Don't use numpy for calculating sigmas.
1 year ago
236bda2683
Make minimum tile size the size of the overlap.
1 year ago
66e28ef45c
Don't use is_bf16_supported to check for fp16 support.
1 year ago
24129d78e6
Speed up SDXL on 16xx series with fp16 weights and manual cast.
1 year ago
4b0239066d
Always use fp16 for the text encoders.
1 year ago
da7a8df0d2
Put VAE key name in model config.
1 year ago
89507f8adf
Remove some unused imports.
1 year ago
05cd00695a
typo fix - calculate_sigmas_scheduler ( #2619 )
...
self.scheduler -> scheduler_name
Co-authored-by: Lt.Dr.Data <lt.dr.data@gmail.com>
1 year ago
4871a36458
Cleanup some unused imports.
1 year ago
78a70fda87
Remove useless import.
1 year ago
d76a04b6ea
Add unfinished ImageOnlyCheckpointSave node to save a SVD checkpoint.
...
This node is unfinished, SVD checkpoints saved with this node will
work with ComfyUI but not with anything else.
1 year ago
f9e55d8463
Only auto enable bf16 VAE on nvidia GPUs that actually support it.
1 year ago
2395ae740a
Make unclip more deterministic.
...
Pass a seed argument note that this might make old unclip images different.
1 year ago
53c8a99e6c
Make server storage the default.
...
Remove --server-storage argument.
1 year ago
977eda19a6
Don't round noise mask.
1 year ago
10f2609fdd
Add InpaintModelConditioning node.
...
This is an alternative to VAE Encode for inpaint that should work with
lower denoise.
This is a different take on #2501
1 year ago
1a57423d30
Fix issue when using multiple t2i adapters with batched images.
1 year ago
6a7bc35db8
Use basic attention implementation for small inputs on old pytorch.
1 year ago
235727fed7
Store user settings/data on the server and multi user support ( #2160 )
...
* wip per user data
* Rename, hide menu
* better error
rework default user
* store pretty
* Add userdata endpoints
Change nodetemplates to userdata
* add multi user message
* make normal arg
* Fix tests
* Ignore user dir
* user tests
* Changed to default to browser storage and add server-storage arg
* fix crash on empty templates
* fix settings added before load
* ignore parse errors
1 year ago
c6951548cf
Update optimized_attention_for_device function for new functions that
...
support masked attention.
1 year ago
aaa9017302
Add attention mask support to sub quad attention.
1 year ago
0c2c9fbdfa
Support attention mask in split attention.
1 year ago
3ad0191bfb
Implement attention mask on xformers.
1 year ago
8c6493578b
Implement noise augmentation for SD 4X upscale model.
1 year ago
ef4f6037cb
Fix model patches not working in custom sampling scheduler nodes.
1 year ago
a7874d1a8b
Add support for the stable diffusion x4 upscaling model.
...
This is an old model.
Load the checkpoint like a regular one and use the new
SD_4XUpscale_Conditioning node.
1 year ago
2c4e92a98b
Fix regression.
1 year ago
5eddfdd80c
Refactor VAE code.
...
Replace constants with downscale_ratio and latent_channels.
1 year ago
a47f609f90
Auto detect out_channels from model.
1 year ago
79f73a4b33
Remove useless code.
1 year ago
1b103e0cb2
Add argument to run the VAE on the CPU.
1 year ago
12e822c6c8
Use function to calculate model size in model patcher.
1 year ago
comfyanonymous
Janek Mann
Dr.Lt.Data
Simon Lui
Dango233
JettHu
Chenlei Hu
Garrett Sutula
Jedrzej Kosinski
kk-89
Shiimizu
logtd
blepping
pythongosssss