ComfyUI-Inspire-Pack
This repository offers various extension nodes for ComfyUI. Nodes here have different characteristics compared to those in the ComfyUI Impact Pack. The Impact Pack has become too large now...
Notice:
- V0.73 The Variation Seed feature is added to Regional Prompt nodes, and it is only compatible with versions Impact Pack V5.10 and above.
- V0.69 incompatible with the outdated ComfyUI IPAdapter Plus. (A version dated March 24th or later is required.)
- V0.64 add sigma_factor to RegionalPrompt... nodes required Impact Pack V4.76 or later.
- V0.62 support faceid in Regional IPAdapter
- V0.48 optimized wildcard node. This update requires Impact Pack V4.39.2 or later.
- V0.13.2 isn't compatible with old ControlNet Auxiliary Preprocessor. If you will use
MediaPipeFaceMeshDetectorProvider
update to latest version(Sep. 17th). - WARN: If you use version 0.12 to 0.12.2 without a GlobalSeed node, your workflow's seed may have been erased. Please update immediately.
Nodes
Lora Block Weight - This is a node that provides functionality related to Lora block weight.
- This provides similar functionality to sd-webui-lora-block-weight
LoRA Loader (Block Weight)
: When loading Lora, the block weight vector is applied.- In the block vector, you can use numbers, R, A, a, B, and b.
- R is determined sequentially based on a random seed, while A and B represent the values of the A and B parameters, respectively. a and b are half of the values of A and B, respectively.
XY Input: LoRA Block Weight
: This is a node in the Efficiency Nodes' XY Plot that allows you to use Lora block weight.- You must ensure that X and Y connections are made, and dependencies should be connected to the XY Plot.
- Note: To use this feature, update
Efficient Nodes
to a version released after September 3rd.
- Make LoRA Block Weight: Instead of directly applying the LoRA Block Weight to the MODEL, it is generated in a separate LBW_MODEL form
- Apply LoRA Block Weight: Apply LBW_MODEL to MODEL and CLIP
- Save LoRA Block Weight: Save LBW_MODEL as a .lbw.safetensors file
- Load LoRA Block Weight: Load LBW_MODEL from .lbw.safetensors file
SEGS Supports nodes - This is a node that supports ApplyControlNet (SEGS) from the Impact Pack.
OpenPose Preprocessor Provider (SEGS)
: OpenPose preprocessor is applied for the purpose of using OpenPose ControlNet in SEGS.- You need to install ControlNet Auxiliary Preprocessors to use this.
Canny Preprocessor Provider (SEGS)
: Canny preprocessor is applied for the purpose of using Canny ControlNet in SEGS.DW Preprocessor Provider (SEGS)
,MiDaS Depth Map Preprocessor Provider (SEGS)
,LeReS Depth Map Preprocessor Provider (SEGS)
,MediaPipe FaceMesh Preprocessor Provider (SEGS)
,HED Preprocessor Provider (SEGS)
,Fake Scribble Preprocessor (SEGS)
,AnimeLineArt Preprocessor Provider (SEGS)
,Manga2Anime LineArt Preprocessor Provider (SEGS)
,LineArt Preprocessor Provider (SEGS)
,Color Preprocessor Provider (SEGS)
,Inpaint Preprocessor Provider (SEGS)
,Tile Preprocessor Provider (SEGS)
,MeshGraphormer Depth Map Preprocessor Provider (SEGS)
MediaPipeFaceMeshDetectorProvider
: This node providesBBOX_DETECTOR
andSEGM_DETECTOR
that can be used in Impact Pack's Detector using theMediaPipe-FaceMesh Preprocessor
of ControlNet Auxiliary Preprocessors.
A1111 Compatibility support - These nodes assists in replicating the creation of A1111 in ComfyUI exactly.
KSampler (Inspire)
: ComfyUI uses the CPU for generating random noise, while A1111 uses the GPU. One of the three factors that significantly impact reproducing A1111's results in ComfyUI can be addressed usingKSampler (Inspire)
.- Other point #1 : Please make sure you haven't forgotten to include 'embedding:' in the embedding used in the prompt, like 'embedding:easynegative.'
- Other point #2 : ComfyUI and A1111 have different interpretations of weighting. To align them, you need to use BlenderNeko/Advanced CLIP Text Encode.
KSamplerAdvanced (Inspire)
: Inspire Pack version ofKSampler (Advanced)
.RandomNoise (inspire)
: Inspire Pack version ofRandomNoise
.- Common Parameters
batch_seed_mode
determines how seeds are applied to batch latents:comfy
: This method applies the noise to batch latents all at once. This is advantageous to prevent duplicate images from being generated due to seed duplication when creating images.incremental
: Similar to the A1111 case, this method incrementally increases the seed and applies noise sequentially for each batch. This approach is beneficial for straightforward reproduction using only the seed.variation_strength
: In each batch, the variation strength starts from the setvariation_strength
and increases byxxx
.
variation_seed
andvariation_strength
- Initial noise generated by the seed is transformed to the shape ofvariation_seed
byvariation_strength
. Ifvariation_strength
is 0, it only relies on the influence of the seed, and ifvariation_strength
is 1.0, it is solely influenced byvariation_seed
.- These parameters are used when you want to maintain the composition of an image generated by the seed but wish to introduce slight changes.
Sampler nodes
KSampler Progress (Inspire)
- In KSampler, the sampling process generates latent batches. By usingVideo Combine
node from ComfyUI-VideoHelperSuite, you can create a video from the progress.Scheduled CFGGuider (Inspire)
- This is a CFGGuider that adjusts the schedule from from_cfg to to_cfg using linear, log, and exp methods.Scheduled PerpNeg CFGGuider (Inspire)
- This is a PerpNeg CFGGuider that adjusts the schedule from from_cfg to to_cfg using linear, log, and exp methods.
Prompt Support - These are nodes for supporting prompt processing.
Load Prompts From Dir (Inspire)
: It sequentially reads prompts files from the specified directory. The output it returns is ZIPPED_PROMPT.- Specify the directories located under
ComfyUI-Inspire-Pack/prompts/
- One prompts file can have multiple prompts separated by
---
. - e.g.
prompts/example
- Specify the directories located under
Load Prompts From File (Inspire)
: It sequentially reads prompts from the specified file. The output it returns is ZIPPED_PROMPT.- Specify the file located under
ComfyUI-Inspire-Pack/prompts/
- e.g.
prompts/example/prompt2.txt
- Specify the file located under
Unzip Prompt (Inspire)
: Separate ZIPPED_PROMPT intopositive
,negative
, and name components.positive
andnegative
represent text prompts, whilename
represents the name of the prompt. When loaded from a file usingLoad Prompts From File (Inspire)
, the name corresponds to the file name.
Zip Prompt (Inspire)
: Create ZIPPED_PROMPT from positive, negative, and name_opt.- If name_opt is omitted, it will be considered as an empty name.
Prompt Extractor (Inspire)
: This node reads prompt information from the image's metadata. Since it retrieves all the text, you need to directly specify the prompts to be used forpositive
andnegative
as indicated in the info.Global Seed (Inspire)
: This is a node that controls the global seed without a separate connection line. It only controls when the widget's name is 'seed' or 'noise_seed'. Additionally, if 'control_before_generate' is checked, it controls the seed before executing the prompt.- Seeds that have been converted into inputs are excluded from the target. If you want to control the seed separately, convert it into an input and control it separately.
Global Sampler (Inspire)
: This node is similar to GlobalSeed and can simultaneously set the sampler_name and scheduler for all nodes in the workflow.- It applies only to nodes that have both sampler_name and scheduler, and it won't be effective if
GlobalSampler
is muted. - If some of the
sampler_name
andscheduler
have been converted to input and connected to Primitive node, it will not apply only to the converted widget. The widget that has not been converted to input will still be affected.
- It applies only to nodes that have both sampler_name and scheduler, and it won't be effective if
Bind [ImageList, PromptList] (Inspire)
: Bind Image list and zipped prompt list to exportimage
,positive
,negative
, andprompt_label
in a list format. If there are more prompts than images, the excess prompts are ignored, and if there are not enough, the remainder is filled with default input based on the images.Wildcard Encode (Inspire)
: The combination node of ImpactWildcardEncode and BlenderNeko's CLIP Text Encode (Advanced).- To use this node, you need both the Impact Pack and the Advanced CLIP Text Encode extensions.
- This node is identical to
ImpactWildcardEncode
, but it encodes usingCLIP Text Encode (Advanced)
instead of the default CLIP Text Encode from ComfyUI for CLIP Text Encode. - Requirement: Impact Pack V4.18.6 or above
Prompt Builder (Inspire)
: This node is a convenience node that allows you to easily assemble prompts by selecting categories and presets. To modify the presets, edit theComfyUI-InspirePack/resources/prompt-builder.yaml
file.Seed Explorer (Inspire)
: This node helps explore seeds by allowing you to adjust the variation seed gradually in a prompt-like form.- This feature is designed for utilizing a seed that you like, adding slight variations, and then further modifying from there when exploring.
- In the
seed_prompt
, the first seed is considered the initial seed, and the reflection rate is omitted, always defaulting to 1.0. - Each prompt is separated by a comma, and from the second seed onwards, it should follow the format
seed:strength
. - Pressing the "Add to prompt" button will append
additional_seed:additional_strength
to the prompt.
Composite Noise (Inspire)
: This node overwrites a specific area on top of the destination noise with the source noise.Random Generator for List (Inspire)
: When connecting the list output to the signal input, this node generates random values for all items in the list.Make Basic Pipe (Inspire)
: This is a node that creates a BASIC_PIPE using Wildcard Encode. TheAdd select to
determines whether the selected item from theSelect to...
combo will be input as positive wildcard text or negative wildcard text.Remove ControlNet (Inspire)
,Remove ControlNet [RegionalPrompts] (Inspire)
: Remove ControlNet from CONDITIONING or REGIONAL_PROMPTS.Remove ControlNet [RegionalPrompts] (Inspire)
requires Impact Pack V4.73.1 or above.
Regional Nodes - These node simplifies the application of prompts by region.
- Regional Sampler - These nodes assists in the easy utilization of the regional sampler in the
Impact Pack
.Regional Prompt Simple (Inspire)
: This node takesmask
andbasic_pipe
as inputs and simplifies the creation ofREGIONAL_PROMPTS
.Regional Prompt By Color Mask (Inspire)
: Similar toRegional Prompt Simple (Inspire)
, this function accepts a color mask image as input and defines the region using the color value that will be used as the mask, instead of directly receiving the mask.- The color value can only be in the form of a hex code like #FFFF00 or a decimal number.
- Regional Conditioning - These nodes provides assistance for simplifying the use of
Conditioning (Set Mask)
.Regional Conditioning Simple (Inspire)
Regional Conditioning By Color Mask (Inspire)
- Regional IPAdapter - These nodes facilitates the convenient use of the attn_mask feature in
ComfyUI IPAdapter Plus
custom nodes.- To use this node, you need to install the ComfyUI IPAdapter Plus extension.
Regional IPAdapter Mask (Inspire)
,Regional IPAdapter By Color Mask (Inspire)
Regional IPAdapter Encoded Mask (Inspire)
,Regional IPAdapter Encoded By Color Mask (Inspire)
: acceptembeds
instead ofimage
- Regional Seed Explorer - These nodes restrict the variation through a seed prompt, applying it only to the masked areas.
Regional Seed Explorer By Mask (Inspire)
Regional Seed Explorer By Color Mask (Inspire)
Regional CFG (Inspire)
- By applying a mask as a multiplier to the configured cfg, it allows different areas to have different cfg settings.Color Mask To Depth Mask (Inspire)
- Convert the color map from the spec text into a mask with depth values ranging from 0.0 to 1.0.- The range of the mask value is limited to 0.0 to 1.0.
- base_value: Sets the value of the base mask.
- dilation: Dilation applied to each mask layer before flattening.
- flatten_method: The method of flattening the mask layers.
- The layers are flattened including the base layer set by base_value.
- override: Each pixel is overwritten by the non-zero value of the upper layer.
- sum: Each pixel is flattened by summing the values of all layers.
- max: Each pixel is flattened by taking the maximum value from all layers.
Image Util
Load Image Batch From Dir (Inspire)
: This is almost same asLoadImagesFromDirectory
of ComfyUI-Advanced-Controlnet. This is just a modified version. Just note that this node forcibly normalizes the size of the loaded image to match the size of the first image, even if they are not the same size, to create a batch image.Load Image List From Dir (Inspire)
: This is almost same asLoad Image Batch From Dir (Inspire)
. However, note that this node loads data in a list format, not as a batch, so it returns images at their original size without normalizing the size.Load Image (Inspire)
: This node is similar to LoadImage, but the loaded image information is stored in the workflow. The image itself is stored in the workflow, making it easier to reproduce image generation on other computers.Change Image Batch Size (Inspire)
: Change Image Batch Sizesimple
: if thebatch_size
is larger than the batch size of the input image, the last frame will be duplicated. If it is smaller, it will be simply cropped.
Change Latent Batch Size (Inspire)
: Change Latent Batch SizeImageBatchSplitter //Inspire
,LatentBatchSplitter //Inspire
: The script divides a batch of images/latents into individual images/latents, each with a quantity equal to the specifiedsplit_count
. An additional output slot is added for eachsplit_count
. If the number of images/latents exceeds thesplit_count
, the remaining ones are returned as the "remained" output.Color Map To Masks (Inspire)
: From the color_map, it extracts the top max_count number of colors and creates masks. min_pixels represents the minimum number of pixels for each color.Select Nth Mask (Inspire)
: Extracts the nth mask from the mask batch.
Backend Cache - Nodes for storing arbitrary data from the backend in a cache and sharing it across multiple workflows.
Cache Backend Data (Inspire)
: Stores any backend data in the cache using a string key. Tags are for quick reference.Retrieve Backend Data (Inspire)
: Retrieves cached backend data using a string key.Remove Backend Data (Inspire)
: Removes cached backend data.- Deletion in this node only removes it from the cache managed by Inspire, and if it's still in use elsewhere, it won't be completely removed from memory.
signal_opt
is used to control the order of execution for this node; it will still run without asignal_opt
input.- When using '*' as the key, it clears all data.
Show Cached Info (Inspire)
: Displays information about cached data.- Default tag cache size is 5. You can edit the default size of each tag in
cache_settings.json
. - Runtime tag cache size can be modified on the
Show Cached Info (Inspire)
node. For example:ckpt: 10
.
- Default tag cache size is 5. You can edit the default size of each tag in
Cache Backend Data [NumberKey] (Inspire)
,Retrieve Backend Data [NumberKey] (Inspire)
,Remove Backend Data [NumberKey] (Inspire)
: These nodes are provided for convenience in the automation process, allowing the use of numbers as keys.Cache Backend Data List (Inspire)
,Cache Backend Data List [NumberKey] (Inspire)
: This node allows list input for backend cache. Conversely, nodes likeCache Backend Data [NumberKey] (Inspire)
that do not accept list input will attempt to cache redundantly and overwrite existing data if provided with a list input. Therefore, it is necessary to use a unique key for each element to prevent this. This node caches the combined list. When retrieving cached backend data through this node, the output is in the form of a list.Shared Checkpoint Loader (Inspire)
: When loading a checkpoint through this loader, it is automatically cached in the backend cache. Additionally, if it is already cached, it retrieves it from the cache instead of loading it anew.- When
key_opt
is empty, theckpt_name
is set as the cache key. The cache key output can be used for deletion purposes with Remove Back End. - This node resolves the issue of reloading checkpoints during workflow switching.
- When
Stable Cascade Checkpoint Loader (Inspire)
: This node provides a feature that allows you to load thestage_b
andstage_c
checkpoints of Stable Cascade at once, and it also provides a backend caching feature, optionally.
Conditioning - Nodes for conditionings
Concat Conditionings with Multiplier (Inspire)
: Concatenating an arbitrary number of Conditionings while applying a multiplier for each Conditioning. The multiplier depends oncomfy_PoP
, so comfy_PoP must be installed.Conditioning Upscale (Inspire)
: When upscaling an image, it helps to expand the conditioning area according to the upscale factor. Taken from ComfyUI_Dave_CustomNodeConditioning Stretch (Inspire)
: When upscaling an image, it helps to expand the conditioning area by specifying the original resolution and the new resolution to be applied. Taken from ComfyUI_Dave_CustomNode
Models - Nodes for models
IPAdapter Model Helper (Inspire)
: This provides presets that allow for easy loading of the IPAdapter related models. However, it is essential for the model's name to be accurate.- You can download the appropriate model through ComfyUI-Manager.
Util - Utilities
Float Range (Inspire)
: Create a float list that increases the value bystep
fromstart
tostop
. A list as large as the maximum limit is created, and whenensure_end
is enabled, the last value of the list becomes the stop value.ToIPAdapterPipe (Inspire)
,FromIPAdapterPipe (Inspire)
: These nodes assists in conveniently using the bundled ipadapter_model, clip_vision, and model required for applying IPAdapter.List Counter (Inspire)
: When each item in the list traverses through this node, it increments a counter by one, generating an integer value.RGB Hex To HSV (Inspire)
: Convert an RGB hex string like#FFD500
to HSV:
Credits
ComfyUI/ComfyUI - A powerful and modular stable diffusion GUI.
ComfyUI/sd-webui-lora-block-weight - The original idea for LoraBlockWeight came from here, and it is based on the syntax of this extension.
jags111/efficiency-nodes-comfyui - The XY Input
provided by the Inspire Pack supports the XY Plot
of this node.
Fannovel16/comfyui_controlnet_aux - The wrapper for the controlnet preprocessor in the Inspire Pack depends on these nodes.
Kosinkadink/ComfyUI-Advanced-Controlnet - Load Images From Dir (Inspire)
code is came from here.
Trung0246/ComfyUI-0246 - Nice bypass hack!
cubiq/ComfyUI_IPAdapter_plus - IPAdapter related nodes depend on this extension.
Davemane42/ComfyUI_Dave_CustomNode - Original author of ConditioningStretch, ConditioningUpscale
BlenderNeko/ComfyUI_Noise - slerp code for noise variation