smZNodes
A selection of custom nodes for ComfyUI.
Contents
CLIP Text Encode++
<p align="center"> <div class="row"> <p align="center"> <img width="1255" alt="Clip Text Encode++ – Default settings on stable-diffusion-webui" src="https://github.com/shiimizu/ComfyUI_smZNodes/assets/54494639/ec85fd20-2b83-43cd-9f19-5aba34034e2a"> </div> </p>CLIP Text Encode++ can generate identical embeddings from stable-diffusion-webui for ComfyUI.
This means you can reproduce the same images generated from stable-diffusion-webui
on ComfyUI
.
Simple prompts generate identical images. More complex prompts with complex attention/emphasis/weighting may generate images with slight differences. In that case, you can try using the Settings
node to match outputs.
Features
- Prompt editing
AND
keyword (similar to the ConditioningCombine node)BREAK
keyword (same as the ConditioningConcat node)- Weight normalization
- Optional
embedding:
identifier
Comparisons
These images can be dragged into ComfyUI to load their workflows. Each image is done using the Silicon29 (in SD v1.5) checkpoint with 18 steps using the Heun sampler.
|stable-diffusion-webui|A1111 parser|Comfy parser| |:---:|:---:|:---:| | | | | | | | |
Image slider links:
- https://imgsli.com/MTkxMjE0
- https://imgsli.com/MTkxMjEy
Options
|Name|Description|
| --- | --- |
| parser
| The parser to parse prompts into tokens and then transformed (encoded) into embeddings. Taken from SD.Next. |
| mean_normalization
| Whether to take the mean of your prompt weights. It's true
by default on stable-diffusion-webui
.<br>This is implemented according to how it is in stable-diffusion-webui
. |
| multi_conditioning
| <blockquote> For each prompt, the list is obtained by splitting the prompt using the AND
separator. <br>See: Compositional Visual Generation with Composable Diffusion Models </blockquote> <ul><li>a way to use multiple prompts at once</li><li>supports weights for prompts: a cat :1.2 AND a dog AND a penguin :2.2
(for non-comfy parsers). The weights default to 1</li><li>each prompt gets a cfg value of cfg * weight / N
, where N
is the number of positive prompts. In stable-diffusion-webui
, each prompt gets a cfg value of cfg * weight
. To match their behaviour, you can add a weight of :N
to every prompt or simply set a cfg value of cfg * N
</li></ul> |
|use_old_emphasis_implementation
| <blockquote>Use old emphasis implementation. Can be useful to reproduce old seeds.</blockquote>|
<br>[!TIP]
You can right click the node to show/hide some of the widgets. E.g. thewith_SDXL
option.
| Parser | Description |
| ----------------- | -------------------------------------------------------------------------------- |
| comfy
| The default way ComfyUI
handles everything |
| comfy++
| Uses ComfyUI
's parser but encodes tokens the way stable-diffusion-webui
does, allowing to take the mean as they do. |
| A1111
| The default parser used in stable-diffusion-webui
|
| full
| Same as A1111
but whitespaces, newlines, and special characters are stripped |
| compel
| Uses compel
|
| fixed attention
| Prompt is untampered with |
[!IMPORTANT]
Everyparser
exceptcomfy
usesstable-diffusion-webui
's encoding pipeline.
[!WARNING]
LoRA syntax (<lora:name:1.0>
) is not suppprted.
Settings
<div align="center"> <img width="1262" alt="Settings-node-showcase" src="https://github.com/shiimizu/ComfyUI_smZNodes/assets/54494639/37b50faa-81f4-41b1-88ec-2b28e9c5708e"> <p>Settings node showcase</p> </div>The Settings
node is a dynamic node functioning similar to the Reroute node and is used to fine-tune results during sampling or tokenization. The inputs can be replaced with another input type even after it's been connected. CLIP
inputs only apply settings to CLIP Text Encode++. Settings apply locally based on its links just like nodes that do model patches. I made this node to explore the various settings found in stable-diffusion-webui
.
This node can change whenever it is updated, so you may have to recreate it to prevent issues. Settings can be overridden by using another Settings
node somewhere past a previous one. Right click the node for the Hide/show all descriptions
menu option.
Tips to get reproducible results on both UIs
- Use the same seed, sampler settings, RNG (CPU or GPU), clip skip (CLIP Set Last Layer), etc.
- Ancestral and SDE samplers may not be deterministic.
- If you're using
DDIM
as your sampler, use theddim_uniform
scheduler. - There are different
unipc
configurations. Adjust accordingly on both UIs.
FAQs
- How does this differ from
ComfyUI_ADV_CLIP_emb
?- While the weights are normalized in the same manner, the tokenization and encoding pipeline that's taken from stable-diffusion-webui differs from ComfyUI's. These small changes add up and ultimately produces different results.
- Where can I learn more about how ComfyUI interprets weights?
- https://comfyanonymous.github.io/ComfyUI_examples/faq/
- https://blenderneko.github.io/ComfyUI-docs/Interface/Textprompts/
- comfyui.creamlab.net
Installation
Three methods are available for installation:
- Load via ComfyUI Manager
- Clone the repository directly into the extensions directory.
- Download the project manually.
Load via ComfyUI Manager
<div align="center"> <img width="1207" alt="ComfyUI Manager" src="https://github.com/shiimizu/ComfyUI_smZNodes/assets/54494639/310d934d-c8db-4c4a-af2a-7a26938eb751"> <p>Install via ComfyUI Manager</p> </div>Clone Repository
cd path/to/your/ComfyUI/custom_nodes
git clone https://github.com/shiimizu/ComfyUI_smZNodes.git
Download Manually
- Download the project archive from here.
- Extract the downloaded zip file.
- Move the extracted files to
path/to/your/ComfyUI/custom_nodes
. - Restart ComfyUI
The folder structure should resemble: path/to/your/ComfyUI/custom_nodes/ComfyUI_smZNodes
.
Update
To update the extension, update via ComfyUI Manager or pull the latest changes from the repository:
cd path/to/your/ComfyUI/custom_nodes/ComfyUI_smZNodes
git pull