One Button Prompt
Summary
One Button Prompt is a tool/script for Automatic1111/ComfyUI/RuinedFooocus for beginners who have problems writing a good prompt, or advanced users who want to get inspired.
It generates an entire prompt from scratch. It is random, but controlled. You simply load up the script and press generate, and let it surprise you.
It is a full AI prompt generator for Stable Diffusion.
It is best used on all-purpose models, such as Stable Difussion 1.5 or SDXL type models. However, feel free to use it on your personal favorite models.
A simple user guide for first time use and settings is available here.
It is also now available as a custom node for ComfyUI. Check installation doc here
More of a Fooocus fan? Take a look at this excellent fork called RuinedFooocus that has One Button Prompt built in. Check some options available here
Any other AI tool you are using? Midjourney? Dalle? No problem, I got it working on a website here. Just copy the prompt to your clipboard with a click, and paste it in any image generator tool.
Features
- Full prompt generation with the click of a button. ==> guide to my first generation
- Supports TXT2IMG, IMG2IMG, ControlNET, inpainting and latent couple. ==> guide to IMG2IMG and ControlNET
- Save your favorite generation settings with presets. ==> One Button Presets
- Workflow assist, generate multiple prompts with One Button. Create prompt variants with ease. ==> guide to workflow assist and prompt variant mode
- Create infinite variations of a chosen subject. ==> guide to override subject
- Fully automated generation, classification and upscaling. ==> guide to one_button_run_and_upscale
- Add LoRA's, customize lists and personal artists choices. ==> guide to custom files
- Use Anime Model mode to generate prompts specific for use with anime/pony models ==> guide to Anime Mode
- Compound multiple prompts together for unexpected results. ==> guide to prompt compounder
- Use wildcards, or combine with Dynamic Prompts extension ==> guide to using wildcards and Dynamic Prompts
- Has a set of template prompts from various sources, fully wildcarded and usable with Subject Override ==> guide to prompt templates
- Has multiple prompt generation modes to choose from ==> guide to prompt generation modes
- Integration is available with the superprompt-v1 model ==> guide to super prompt
- Stay in control, and fine-tune One Button Prompt with a config file ==> config file
- Flufferize your prompt to enhance your results with Prompt Magic
Important Notice
One Button Prompt had a recent large change in the UI when Presets were introduced. This might be confusing for long time users.
If you are not finding the settings, change the "One Button Preset" to "Custom...".
<img src="https://github.com/AIrjen/OneButtonPrompt/assets/130234949/6d821c82-edf9-4496-867f-ac01dda994cd.png" width="50%" height="50%">Subtypes are also completely gone now, and integrated into the subject field.
Loading the first time after upgrading on ComfyUI might give some errors, because the fields have shifted. Just set the settings back.
How to use in automatic1111/SD.next
In TXT2IMG or IMG2IMG, select the script "One Button Prompt".
<img src="https://github.com/AIrjen/OneButtonPrompt/assets/130234949/b43f7bef-533d-4139-a477-562a0b2d39ca.png" width="50%" height="50%">Leave the prompts empty:
<img src="https://user-images.githubusercontent.com/130234949/230793068-d38bc782-4c2f-4268-9e91-76f4eabe3eca.png" alt="who needs prompts anyway" width="50%" height="50%">Hit Generate!
<img src="https://user-images.githubusercontent.com/130234949/230793086-cedbe72a-e1eb-46e5-a425-4a52540847f6.png" alt="click!" width="30%" height="30%">Enjoy creating awesome pictures: <img src="https://github.com/AIrjen/OneButtonPrompt/assets/130234949/aa0ff559-03a9-49be-bbe5-94789f8102a0.png" alt="wow, good job you!">
stylized by Waterhouse, John Constable, Ed Blinkey, Atey Ghailan, Studio Ghibli, Jeremy Mann, Greg Manchess, Antonio Moro and makoto shinkai, landscape of a Atmospheric (Lazarus Labs:1.1) , from inside of a Furious Stargate, Ultrarealistic, extremely hyper aesthetic
Please be aware, that not each picture will be awesome due to the randomness of the prompt, artist and model used. You might get an epic landscape, or a photo of an Aggregavated Trout. In my experience, about 1 in 5 is good. Everyone of them is interesting.
Don't get overwhelmed by the options, they will become more clear once you use it more.
For first time users, play around with the set presets.
Some more examples below. And check the first time user guide here.
Some details
It will generate between 0 and 3 artists, and add those the prompt.
It can generate the following subjects, while building a prompt:
-
object - Can be a random object, a building ,a vehicle, some food or objects from space.
-
animal - A random (fictional) animal. Has a chance to have human characteristics, such as clothing added.
-
humanoid - A random humanoid, males, females, fantasy types, fictional and non-fictional characters. Can add clothing, features and a bunch of other things.
-
landscape - A landscape or a landscape with a building.
-
concept - Can be a concept, such as "the X of Y", or an historical event such as "The Trojan War". It can also do a line from a poem or from a song.
It mixes techniques such as prompt switching and hybrids.
This generator will generate a complete full prompt for you, based on randomness. You can increase the slider, to include more things to put into the prompt. Recommended is keeping it around 3-7. Use 10 at your own risk.
There are a lot of special things build in, based on various research. Just try it, and let it surprise you.
Suggestion is to leave the prompt field empty, anything here will be added at the end of the generated prompt.
It doesn't add anything to the negative prompt field, so feel free to add your favorite negative prompts here.
For each Batch you run, it will create a new prompt. For each batch size, it will reuse the same prompt.
Installing in automatic1111
One Button Prompt can be found in the normal installation list of Automatic1111. Go to Extension -> Available and press Load From. In the list you will see One Button Prompt, and press install.
If you want to do it manually,sSimply install this from via install from URL. After that you can see OneButtonPrompt in the script fields for txt2img and img2img. Set the following URL to install from: https://github.com/AIrjen/OneButtonPrompt
<img src="https://user-images.githubusercontent.com/130234949/230917712-60a3c1f4-fea6-4ecd-bc68-da52f1ff86fe.png" alt="Easy to install" width="50%" height="50%">You can also download the files from github directly, and place them under your automatic1111 installation in the \Extensions\ folder.
Main tab
The main tab will show preset options, which are preset generation settings which will help achieve good results. On default, it is set to Standard, which was the previous default setting of One Button Prompt. It is quite random and give some wild results.
If you are looking for more guided results, choose a different preset. Some good first choices are:
- Standard -> One Button Prompts default. Wild and unpredictable. Good for prompt exploration.
- Unique People Portraits -> Will focus on generating photographic people
- D&D Style Portraits -> Will focus on generating fantasy style portraits
- Consistent Results -> Running on a large set of build in styles, to get consistent results in prompts. Works best on SDXL.
- Greg Mode - The Preset -> Focusses on creating characters, mixed with popular artists (like Greg Rutkowski). Works best on SD 1.5 models.
If you want to change the settings yourself, please change the One Button Preset to "Custom...". This will load in all the settings to be adjusted.
Insanity level. You can increase the slider, to include more things to put into the prompt. Recommended is keeping it around 3-7. Use 10 at your own risk. I usually run it between 5 and 7.
You an use the Subject Types filter to select on main subject types to generate. Maybe you want only Landscapes, maybe you want only people. Select it here.
Artists have a major impact on the result. Automatically, it will select between 0-3 artists out of 3483 artists for your prompt. You can turn it off. Add your own artists to the prompt, and they will be added to the end of the prompt.
Type of image can be used to force a certain direction. For example when using Realistic Vision, it might be a good idea to set it to photograph. For an anime model, you might want to use "all - anime"
Special image type modes have chance to trigger. Those follow different rules of prompt generation.
When you fill in the Overwrite subject field, that subject will be used to build the dynamic prompt around. It is best, if you set the subject type to match the subject. For example, set it to humanoid if you place a person in the override subject field.
This way, you can create unlimited variants of a subject.
Smart subject tries to determine what to and not to generate based on your subject. Example, if your Overwrite subject is formed like this: Obese man wearing a kimono.
It will then recognize the body type and not generate it. It also recognizes the keyword wearing, and will not generate an outfit.
The existing prompt and negative prompt fields are ignored.
Add a prompt prefix, suffix and the negative prompt in the respective fields. They will be automatically added during processing.
These can be used to add textual inversion and LoRA's. They can also be used to add your models trigger words.
Workflow assist tab
This tab is designed to help with the workflow of adjusting and maintaining prompts without turning the extension off. "Workflow mode" turns off the generated script, and uses the Workflow prompt instead.
Use the prompt variant slider to create variants of the Workflow prompt.
It also has the options to generate a few prompts with a click and send them to the workflow prompt. This way you can search or combine interesting ideas together.
One Button Run and Upscale
Using the API feature of WebUI, this allows you to:
This will allow you to:
- Generate an image with TXT2IMG
- Can enable Hi res. fix
- Possible to set up a Quality Gate, so only the best images get upscaled
- Possible to ignore the One Button Prompt generation, and use your own prompts
- Upscale that image with IMG2IMG
- This proces can be repeated. Loopback enabled.
- Supports SD Upscale, Ultimate SD Upscale and Controlnet tile_resample methods of upscaling
- Upscale with EXTRAS
- Possiblities for just upscale existing images
All with a single press of One Button.
roadmap
Some ideas I'd like to implement:
- Ongoing: list refinements and new features in the prompt generation
- Ongoing: Documentation and toturials
If you have a good idea or suggestion, let me know, or build it yourself ;)
Prompts and examples
video game concept art, 2d game art, concept art, landscape of a Kokiri Forest, it is Tribal, Sun in the sky, designed by Atey Ghailan, detailed, masterpiece, Deathpunk, 35mm, Polychromatic, digital art, contemporary fine detail, stunning, unique, fine detail, aesthetic
small centered composition, product shot, plain background, wallpaper art, in the center is an image of an epic beautiful ("The Orb of Elegance":1.2) , foliage, at Golden hour, side lit, Colorless, warm light, dynamic dramatic atmosphere, background inspired, dynamic composition, ambient light, fine detail
colorful art by Norm Rapmund, Fatigued 25 y.o. Girl of [Rot|Music], Comic book art, dynamic, detailed, portrait art by Brian Sum, luxurious sharp focus, highly contrasted, sunny, complex artistic color composition, magnificent, dynamic cinematic color, cool colors, beautiful composition, complimentary colors, beautiful
Pill Bug, Moon in the night, Barbiecore, Side lighting, 50mm, designed by Ilya Kuvshinov, sci-fi
photograph, buxom Girl, Appealing, dressed in headwear, the Girl has a Pink Angelic Halo, Wide view, Grim, Long exposure, Iphone X, F/5, dreamy, dream, dark, cozy, highly enhanced, intricate artistic color, beautiful elegant, confident, intricate detail
Origami, Anime, Concept art of a Shinto Foliage, Average, it is in a Star Wars setting, Narnia in background, at Dusk, (realism art designed by Agnes Martin:1.0) , natural lighting, Pastel Colors, masterpiece
(by Carne Griffiths:1.2) , Cyborg "Through the lens of poetry, ordinary moments transform into extraordinary tales of the human experience.", nature and River stone background, Bathed in shadows, Monochrome, beautiful, boring, fauna, cool colors, magnificent, modified, radiant, magical composition
Suprematism, "Worgen Infiltrator", abstract, limited color palette, geometric forms, Suprematism
attractive, Seductive Female Valkyrie, Dark matter background, fairy tale, Abstract Art, feminine
Thank you
Thank you to the amazing Stylepile and Dynamic Prompts for inspiration.
Thanks to everyone maintaining this SD artists list
Thanks to openart.ai for setting up the very helpful prompt book
Thanks to this ai art modifier guide
Everyone at the stable diffusion subreddit for inspiration and sharing workflows