Hey all, new to this and pretty amazed at the quaity of the text to photos I’m getting. Working to create players on a baseball team. What is way to add grass stains or dirt from sliding to a uniform?Only a little dust shows up no matter what I prompt, and usually there’s nothing. Doesn’t seem to want to put a stain on white pants, lol. Any ideas? thx
Stable Diffusion works by converting purely random noise to an image that matches the prompt.
The reason for this is because Stable Diffusion was trained with billions of existing image + description pairs.
A little bit of “noise” was added to each image and Stable Diffusion was tasked to modify itself so it could “fill in the gaps” , until it reached a point where it could convert pure noise to an image using a prompt.
The random noise is generated from the seed.
The image generation process is deterministic , so same seed for a given prompt => same image.
Best not bother with the seeds IMO.
Seeds are only ever useful when you want to demonstrate/compare stuff.
If you get a good image , it’s better to copy paste the start of the prompt and shift around the stuff at the end.
Given the “left-to-right” rule , the first two tokens are the most important thing in your prompt.
Ideally , you want to keep those two tokens as vague as possible , e.g instead of “dog with red ball” you write “look at this dog with a red ball here” , or something.
Note that I added the token “here” at the end as well , so we get the association “ball->here” in addition to the “red->ball” .
TLDR : "vague stuff A " “the prompt” “vague stuff B” ,
is sort of how you want to style the prompt.
If image is good , keep “vague stuff A” and shift “vague stuff B” around .
// — //
Also note that I’m writing this just to show how it works. There is no “correct” way to prompt.
There is more stuff related to tokens and cross-attention but I’m skipping it because I don’t want to write more.
But you can see it’s kind of a large subject :)
and i have no idea about tokens nor seeds lol! you clearly are the tokenmaster tho
about to delve in to seeds right now tho and post back what i learn
i’ve learned b4 that generating an image with the same seed comes out more ‘not identical’ the more tokens are used even tho it is said they are identical.
just now i made image 1 seed 1, image 2 seed 2, etc up to seed 6.
first prompt was ‘cute kitty’
notice the extradark kitty in top right
i did this once on one of Vione’s generators and got the EXACT same person wearing a different outfit.
my guess is the top right seed has a little bit more dark pixels in a certain region than the other pictures. I have tended to agree with adComfortable and not even included seed options in my generators, and it seems very easy to entirely change the entire picture with a single change or addition of a word, tho nice topic and i will probably get back to you in a week after having added the ability to save seeds of good images and then mess with them and see just how buildable or not buildable they are while keeping the soul coherent.
cute kitty top right also prefers right paw forward
Cool!
One minor thing I forgot to say ; the “noise” isn’t pixels in an image.
The “noise” is a purely mathematical abstract concept here , commonly referred as latent noise .
I have no idea if saving the seed for a “good image” will yield the similiar “good results” with a different prompt.
I’d be happy to hear if you discover something :)!
In my generator I use a different approach by pre-rendering the image with the “Base”-prompt , switching over to the “Main” prompt after 10% of the generation steps (be default).
Unlike seeds , that is actually a partially rendered image which is filled in. So this is another option to use.
wow! sounds like an entire artform you are tapped in to
Definitely something to using the same seed to retain the same character.
even switching some words toward the front around (adding ‘oceanic’ as the second word to see if i could turn the blue to water) kept large amounts of the image, including the character, mostly the same.
it is surprisingly easy to keep large chunks the same. definite more to explore
that is ‘master planner girl’. didn’t say anything about her hair color nor style, yet something is holding it the same on the same seed. tho also even with identical seed and prompt it seems generating 6 pics results in 4 or 5 slightly different ones with, for master planner girl, the one where she is looking forward and slightly to the side being her two main image types
base prompt is highly complex too: Monstrous supercutie, very nonhuman, extremely alien yet beautiful, absolutely beautiful, otherworldly, (((absolutely beautiful))), glowing, smiling, intricately detailed, high definition, beautiful, beautiful lighting, masterpiece, dramatic pose, sleek, detailed, (((((beautiful face))))), exquisite detail, backlit, absolute masterpiece, iridescent, beautiful details, heartwarming, glorious, exotic, exquisite, beautiful colors, 8k, in the styles of the artists Michal Lisowski, John Berkey, Odilon Redon, Alfred Kubin, Yayoi Kusama, John Blanche, Tomma Abts, Francesco Francavilla, Duncan Grant, Brian Froud, Francesco Francavilla, Emmanuel Shiu, , Cinematic, fate, mystical, inspiring, spirit, enlightened, fey, masterpiece, best quality, high quality (seed:::26347707)
antiprompt: photo, ((words)), (((logo))), triple-breasted, (username), (((text))), ((subtitle)), (collar), (title), ((gruesome)), fused limbs, three legs, inaccurate hands, (long neck), ((extralong neck)), very long neck, incorrect fingers, ((blood)), ((gore)), ((horror)), (Zombie), ((evil)), distorted thumb, distorted fingers, distorted features, photography, two-headed, distorted butt, three arms, three legs, distorted crotch, wrong anatomy, distorted anatomy, fused bodies, mutant, error, discolored, distorted nose, ugly nose, distant distorted face, distorted face, distorted eyes, distorted lips, frown, username, facebook, youtube, unhealthy, mad, unhappy, morbid, ugly philtrum, distorted philtrum, jpeg artifacts, bad anatomy, mutant, gross, horror, bad dream, horrific, terrible, ugly, scary, bloody, bad propoertions, lowres, distorted face, ugly face, blurry, bad, bad art, low quality, worst qualitybad, terrible, blood, nazi, the worst ever, ugly, very ugly, unhappy, distorted, nightmarish, worst, earings, fire, ugly, misshapen, extra limbs, extra fingers, signature, choker, bad, ugly face, distorted, long thumb, terrible, jagged, blurred, watermark, red eyes, swimming, misshapen book, misshapen, misshapen fingers, distorted fingers, wrong number of fingers, misshapen legs, distorted legs, long neck, wrong number of legs, distorted face, distorted knee, awkward, horrid, wrong number of fingers, weird neck, Blurry image, bad quality, watermark, bad image, low quality, deformed, blurry, bad art, incorrect anatomy, ugliness, ugly, horrible resolutions, low DPI, low PPI, bad character positioning, absurd anatomy, pixelization, low pixel count, blurry, low-res face, low poly, Poorly Drawn Characters, Badly Drawn Eyes, Badly Drawn Mouth, Badly Drawn Ears, Badly Drawn Nose, Badly Drawn Hands, Badly Drawn Feet, Badly Drawn Legs, Badly Drawn Hair, Badly Drawn Clothing, bad anatomy, (ugly), missing arms, bad proportions, missing legs, blurry, (poorly drawn feet), morbid, cloned face, ((extra limbs)), (mutated hands), cropped, (disfigured), mutation, deformed, (mutilated), dehydrated, body out of frame, out of frame, (disfigured), ((bad anatomy)), (poorly drawn face), duplicate, cut off, (poorly drawn hands), (error), low contrast, (signature), (extra arms), underexposed, text, (extra fingers), overexposed, (too many fingers), (extra legs), bad art, ugly, (extra limbs), beginner, username, (fused fingers), amateur, (distorted face), worst quality, jpeg artifacts, low quality, (malformed limbs), low-res, (poorly Rendered face), low resolution, low saturation, (bad composition), (deformed body features), messed up fingers,(((choker))), (((earings))), messed up, (poorly rendered hands), (((deformed))), blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, (extra_limb), (ugly), (poorly drawn hands), fused fingers, messy drawing, broken legs censor, censored, censor_bar, multiple breasts, (mutated hands and fingers:1.5), (long body :1.3), (mutation, poorly drawn :1.2), black-white, bad anatomy, liquid body, liquidtongue, disfigured, malformed, mutated, anatomical nonsense, text font ui, error, malformed hands, long neck, blurred, lowers, low res, bad anatomy, bad proportions, bad shadow, uncoordinated body, unnatural body, fused breasts, bad breasts, huge breasts, poorly drawn breasts, extra breasts, liquid breasts, heavy breasts, missingbreasts, huge haunch, huge thighs, huge calf, bad hands, fused hand, missing hand, disappearing arms, disappearing thigh, disappearing calf, disappearing legs, fusedears, bad ears, poorly drawn ears, extra ears, liquid ears, heavy ears, missing ears, old photo, low res, black and white, black and white filter, colorless, (((deformed))), blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, (extra_limb), (ugly), (poorly drawn hands), fused fingers, messy drawing, broken legs censor, censored, censor_bar, multiple breasts, (mutated hands and fingers:1.5), (long body :1.3), (mutation, poorly drawn :1.2), black-white, bad anatomy, liquid body, liquid tongue, disfigured, malformed, mutated, anatomical nonsense, text font ui, error, malformed hands, long neck, blurred, lowers, low res, bad anatomy, bad proportions, bad shadow, uncoordinated body, unnatural body, fused breasts, bad breasts, huge breasts, poorly drawn breasts, extra breasts, liquid breasts, heavy breasts, missing breasts, huge haunch, huge thighs, huge calf, bad hands, fused hand, missing hand, disappearing arms, disappearing thigh, disappearing calf, disappearing legs, fused ears, bad ears, poorly drawn ears, extra ears, liquid ears, heavy ears, missing ears, old photo, low res, black and white, black and white filter, colorless, (((deformed))), blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, (extra_limb), (ugly), (poorly drawn hands), fused fingers, messy drawing, broken legs censor, censored, censor_bar, multiple breasts, (mutated hands and fingers:1.5), (long body :1.3), (mutati
somehow in all that i can change a few words while keeping the seed the same and it generates relatively the same person. definite definite more to explore in seeds and keeping characters
Thanks :)! I hardly use seeds at all so I’d be happy to hear if you discover a cool usage for them
Also; I have token-word generators , if you wish to use them for your image generator.
Here is the common-token generator : https://perchance.org/fusion-sd15-clip-tokens-common
There are 5 sets based on their ID number ( their prevalence in the training data) ; common , average , rare , weird , exotic .
I use them in my generator but here is a version made by Vionet20 which I think is much better for demonstration purposes : https://perchance.org/prompts-from-tokens