I’ve been trying to transition from SD1.5 to SDXL for a while, but old prompting habits die hard.

Even more difficult was finding a model to produce the look I prefer. Most seem to love realism, 3D pixar style, anime, and super airbrushed.

If you have any tips for SDXL models, loras, prompting for this style, etc. please let me know!

parameters:

1girl, demon woman with bangs and ram horns and wings, holding bloody human heart, solo, sitting with knees up, (full body:0.6), looking at viewer, (dark fantasy theme:1.1) (glowing eyes:1.05), thick lines, flat shading

Negative prompt: low quality, deformed, embedding:negativeXL_D, embedding:unaestheticXL_Sky3.1,

Steps: 10, Sampler: dpmpp_3m_sde_simple, CFG scale: 1.0, Seed: 212036223314935, Size: 1024x1024, Model hash: 268a170aa6, Model: grogmixTURBO_v10

(and some inpainting/upscaling)

  • @[email protected]OPM
    link
    fedilink
    English
    1
    edit-2
    8 months ago

    Ones I’ve found so far are:

    • GrogMix TURBO
    • _CHEYENNE_
    • RealCartoon-XL (sometimes?)
    • PixelPaint
    • PixelWaveTurbo

    I’ve seen good images using Pony XL, but my attempts with it have so far produced messy slop so I’m not sure what I’m doing wrong there.

    • @[email protected]
      link
      fedilink
      English
      3
      edit-2
      8 months ago

      Check out the important information section on Pony Diffusion V6 XL’s page. It says: “Make sure you load this model with clip skip 2 (or -2 in some software), otherwise you will be getting low quality blobs.”. Find some images you like and work off of their prompts to learn to make your own,

      • @[email protected]OPM
        link
        fedilink
        English
        18 months ago

        Thanks for the reply, but yeah, I’ve definitely tried that. In ComfyUI for this model, setting it to -2 doesn’t actually do anything compared to no node for that at all. Setting it to -1 of course ruins it though.

        It seems really temperamental with the styles. It seems to vastly change just by changing a few words that aren’t related to style at all.

        This is the best I’ve gotten with it after hours if fiddling. Most of the image is good, but the face and hands never are.

        • @[email protected]
          link
          fedilink
          English
          28 months ago

          Try using some LoRA. You have to use LoRA trained on Pony Diffusion, since the training process moved it far away enough from regular SDXL that Controlnets aren’t even compatible with it,

          • @[email protected]OPM
            link
            fedilink
            English
            18 months ago

            Yeah it seems like loras are necessary. For that image I used the concept art twilight lora.