A Florida man is facing 20 counts of obscenity for allegedly creating and distributing AI-generated child pornography, highlighting the danger and ubiquity of generative AI being used for nefarious reasons.

Phillip Michael McCorkle was arrested last week while he was working at a movie theater in Vero Beach, Florida, according to TV station CBS 12 News. A crew from the TV station captured the arrest, which made for dramatic video footage due to law enforcement leading away the uniform-wearing McCorkle from the theater in handcuffs.

  • @KillerTofu
    link
    -3818 days ago

    How was the model trained? Probably using existing CSAM images. Those children are victims. Making derivative images of “imaginary” children doesn’t negate its exploitation of children all the way down.

    So no, you are making false equivalence with your video game metaphors.

    • @[email protected]
      link
      fedilink
      5918 days ago

      A generative AI model doesn’t require the exact thing it creates in its datasets. It most likely just combined regular nudity with a picture of a child.

      • finley
        link
        fedilink
        English
        -1318 days ago

        In that case, the images of children were still used without their permission to create the child porn in question

        • @[email protected]
          link
          fedilink
          2918 days ago

          That’s not really a nuanced take on what is going on. A bunch of images of children are studied so that the AI can learn how to draw children in general. The more children in the dataset, the less any one of them influences or resembles the output.

          Ironically, you might have to train an AI specifically on CSAM in order for it to identify the kinds of images it should not produce.

          • finley
            link
            fedilink
            English
            -1218 days ago

            Why does it need to be “ nuanced” to be valid or correct?

            • TheRealKuni
              link
              English
              3218 days ago

              Because the world we live in is complex, and rejecting complexity for a simple view of the world is dangerous.

              See You Can’t Get Snakes from Chicken Eggs from the Alt-Right Playbook.

              (Note I’m not accusing you of being alt-right. I’m saying we cannot ignore nuance in the world because the world is nuanced.)

            • @Dkarma
              link
              718 days ago

              Well it doesn’t but it’s not correct.

          • finley
            link
            fedilink
            English
            -718 days ago

            “Nuh uh!” Is a pretty weak argument

        • @[email protected]
          link
          fedilink
          518 days ago

          That’s a whole other thing than the AI model being trained on CSAM. I’m currently neutral on this topic so I’d recommend you replying to the main thread.

            • @[email protected]
              link
              fedilink
              14
              edit-2
              18 days ago

              It’s not CSAM in the training dataset, it’s just pictures of children/people that are already publicly available. This goes on to the copyright side of things of AI instead of illegal training material.

              • finley
                link
                fedilink
                English
                -25
                edit-2
                18 days ago

                It’s images of children used to make CSAM. No matter of your mental gymnastics can change that, nor the fact that those children’s consent was not obtained.

                Why are you trying so hard to rationalize the creation of CSAM? Do you actually believe there is a context in which CSAM is OK? Are you that sick and perverted?

                Because it really sounds like that’s what you’re trying to say, using copyright law as an excuse.

        • @[email protected]
          link
          fedilink
          English
          218 days ago

          Good luck convincing the AI advocates of this. They have already decided that all imagery everywhere is theirs to use however they like.

    • macniel
      link
      fedilink
      2718 days ago

      Can you or anyone verify that the model was trained on CSAM?

      Besides a LLM doesn’t need to have explicit content to derive from to create a naked child.

      • @Dkarma
        link
        618 days ago

        No they are not.

      • @KillerTofu
        link
        -2418 days ago

        You’re defending the generation of CSAM pretty hard here in some vaguely “but no child we know of” being involved as a defense.

        • macniel
          link
          fedilink
          1318 days ago

          I just hope that the Models aren’t trained on CSAM. Making generating stuff they can fap on ““ethical reasonable”” as no children would be involved. And I hope that those who have those tendancies can be helped one way or another that doesn’t involve chemical castration or incarceration.

    • Diplomjodler
      link
      1218 days ago

      While i wouldn’t put it past Meta&Co. to explicitly seek out CSAM to train their models on, I don’t think that is how this stuff works.

    • @grue
      link
      English
      -518 days ago

      But the AI companies insist the outputs of these models aren’t derivative works in any other circumstances!

      • @Dkarma
        link
        618 days ago

        Cuz they’re not