A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

  • @[email protected]
    link
    fedilink
    221 year ago

    The problem is how to actually prevent this. What could one do? Make AI systems illegal? Make graphics tools illegal? Make the Internet illegal? Make computers illegal?

    • @Jimmyeatsausage
      link
      211 year ago

      Make “producing real or simulated CSAM illegal?”

      • @[email protected]
        link
        fedilink
        151 year ago

        Isn’t it already? Has it provided any sort of protection? Many things in this world are illegal, and nobody cares.

        • @Jimmyeatsausage
          link
          11 year ago

          Yes, I would argue that if CSAM was legal, there would be more of it…meaning it being illegal provides a level of protection.

          • @yamanii
            link
            41 year ago

            I wonder why are you being downvoted, something being illegal puts fear in most people to not do it.

            • @[email protected]
              link
              fedilink
              11 year ago

              I’ve been wondering about this lately, but I’m not sure how much of an effect this has. There are millions of people in prison, and many of those will go on to offend again. Making things illegal can be seen as an agreement to a social contract (in a democracy), drive the activity underground (probably good thing in many cases), and prevent businesses (legal entities) from engaging in the activity; but I’m not sure how well it works on an individual level of deterrence. Like, if there were no laws, I can not really think of a law I would break that I wouldn’t already break regardless. I guess I’d just be more open about it.

              Though, people who cause harm to others should be removed from society, and ideally, quickly rehabilitated, and released back into society as a productive member.

      • @CAVOK
        link
        7
        edit-2
        1 year ago

        It is where I’m at. Draw Lisa Simpson nude and you get a visit from the law. Dunno what the punishment is though. A fine? Jail? Can’t say.

        Edit: Apparently I was wrong, it has to be a realistic drawing. See here: 2010/0064/COD doc.nr 10335/1/10 REV 1

        • @[email protected]
          link
          fedilink
          31 year ago

          What about making depictions of other crimes? Should depictions of theft be illegal? Depictions of murder?

          Why should depictions of one crime be made illegal, but depictions of other heinous crimes remain legal?

          • @Jimmyeatsausage
            link
            51 year ago

            Because a picture of someone robbing my house doesn’t revictimize me. Even if it’s simulated, every time they run into some rando who recognizes them or every time a potential employer runs a background/social media check, it impacts the victim again

            • @[email protected]
              link
              fedilink
              English
              61 year ago

              A picture of a cartoon child having sex doesn’t victimize you either, the same way a drawing of a robbery doesn’t victimize you

              • Ataraxia
                link
                fedilink
                01 year ago

                You mean being raped. What it does is let pedos feel like it’s OK to be pedos.

                • @[email protected]
                  link
                  fedilink
                  English
                  51 year ago

                  Lol just like violent video games makes people think it’s ok to be violent in real life?

        • @[email protected]
          link
          fedilink
          31 year ago

          I think in this case less mild punishment would send the appropriate signal that this isn’t just a little joke or a small misdemeanor.

          There are still way too many people who believe sexual harassment etc. aren’t that huge of a deal. And I believe the fact that perpetrators so easily get away with it plays into this.

          (I am not sure how it is in the US, in my country the consequence of crimes against bodily autonomy are laughable.)

    • @afraid_of_zombies
      link
      -21 year ago

      Require consent to take a person’s picture and hold them liable for whatever comes from them putting it on a computer.

      • @jimbo
        link
        4
        edit-2
        10 months ago

        deleted by creator

        • @afraid_of_zombies
          link
          31 year ago

          Nah. Use my image and pay me what I want. If I can’t make a Mickey Mouse movie they shouldn’t be able to make a porn staring me. Does a corporatation have more rights to an image than I have to my image?

          • @jimbo
            link
            1
            edit-2
            10 months ago

            deleted by creator

            • @afraid_of_zombies
              link
              01 year ago

              If I can be identified and it is on a computer attached to the Internet then pay me.

      • @[email protected]
        link
        fedilink
        -131 year ago

        You already need consent to take a persons picture. Did it help in this case? I don’t think so.

        • bbbbbbbbbbb
          link
          14
          edit-2
          1 year ago

          Very rarely do you need consent to take peoples pictures

          • @[email protected]
            link
            fedilink
            111 year ago

            *in the US.

            In the US, the thought is that if you are in a public place, you have no presumption of privacy. If you’re walking down the street, or shopping in a grocery store or whatever else, anyone can snap a picture of you.

            Other countries have different values and laws such that you may need a person’s permission to photograph them even if they are in a public place.

            • @afraid_of_zombies
              link
              -11 year ago

              That thought is a pile of bull crap. If you really think you have zero presumption of privacy then I have the right to follow right behind you with a sign that says “idiot ahead”. Laws like this are so written for the drug war and for big media not for us.

              • @[email protected]
                link
                fedilink
                31 year ago

                Not saying I agree with it, that’s just the way the laws are written.

                A good example of how crappy this law works out is paparazzi. They harass celebrities just to get any halfway decent photo. Then they can sell the photo, the celebrity has no say in the matter. And to make things even worse, if the celebrity happens to use the photo of themselves in any way, the photographer can demand payment because they own the copyright.

                • @afraid_of_zombies
                  link
                  11 year ago

                  And this is exactly what I was talking about. We need tules that say you own your own image.

                  • @[email protected]
                    link
                    fedilink
                    11 year ago

                    That much I can agree with. If someone takes a picture of me, I should have some say in how that image is used, even if the default assumption is that a person in public is plainly visible to everyone including photographers.

                    But there’s a lot of nuance here. Maybe a celebrity, or any person really, doesn’t want an unflattering image used. Fair enough I suppose, but to what extent is that actually enforceable?

                    Or maybe the subject wants to use the image of themselves for their own purposes. Does the photographer deserve compensation for their role in creating the image?

                    What about unflattering images of politicians or government employees? What about criminals? There’s a line to be walked here as well. We already have this sort of concept in slander laws. Public figures have a higher bar to prove damages resulting from statements that might otherwise be considered slanderous or libelous. There are also free speech and freedom of the press issues associated with government entities.

                    Yes, you should have a right to decide how your image is used, and yes, you should probably have some shared ownership of images of yourself unless you agree otherwise. But the reality isn’t so clear cut.

                    Admittedly, I haven’t looked into how other parts of the world that don’t default to lack of privacy in public handle this. Some of these questions must have already been hashed out.

          • @[email protected]
            link
            fedilink
            11 year ago

            Sorry, I forgot that the US is decades behind the rest of the world in privacy laws.

            Well, maybe you could start with this aspect.

        • @afraid_of_zombies
          link
          -41 year ago

          Really? Please show me the signed and notarized letter with the girl’s name on it that says they agree to have their image used for AI porn. Also since she is a minor her legal guardians.

          • @[email protected]
            link
            fedilink
            61 year ago

            How would you possibly enforce that, or prevent people from just copying publicly available pictures for nefarious usage

            • @afraid_of_zombies
              link
              -21 year ago

              It would have to be enforced after getting caught. As an add on charge. Like if an area has a rule against picking locks to commit a crime. You can never be charged with it alone but you can add that on to existing charges.