New Mexico sued Snapchat after using AI to reveal child safety risks.

New Mexico is seeking an injunction to permanently block Snap from practices allegedly harming kids. That includes a halt on advertising Snapchat as “more private” or “less permanent” due to the alleged “core design problem” and “inherent danger” of Snap’s disappearing messages. The state’s complaint noted that the FBI has said that “Snapchat is the preferred app by criminals because its design features provide a false sense of security to the victim that their photos will disappear and not be screenshotted.”

  • @[email protected]
    7•2 months ago

    I feel like there’s two stories here:

    1. Snap is a pedo grooming ground

    2. Police are generating fake CSAM

    3. is, well, yeah . Like any major network you have creeps, Nazis and pedos and it’s good to root them out. It’s weird that themselves don’t do that.

    4. is … difficult. I feel like the cops that prompt GenAIs to produce (sexualized) images of children risk severe trauma. It must be punishing to ask a a machine to produce fake images of morally reprehensible material. That’s gotta take a toll on you. What’s even more important is that those people could be spending their time taking down actual child abuse images.

    I can’t wrap my head around that.