The investigator told her that the adult brother of one of her classmates in the photo had used Elon Musk’s artificial intelligence chatbot Grok to manipulate the unremarkable picture into child sexual abuse material, or CSAM, of eighth-grade Jane, depicting her completely naked in a sexual pose, and shared it on the internet.
“It is impossible to know how many other child sex predators may now possess Jane Doe 5’s CSAM, nor how widely her CSAM has now been disseminated online through darknet channels and applications,” says a complaint filed by Jane Doe 5, as she’s known in a class action lawsuit against Musk’s generative AI company and Grok creator, xAI.
“It’s out there, and there’s really nothing I can do about it. That’s what scared me the most,” Jane, who’s now 18, said in a recent interview days before she left for college. “It made me feel like I wanted to give up on everything,” she said.
AI is making it easier than ever for anyone to turn normal photos ripped from personal social media feeds and school websites into unthinkable images in seconds. Jane Doe 5 joins a growing number of young victims trying to hold xAI legally accountable for the troubling images Grok helped its users produce. In doing so, they’re taking on not only a company backed by the world’s richest man but also a fundamental question that is far from settled in the fast-evolving AI era. When a chatbot generates abusive content, who’s ultimately liable: The person who gave the command, or the company that built the technology? Or both?
XAI says it, like popular rivals OpenAI, Anthropic PBC and Meta Platforms Inc., strictly prohibits the use of its chatbot to create this kind of imagery, which has become an industrywide problem, and has technological measures in place to prevent people from generating it. Yet Musk has deliberately pitched Grok since its launch in 2023 as a provocative alternative with fewer restrictions than its peers. He’s encouraged people to spin up sexual AI content using the chatbot’s “Spicy” mode built specifically for “edgier, more visually daring narratives” and “NSFW” images and videos. That and “Unhinged” mode, the company has said, serve Grok’s goal of being “maximally truth-seeking.”
0 comments
log in to comment.