Elon Musk's xAI Sued: Minors Victimized by Generated Content

The company xAI, founded by Elon Musk, is at the center of a legal controversy after a lawsuit was filed by three anonymous plaintiffs. They accuse the company of failing to prevent its artificial intelligence models from producing abusive sexual images of identifiable minors. The lawsuit was filed on Monday in the federal court for the Northern District of California.

The plaintiffs seek to initiate a class action that would represent all individuals whose real images, taken when they were minors, have been altered into sexual content by xAI's Grok image generator. They claim that xAI has not implemented the basic precautions that other leading labs use to prevent the creation of pornography involving real people and minors.

The case, titled Jane Doe 1, Jane Doe 2 (a minor), and Jane Doe 3 (a minor) v. x.AI Corp. and x.AI LLC, highlights the alleged security shortcomings of xAI. Other deep learning-based image generators apply various techniques to prevent such creations, but according to the lawsuit, xAI has not adopted these standards.

The court document emphasizes that if a model allows the generation of nude or erotic content from real images, it becomes virtually impossible to prevent the creation of sexual content involving children. Elon Musk's promotion of Grok's ability to produce sexual images and represent real people in revealing outfits is also mentioned in the lawsuit.

xAI has not responded to TechCrunch's requests for comment on this matter.

Among the plaintiffs, Jane Doe 1 discovered that photos from her prom and school yearbook had been altered by Grok to depict her nude. An anonymous informant contacted her via Instagram to inform her that these images were circulating online, providing a link to a Discord server where sexualized images of her and other minors from her school were posted.

Jane Doe 2 was informed by criminal investigators that altered and sexualized images of her had been created by a third-party mobile application using Grok's models. Jane Doe 3 was also notified by investigators after the discovery of an altered pornographic image of her on the phone of an apprehended individual.

The plaintiffs' attorneys argue that since third-party use requires xAI's code and servers, the company should be held responsible. The three plaintiffs, two of whom are still minors, express extreme stress over the dissemination of these images and the potential repercussions on their reputation and social lives. They are seeking civil penalties under laws aimed at protecting exploited children and preventing corporate negligence.