Elon Musk’s xAI is facing allegations of child pornography from Grok’s allegedly undressed children

Elon Musk’s company xAI should be sued for allowing its AI models to create pornographic images of famous children, three anonymous plaintiffs argued in a lawsuit filed Monday in federal court in California.

The three plaintiffs want to bring a class-action suit representing anyone who had actual photos of themselves as minors sexually modified by Grok. They say xAI did not take the same security measures used by other border labs to prevent their images from releasing pornographic images that show real people and children.

The lawsuit, Jane Doe 1, Jane Doe 2, minor, and Jane Doe 3, minor vs. x.AI Corp. and x.AI LLC, filed in the US District Court for the Northern District of California.

Some serious photo generators use different methods to prevent the creation of child pornography from normal images. The lawsuit states that these standards were not adopted by xAI.

In particular, if a cartoon allows the extraction of nudity or pornography from real images, it is impossible to prevent it from creating child sex. Musk publicized Grok’s ability to create sexy images and show real people in skimpy clothes that are more visible in suits.

The company did not respond to TechCrunch’s request.

One defendant, Jane Doe 1, had photos from her high school and yearbook altered by Grok to show her naked. An anonymous tipster she contacted on Instagram told her the photos were circulating online, and sent her a link to a Discord server with sexually explicit photos of her and other kids she recognized at school.

The second plaintiff, Jane Doe 2, was informed by criminal investigators of edited, sexually explicit images created by third-party software that relied on Grok’s samples. A third, Jane Doe 3, was also identified by detectives who found an edited, pornographic image on the phone of the subject they arrested. The plaintiffs’ lawyers say that because third-party use still requires xAI code and servers, the company should be held liable.

All three defendants, two of whom are still minors, say that they are facing serious problems because of the publication of these pictures and what it may mean for their history and their lives. They are seeking civil penalties under several laws to protect child victims and prevent corporate negligence.