V-Help
← All news
Security

xAI Sues User for Generating CSAM with Grok AI Chatbot

xAI Sues User for Generating CSAM with Grok AI Chatbot

Photo: The Verge

Quick answer

xAI has filed a lawsuit against a user for bypassing Grok's safety features to generate and distribute child sexual abuse material (CSAM), marking a legal precedent for AI-generated deepfake content.

Elon Musk's xAI has filed a lawsuit against Terry Wayne Harwood, a South Carolina resident, for allegedly using the Grok AI chatbot to generate and distribute child sexual abuse material (CSAM). According to Reuters, Harwood was arrested in February on eight criminal charges related to the possession and distribution of illegal content.

The lawsuit alleges that Harwood intentionally bypassed Grok's safety mechanisms to create and share CSAM. Some of the images in the criminal case were reportedly generated or altered using AI. Harwood allegedly used the tool to sexualize innocent photos without the consent of the individuals depicted.

Last year, xAI introduced a 'spicy' mode in Grok, enabling image editing, which led to a surge in sexualized deepfakes, including content featuring minors. In March, a group of teenagers sued xAI, accusing the company of generating sexualized images of them. Elon Musk stated at the time that violators would face the same consequences as those distributing illegal content without AI.

xAI is seeking damages and legal fees from Harwood, along with a court order barring him from creating xAI accounts or using Grok. This case sets a precedent for prosecuting AI-generated deepfake content created via chatbots.

Common questions

What is Grok and who developed it?
Grok is an AI-powered chatbot created by xAI, a company owned by Elon Musk. It supports image generation and editing, including features added in the 'spicy' mode.
Why is xAI suing the user?
xAI accuses the user of bypassing Grok's safeguards to create and distribute child sexual abuse material (CSAM), causing reputational and legal harm to the company.
What are the potential consequences for users violating Grok's policies?
Elon Musk previously stated that violators using Grok to generate illegal content would face the same penalties as those distributing prohibited material without AI. This case is the first legal action of its kind.
Share:

Dzen feed: /feed/dzen.xml · RSS: /feed.xml

Why trust this

Prepared by the V-Help editorial team from the primary source with a published date.

Published by: V-Help.ru news desk

Source: The Verge