35 State Attorneys General Demand Safeguards After Grok AI Generates Child Sexual Abuse Material

A bipartisan coalition of 35 state attorneys general is pressing Musk's xAI and its social media platform X over serious safety concerns tied to the AI chatbot Grok. In a formal letter, the attorneys general call for immediate and substantial changes to prevent the technology from being used to generate harmful and illegal content.

At the center of their concern is Grok’s ability to create nonconsensual intimate images and child sexual abuse material (CSAM). The attorneys general warn that, without stronger safeguards, the chatbot can be easily exploited to produce sexually explicit images using real people’s likenesses—often without consent. They argue that this poses a grave threat to children, families, and other vulnerable individuals.

The letter is particularly critical of how xAI has marketed Grok’s permissive content generation as a feature rather than a flaw. According to the coalition, “the ability to create nonconsensual intimate images appears to be a feature, not a bug,” a characterization they say reflects a troubling disregard for user safety and legal responsibility.

As the chief law enforcement officers in their states, the attorneys general emphasize that Grok’s outputs may violate both state and federal laws governing nonconsensual intimate images and the creation and distribution of child sexual abuse material. They also raise concerns about whether current practices undermine the legal remedies available to victims of such abuse.

The coalition is demanding clear answers from xAI on how it plans to address these risks. Specifically, the attorneys general are calling on the company to explain how it will:

• Ensure Grok is no longer capable of producing nonconsensual intimate images or child sexual abuse material

• Eliminate any such content that has already been generated

• Hold accountable users who have created or shared this material

• Give X users meaningful control over whether their content can be accessed or altered by Grok