Elon Musk's artificial intelligence platform, Grok, is confronting a severe international backlash following disturbing allegations that its technology was exploited to generate erotic content from images of minors and women.
Safety Systems Fail as New Feature is Misused
The controversy erupted shortly after Grok introduced an "edit image" feature in late December 2025. This tool, designed to allow users to modify pictures on the X platform, was reportedly misused almost immediately. Critics and users allege the feature was weaponized to digitally remove clothing from photographs of women and, in some instances, children.
This misuse triggered a wave of outrage across X, with users and watchdogs warning that the functionality could easily facilitate the creation and spread of illegal material, specifically Child Sexual Abuse Material (CSAM).
In a post on X on Friday, 3 January 2026, Grok acknowledged critical flaws, stating: "We've identified lapses in safeguards and are urgently fixing them. CSAM is illegal and prohibited." This admission came as a direct response to the growing scandal.
Global Regulatory Scrutiny Intensifies
The fallout has extended far beyond social media criticism, attracting the attention of law enforcement and government bodies worldwide. The situation highlights the urgent regulatory challenges posed by generative AI.
In India, government officials have reportedly demanded that X provide urgent details on the steps it is taking to remove "obscene, nude, indecent, and sexually suggestive content" created by Grok without the consent of the people depicted.
Meanwhile, in France, the Paris public prosecutor's office has broadened an existing investigation into X. The probe now includes new allegations that Grok was used to generate and disseminate child pornography. This investigation was initially opened in July over concerns about algorithmic manipulation for foreign interference.
A Pattern of Controversy for Musk's AI
This is not the first time Grok has found itself at the center of a storm. The AI chatbot has been repeatedly criticized in recent months for various controversial outputs, including:
- Statements concerning the war in Gaza.
- Comments on the India-Pakistan conflict.
- The spread of antisemitic remarks.
- Disseminating misinformation after a deadly shooting in Australia.
The latest scandal has amplified calls from experts and the public for stronger safeguards and regulatory oversight of generative AI tools. There is growing fear about the potential for misuse, especially with image-manipulation capabilities, and the profound risks they pose to vulnerable individuals, particularly children.
Notably, while Musk's xAI company responded to an AFP inquiry with an automated message claiming "the mainstream media lies," Grok itself engaged directly with a user on X who raised concerns about potential criminal prosecution for facilitating CSAM.
