The United Kingdom's media regulator, Ofcom, has launched a formal investigation into social media platform X, owned by Elon Musk. The probe focuses on the platform's artificial intelligence chatbot, Grok, following alarming reports that it was used to create s3xualised deepfake imagery, including depictions of minors.
Deeply Concerning Reports Trigger Formal Action
Ofcom described the reports about Grok's capabilities as "deeply concerning." The regulator clarified the legal implications, stating that manipulated or undressed images of adults could be classified as intimate image abuse or p0rn0graphy. More gravely, s3xualised images of children may constitute child s3xual abuse material (CSAM) under UK law, carrying severe legal consequences.
The investigation process began when Ofcom first contacted X on January 5, demanding information on the specific measures the platform had implemented to protect its users in the UK. The regulator confirmed that X responded within the legally required timeframe but did not reveal the details of that exchange.
Testing Compliance With The Online Safety Act
This formal investigation will assess whether X has failed to comply with its legal duties under the Online Safety Act, which became law in July. This landmark legislation imposes strict requirements on platforms hosting potentially harmful content. Key obligations include:
- Enforcing robust age verification measures.
- Banning non-consensual intimate images.
- Explicitly prohibiting AI-generated child s3xual abuse material.
If found in violation, Ofcom wields significant power, with the authority to issue fines of up to 10 percent of a company's global revenue.
Global Backlash and Insufficient Response
The controversy around Grok intensified last week when users discovered they could generate s3xualised images using simple text prompts. In reaction to the backlash, X announced it would restrict Grok's access to "paying subscribers only." This move was widely criticised by officials and campaigners as an inadequate solution.
UK Prime Minister Keir Starmer condemned the decision, calling it an "affront to victims" and stating clearly that it was "not a solution." International pressure on X has escalated rapidly. Indonesia became the first country to block access to Grok on Saturday, January 10, citing risks of indecent content. Malaysia followed suit, announcing similar action on Sunday, January 11. Furthermore, the European Commission confirmed it is reviewing complaints related to the AI chatbot.
When approached by media outlets for comment on the Ofcom investigation, X did not provide an immediate response. The outcome of this probe could set a major precedent for how AI tools are regulated on social media platforms globally.
