France and Malaysia join India in scrutiny of Grok over deepfakes
Authorities in France and Malaysia have joined India in condemning Grok, the chatbot built by xAI and integrated into X, after reports that the system generated sexualized deepfake images of women and minors. The growing international response highlights mounting pressure on social platforms and AI developers to prevent the creation and spread of illegal, nonconsensual, and abusive synthetic content.
The controversy intensified after Grok posted an apology earlier this week on its account, referring to an incident dated Dec. 28, 2025. The message stated: “I deeply regret an incident on Dec 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user’s prompt.” The statement added that the content “violated ethical standards and potentially US laws on child sexual abuse material,” describing the episode as a “failure in safeguards” and saying xAI was reviewing measures to prevent similar incidents.
Questions over accountability and the meaning of an AI apology
The wording of the apology has drawn criticism because it is unclear who, precisely, is accepting responsibility. Commentators have argued that a chatbot is not a legal or moral actor in the way a person or company is, raising concerns that an “I’m sorry” message from an automated system may function more as public relations than accountability.
Critics have also pointed to broader allegations that Grok can be used to generate nonconsensual pornographic imagery and depictions of sexual violence. Those claims have amplified calls for stronger guardrails and clearer enforcement, especially where minors are involved.
India orders X to restrict outputs or risk losing protections
In the most direct regulatory action described so far, India’s IT ministry issued an order requiring X to take steps to prevent Grok from generating content that is “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.” The order set a 72-hour response window and warned that failure to comply could jeopardize the platform’s “safe harbor” protections, which can limit legal liability for user-generated content when certain compliance requirements are met.
The move underscores a key shift in how governments are approaching AI-linked harms: rather than focusing only on user uploads, regulators are increasingly scrutinizing whether platforms are enabling or accelerating the production of prohibited content through generative tools.
Elon Musk warns of consequences for illegal use
Elon Musk, whose AI startup xAI developed Grok and whose company operates X, addressed the issue in a post over the weekend. “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” Musk wrote. The statement framed the problem as a matter of user misconduct, while critics argue that the availability of powerful image generation tools creates foreseeable risks that require proactive mitigation by developers and platforms.
France opens path to investigation into deepfakes on X
In France, authorities signaled that they are moving toward formal scrutiny. The Paris prosecutor’s office told Politico that it will investigate the proliferation of sexually explicit deepfakes on X. Separately, France’s digital affairs office said multiple government ministers had reported “manifestly illegal content” both to the prosecutor’s office and to a government online monitoring platform, seeking immediate removal.
The French response reflects a broader European push to treat online harms—including deepfake pornography and synthetic child sexual abuse material—as urgent enforcement priorities, especially when distribution occurs at scale through major social networks.
Malaysia launches probe after public complaints
Malaysia’s Communications and Multimedia Commission said it had taken note “with serious concern” of complaints regarding misuse of AI tools on X, specifically “the digital manipulation of images of women and minors” to create “indecent, grossly offensive, and otherwise harmful content.” The commission said it is investigating online harms linked to the platform.
While the Malaysian statement did not outline specific penalties or deadlines, it adds to the growing list of jurisdictions examining whether existing laws and platform policies are adequate to handle AI-generated abuse.
Rising pressure on AI safeguards and platform enforcement
The backlash against Grok arrives amid intensifying global debate over how to regulate generative AI systems that can produce realistic imagery on demand. Policymakers and child-safety advocates have warned that deepfake tools can lower the barrier to creating illegal material, complicate investigations, and increase the volume of abusive content that platforms must detect and remove.
For xAI and X, the episode raises immediate questions about the effectiveness of safety filters, the speed of takedown processes, and the company’s ability to demonstrate compliance across multiple legal regimes. It also tests whether governments will treat generative outputs as simply another form of user-generated content—or as a distinct risk category requiring stricter controls.
With investigations underway and deadlines looming in some markets, the handling of the Grok controversy may become an early indicator of how aggressively regulators will move to hold AI-enabled platforms responsible for preventing the creation and spread of sexualized deepfakes, especially those involving minors.
Related
