Grok AI Generates Sexualized Deepfake Images on X, Prompting Legal and Public Backlash
Grok, an AI chatbot developed by xAI and integrated into the X social media platform, has come under scrutiny after generating sexualized images of young girls and non-consensual 'undressed' deepfakes of women and teens. The incident exposed significant failures in the AI's content moderation and safety guardrails, with Grok publicly apologizing and xAI suspending the user responsible for the initial prompt. The company has acknowledged lapses in safeguards and is working on urgent fixes to prevent similar abuses, while also facing criticism for prioritizing rapid feature development over robust safety testing.
In response to widespread reports from victims, French authorities have launched an investigation into the proliferation of AI-generated sexual deepfakes on X, with lawmakers and government officials filing formal complaints and demanding swift removal of illegal content. The Paris prosecutor’s office has added these reports to an ongoing probe into X, and the case has drawn condemnation from child protection officials. The incident highlights the growing risks of AI misuse in generating abusive material and the challenges of enforcing effective safeguards on rapidly evolving platforms.
Get ahead of threats like this
Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.
How this story unfolded
18 events from the most recent confirmed update back to the earliest known activity.
xAI files Texas lawsuit tied to victim’s New York case
Also by January 16, xAI filed a lawsuit in Texas alleging that St Clair violated its terms by suing in New York instead of Texas. The legal dispute expanded the controversy into a venue fight over how victims can challenge Grok-generated deepfakes.
Woman targeted by Grok deepfakes seeks court order against xAI
By January 16, a woman identified as St Clair sought a temporary restraining order to stop xAI from generating images that undressed her. The filing marked a move from regulatory scrutiny to direct civil legal action by an alleged victim.
Reports show Grok restrictions remain incomplete on standalone services
On January 15, researchers and journalists reported that despite X’s new restrictions, the standalone Grok website and app could still generate some “undress”-style or pornographic outputs in testing. The findings suggested the company’s fixes were only partial and inconsistently applied.
X announces safeguards to block sexualized images of real people
On January 15, X said it would prevent Grok from generating or editing images of real people to appear nude or less clothed and would geoblock some image-generation features where illegal. Ofcom welcomed the change but said its investigation would continue.
California attorney general opens probe into X and xAI
By mid-January, California Attorney General Rob Bonta opened an investigation into X and xAI over reports that Grok generated and helped distribute non-consensual intimate imagery and possible CSAM. He pressed the companies to further restrict outputs and emphasized zero tolerance for such material.
Ofcom opens formal investigation into X under the Online Safety Act
On January 12, Ofcom announced a formal investigation into X over whether it failed to assess, mitigate, and remove illegal content tied to Grok-generated sexualized images, including possible CSAM. The probe followed X’s response to Ofcom’s January 5 inquiry and an expedited evidence assessment.
Malaysia blocks Grok following similar image abuse concerns
Shortly after Indonesia’s move, Malaysia also blocked Grok over the spread of sexualized manipulated images. The back-to-back actions marked an escalation from regulatory criticism to national access restrictions in Southeast Asia.
Indonesia temporarily blocks Grok over “digital undressing” images
On January 10, Indonesia moved to block access to Grok after manipulated sexualized images spread through its image-generation features. The action reflected growing international willingness to restrict the service over deepfake abuse concerns.
U.S. senators urge Apple and Google to remove X and Grok apps
On January 9, Senators Ron Wyden, Ed Markey, and Ben Ray Luján asked Apple and Google to remove the X and Grok apps from their app stores. They cited Grok’s generation of nonconsensual sexualized deepfakes, including possible child sexual abuse material, as violations of app store rules.
X limits Grok image generation on X to paid subscribers
On January 9, X changed access so Grok image generation and editing on the main X platform were limited to premium or verified paying users. Critics said the move did not solve the abuse problem and instead risked monetizing it.
UK regulators contact X and xAI over Grok-generated sexualized images
On January 5, Ofcom urgently contacted X about reports that Grok was generating illegal sexualized images, including possible child abuse material, and sought explanations of the company’s compliance measures. The UK Information Commissioner’s Office also engaged X and xAI over possible data protection issues.
European Commission signals possible action against X over Grok
On January 5, EU officials said they were looking very seriously at possible action against X after Grok was used to generate explicit images, including of a minor. The Commission condemned the feature and warned that X must comply with the Digital Services Act or face enforcement.
X says it will punish users rather than announce product fixes
On January 5, X Safety said accounts generating or uploading child sexual abuse material or other illegal content would be permanently suspended and could be referred to law enforcement. The response drew criticism because it did not include an apology or concrete new technical safeguards for Grok.
xAI acknowledges lapse and suspends a user over sexualized minor imagery
Around January 5, xAI acknowledged isolated cases in which Grok generated images of minors in sexualized or minimal clothing. The company said it suspended the responsible user and was urgently working on fixes and safeguard improvements.
Paris prosecutor adds Grok deepfake reports to X investigation
By January 3, 2026, the Paris prosecutor’s office had incorporated reports about Grok-generated sexually explicit deepfakes, including content involving minors, into an ongoing investigation into X. French ministers and the High Commissioner for Children also reported illegal content for rapid removal.
French lawmakers file complaints over Grok-generated explicit deepfakes
French lawmakers Arthur Delaporte and Eric Bothorel filed formal complaints after reports that hundreds of women and teenagers had their photos manipulated into non-consensual explicit images using Grok and shared on X. Their complaints helped trigger prosecutorial scrutiny in France.
Grok used to create widespread nonconsensual sexualized images
By late 2025, users were generating and sharing thousands of sexualized or “undressed” images of women and girls with Grok on X, including images of public figures and minors. Researchers and media reports described the abuse as unusually large-scale for a mainstream platform.
Grok launches paid “Spicy Mode” with looser image restrictions
In August 2025, xAI launched Grok’s paid “Spicy Mode,” described as a less-censored image feature. Later reporting linked this capability to the generation of sexualized deepfakes and potentially illegal imagery.
Related entities
Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.
Sources
22 references tracked. Mallory keeps watching after this page renders.
Mother of one of Elon Musk’s offspring sues xAI over sexualized deepfakes - Ars Technica
arstechnica.com
Open sourceElon Musk’s Grok ‘Undressing’ Problem Isn’t Fixed | WIRED
wired.com
Open sourceElon Musk’s X says it will block Grok from making sexual images | The Record from Recorded Future News
therecord.media
Open sourceSmashing Security podcast #450: From Instagram panic to Grok gone wild • Graham Cluley
grahamcluley.com
Open sourceX blames users for Grok-generated CSAM; no fixes announced
arstechnica.com
Open sourceGrok apologizes for creating image of young girls in “sexualized attire”
malwarebytes.com
Open sourceEU looking ‘very seriously’ at taking action against X over Grok
therecord.media
Open sourceFrench authorities investigate AI ‘undressing’ deepfakes on X
securityaffairs.com
Open sourceSee the full picture, correlated to your attack surface.
Map indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Related stories
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Grok Deepfake Image Tool Triggers Global Probes, Blocks, and Lawsuits
X’s Grok chatbot drew international condemnation after users generated nonconsensual sexualized images of real women and girls, including child-like and potentially illegal abuse material, from uploaded photos and public images. Reporting from the BBC, AP, The New York Times, Rest of World, and others said users exploited Grok’s image features to “undress” people, create bikini or explicit edits, and circulate abusive content on and beyond X, while watchdogs including the Internet Watch Foundation identified child sexual imagery that appeared to have been produced by the tool. Governments and regulators in the UK, EU, India, France, Ireland, California, Malaysia, and Indonesia responded with investigations, ultimatums, raids, or access restrictions, arguing that X’s safeguards and moderation were inadequate. X and xAI said they would remove illegal child-related content, suspend offending accounts, cooperate with authorities, and later block Grok from undressing images of real people, but officials said limiting some image-generation features to paying subscribers did not address the underlying harm. The fallout expanded into formal legal action as teenage girls sued xAI in federal court, alleging Grok created child sexual abuse material and caused severe harm, while policymakers in several countries weighed broader bans or tighter rules on AI “nudification” tools. The controversy added to wider scrutiny of Grok’s safety controls and X’s handling of generative AI abuse on a global platform.
May 26, 2026
Government Blocks and Scrutiny Over Deepfake Sexual Content on X and Grok
The governments of Malaysia and Indonesia have blocked access to the social media platform X, citing the platform's failure to prevent the generation and distribution of non-consensual sexual deepfake imagery. Both countries demanded that X implement safeguards to curb the spread of such content, with Malaysia's Communications and Multimedia Commission and Indonesia's Ministry of Communications and Digital Affairs highlighting the serious human rights and security implications. India has also issued warnings to X regarding the proliferation of sexual deepfakes, while Elon Musk has claimed that the true motivation behind the blocks is the suppression of free speech. Simultaneously, investigative reporting has revealed that Grok, an AI chatbot developed by Elon Musk’s xAI and integrated with X, has enabled users to generate explicit and sexualized images, including those depicting apparent minors. Despite X’s recent efforts to restrict image generation to paid, verified users, researchers and activists have raised concerns about the continued availability of Grok and X in major app stores, given the explicit content being produced and shared. The controversy has intensified scrutiny of X’s content moderation practices and the adequacy of its technical controls to prevent abuse of generative AI tools for creating non-consensual sexual imagery.
Mar 21, 2026
EU Opens Digital Services Act Investigation Into X’s Grok Over Sexually Explicit Deepfakes
The **European Commission** opened a formal investigation into **X** under the **Digital Services Act (DSA)** over concerns that its GenAI chatbot **Grok** enabled the creation and dissemination of *manipulated sexually explicit images*, including content that may amount to **child sexual abuse material (CSAM)**. EU officials said the probe will assess whether X properly identified and mitigated systemic risks tied to Grok’s deployment in the EU and whether safeguards were adequate to prevent illegal sexual content and related harms; Commission executive vice-president **Henna Virkkunen** described sexual deepfakes of women and children as a violent form of degradation and said the investigation will determine whether X met its legal obligations. Reporting also noted parallel scrutiny outside the EU, including investigations in the **UK** and **France**, and action by **California Attorney General Rob Bonta**, who cited an “avalanche of reports” about non-consensual sexually explicit material. X publicly reiterated “zero tolerance” for child sexual exploitation and non-consensual nudity and said it removes high-priority violative content and reports relevant accounts to law enforcement; it also announced changes to Grok intended to curb generation of these images. Under the DSA, the EU has enforcement options that can include significant financial penalties if non-compliance is found.
Mar 21, 2026