Skip to main content
Live Webinar with SANS (June 25)— Agentic CTI Automation for Fun & ProfitRegister Free
Mallory
Back to intelligence
privacy-surveillance-policycybersecurity-regulationai-enabled-threat-activityidentity-impersonation-fraud

EU Moves to Curb AI-Generated Sexual Abuse and Deepfake Harms

Updated 3mo agoFirst seen Mar 13, 20264 sources

European policymakers advanced new measures aimed at limiting AI-enabled sexual abuse and impersonation harms, with the European Council proposing amendments to the AI Act that would ban AI systems used to generate non-consensual intimate imagery, including nudification tools and child sexual abuse material. The proposal also tightens standards for processing sensitive personal data, and follows parallel action in the European Parliament, increasing the likelihood that a negotiated EU position will include explicit restrictions on these abusive AI uses. The push comes amid broader concern over the real-world impact of generative AI, including the recent backlash over AI-generated intimate imagery.

Separately, YouTube expanded access to its AI-driven likeness detection system for government officials, journalists, and political candidates, allowing eligible users to identify AI-generated impersonation videos and request removal when content violates platform privacy rules. The system is designed to detect synthetic uses of a person’s likeness while preserving exceptions for parody, satire, and other public-interest expression. Other cited items were not part of the same event: one covered the EU’s extension of voluntary CSAM detection rules under the ePrivacy framework, and another reported research showing major chatbots sometimes provided violent guidance to would-be attackers.

Share:
EU Moves to Curb AI-Generated Sexual Abuse and Deepfake Harms
Stay ahead

Get ahead of threats like this

Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.

EVENT TIMELINE

How this story unfolded

8 events from the most recent confirmed update back to the earliest known activity.

8 EVENTS
Mar 13, 20263mo ago

European Council proposes AI Act ban on nudification tools

The European Council released amendments to streamline the EU AI Act, including a ban on AI tools that generate non-consensual sexual and intimate content, including child sexual abuse material. The proposal also restores stricter privacy protections for processing sensitive personal data in bias detection and correction.

European Parliament approves similar ban on AI nudification

Before the Council’s latest proposal, the European Parliament had already approved a similar ban on AI nudification practices. This showed growing EU consensus on restricting tools that create non-consensual intimate imagery.

European Commission probes X and Grok over image generation concerns

Following the backlash over Grok-generated intimate images, the European Commission opened a probe into X and its Grok feature. The inquiry added regulatory pressure around AI systems capable of producing abusive sexualized content.

Backlash erupts over Grok-generated nonconsensual intimate images

Nonconsensual intimate images generated with Grok were widely shared online, prompting public backlash. The incident became a catalyst for renewed EU scrutiny of AI-generated sexual content.

European Commission proposes changes to EU AI Act implementation

The European Commission earlier proposed amendments to the EU AI Act that would delay some rules for high-risk AI systems and broaden exemptions for smaller companies. These earlier proposals set the stage for later Council amendments.

Mar 11, 20264mo ago

YouTube expands deepfake likeness detection pilot to public figures

YouTube expanded access to its AI-driven likeness detection system to a pilot group including government officials, journalists, and political candidates. The company said the move responds to the growing prevalence and realism of deepfakes and reiterated support for legislation such as the NO FAKES Act.

YouTube rolls out likeness detection to Partner Program creators

Before expanding the program further, YouTube had already introduced its AI-driven likeness detection system to creators in the YouTube Partner Program. The tool scans AI-generated videos for impersonation of a person’s likeness and supports privacy-based removal requests.

Feb 23, 20264mo ago

EDPB backs global privacy statement on AI-generated imagery

On 2026-02-23, EDPB Chair Anu Talus signed a joint Global Privacy Assembly statement on behalf of the European Data Protection Board addressing privacy risks from AI-generated images and videos of identifiable people. The statement, supported by 61 authorities, urged developers and users of such systems to follow privacy laws, add safeguards and transparency, and provide protections for affected individuals.

AI-generated imagery and protection of privacy: EDPB supports joint Global Privacy Assembly’s statement | European Data Protection Board
LINKED ENTITIES

Related entities

Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.

8 LINKEDOpen in app
Affected products
2 linked
BingGoogle Search
Organizations
6 linked
GoogleMeta PlatformsMicrosoft CorporationxAIOfflimitsHelp Net Security
The operational view lives in Mallory

See the full picture, correlated to your attack surface.

This page covers what’s public. Mallory adds the parts that aren’t — which of your assets are affected, which threat actors are using it right now, which detections to deploy, and what to do next.
Exposure mapping

Map indicators from this story to your assets and identify affected systems in minutes.

Threat actor evidence

Every observed campaign, victim, and pivot linked to actors named in this story.

Associated malware

Malware, exploits, and IOCs connected to the activity described here.

Detection signatures

YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.

Scheduled alerts

Get matching new stories delivered to your team as they break — not the next morning.

AI threads

Ask questions about this story and take action on the answers.