Skip to main content
Live Webinar with SANS (June 25)— Agentic CTI Automation for Fun & ProfitRegister Free
Mallory
Back to intelligence
ai-enabled-threat-activityai-platform-securityidentity-impersonation-fraud

AI-Enabled Abuse and Governance Risks in Emerging Agentic Systems

Updated 3mo agoFirst seen Mar 2, 20262 sources

Open-source and locally run generative AI models are being operationalized for nonconsensual sexual imagery and other manipulation, with researchers (including Graphika and Open Measures) tracking coordinated sharing of “nudified” deepfakes targeting Olympic athletes on platforms such as 4chan. Reporting described how communities use downloadable models without safety guardrails and share fine-tuned components like Low-Rank Adaptations (LoRA) to improve output quality and lower the technical barrier for abuse, accelerating the spread of sexualized deepfakes and related harassment.

Separate commentary highlighted that as agentic AI moves into production, organizations are increasingly judged on reliability, auditability, and operating within regulatory boundaries, because these systems can execute multi-step actions across tools with limited human prompting. The material emphasized the need for governance controls—e.g., defined action permissions, escalation paths, logging, and human-in-the-loop checkpoints—to prevent autonomous behavior from exceeding policy or risk thresholds; additional workplace-oriented coverage focused on employee anxiety and career adaptation around AI rather than a specific security incident.

Share:
AI-Enabled Abuse and Governance Risks in Emerging Agentic Systems
Stay ahead

Get ahead of threats like this

Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.

EVENT TIMELINE

How this story unfolded

5 events from the most recent confirmed update back to the earliest known activity.

5 EVENTS
Mar 2, 20264mo ago

CyberScoop reports Olympic athletes were plagued by AI deepfakes

CyberScoop published reporting tying together the sexualized deepfake targeting of female U.S. athletes and politically themed AI manipulation during the Milan Olympics. The report highlighted both the technical enablers and the cross-platform spread of the content.

AI-generated TikTok falsely depicts Brady Tkachuk making anti-Canadian remarks

During the Olympics, an AI-generated White House TikTok video falsely portrayed U.S. hockey player Brady Tkachuk making anti-Canadian comments. Tkachuk publicly objected, saying the voice was not his and the lip movement was not real.

Graphika and Open Measures track Olympic deepfake campaign across platforms

Research firms Graphika and Open Measures documented the abuse targeting Olympic athletes and found that Telegram and increasingly X helped amplify the content beyond 4chan's auto-deleting posts. They also noted that open-source local image models and shareable LoRA weights made such nonconsensual imagery easier to produce at scale.

Feb 1, 20265mo ago

AI-generated sexualized deepfakes target female U.S. athletes during Milan Olympics

During the Milan Olympics, multiple female U.S. athletes were targeted with AI-generated 'nudified' or sexualized images. Researchers said the material was created and circulated on 4chan before spreading to other platforms.

Jan 1, 20242y ago

Deepfake nudes of Taylor Swift spread from 4chan to mainstream social media

In 2024, sexually explicit AI-generated deepfake images of Taylor Swift reportedly originated on 4chan and then went viral on mainstream social media platforms. The incident was cited as an earlier example of how harmful synthetic media can move from fringe forums to wider distribution.

LINKED ENTITIES

Related entities

Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.

8 LINKEDOpen in app
Affected products
2 linked
TelegramTiktok
Organizations
6 linked
Open MeasuresTikTokXTelegramGraphikaOttawa Senators
The operational view lives in Mallory

See the full picture, correlated to your attack surface.

This page covers what’s public. Mallory adds the parts that aren’t — which of your assets are affected, which threat actors are using it right now, which detections to deploy, and what to do next.
Exposure mapping

Map indicators from this story to your assets and identify affected systems in minutes.

Threat actor evidence

Every observed campaign, victim, and pivot linked to actors named in this story.

Associated malware

Malware, exploits, and IOCs connected to the activity described here.

Detection signatures

YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.

Scheduled alerts

Get matching new stories delivered to your team as they break — not the next morning.

AI threads

Ask questions about this story and take action on the answers.

AI-Enabled Abuse and Governance Risks in Emerging Agentic Systems | Mallory