Security Risks and Remediation Challenges of AI-Generated Code and Agentic AI in Cybersecurity
The rapid adoption of agentic AI and AI-generated code is transforming cybersecurity operations, offering both significant opportunities and new risks. Security leaders and CISOs are increasingly leveraging agentic AI for autonomous threat detection and response, as highlighted by industry experts from organizations like Dell Technologies and Zoom. However, the proliferation of AI-generated code in enterprise environments has introduced complex security challenges, with studies showing that critical vulnerabilities can increase as AI-generated code is refined, and remediation of such code often takes significantly longer than for human-written code. The financial impact of breaches involving AI-generated logic is substantial, with incidents costing millions and compliance fines mounting due to unpatched flaws.
Traditional application security tools are struggling to keep pace with the unique risks posed by AI-generated code, which often lacks clear human intent and context. Security teams face delays in remediation due to misalignment with engineering, as reported in industry surveys, leading to prolonged exposure and increased risk. The need for new control layers, such as agentic remediation, is becoming evident to govern and secure AI-written code at scale. As AI continues to accelerate both the sophistication and volume of cyber threats, organizations must balance the productivity gains of AI with the heightened risk and complexity it introduces to their security posture.
Get ahead of threats like this
Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.
How this story unfolded
8 events from the most recent confirmed update back to the earliest known activity.
Seemplicity publishes 2025 Remediation Operations Report
Seemplicity's 2025 Remediation Operations Report found that misalignment between security and engineering teams is a major obstacle to timely vulnerability remediation and increases organizational exposure.
Israeli cybersecurity startups secure notable funding rounds
Several Israeli cybersecurity startups were reported to have raised significant new funding, signaling continued investor interest in the sector.
Cloud service providers suffer major outages
Major outages affected cloud service providers, becoming one of the notable industry developments highlighted in the reporting.
Security vendors announce significant layoffs
Axonius, Bitdefender, and Deepwatch were reported to have carried out notable layoffs, reflecting broader workforce reductions in the cybersecurity sector.
Anthropic reports China's AI-assisted hacking still required human operators
Anthropic published a security report on a China-linked AI-powered hacking campaign, concluding that despite automation claims, substantial human involvement was still necessary.
Critical Imunify360 AV flaw exposes millions of Linux-hosted websites
A critical vulnerability in Imunify360 AV was reported as exposing more than 56 million Linux-hosted websites to potential remote code execution attacks.
Checkout.com discloses breach tied to legacy cloud storage
Checkout.com experienced a breach involving legacy cloud storage. The company said it would not pay ransom demands and instead chose to donate funds to cybersecurity research.
North Korean IT worker fraud defendants plead guilty
A North Korean IT worker fraud scheme resulted in guilty pleas, marking a law enforcement development in the long-running operation to place covert workers in companies.
Related entities
Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.
Sources
3 references tracked. Mallory keeps watching after this page renders.
Agentic AI – die besten Security-Anwendungsfälle
csoonline.com
Open sourceAgentic Remediation: The New Control Layer for AI-Generated Code
softwareanalyst.substack.com
Open sourceAligning teams for effective remediation, Anthropic’s latest report, and the news – Ravid Circus – ESW #434
scworld.com
Open sourceSee the full picture, correlated to your attack surface.
Map indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Related stories
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Security and Risk Implications of Agentic AI and AI-Generated Code in the Enterprise
The rapid integration of agentic AI systems and AI-generated code into enterprise environments is fundamentally transforming business operations, productivity, and the cybersecurity landscape. AI agents are now embedded in daily workflows, automating tasks and augmenting human capabilities, but their lack of human intuition and ethical judgment introduces new attack surfaces and vulnerabilities. Security experts warn that the rush to deploy agentic AI—autonomous systems capable of executing complex, multistep tasks—without adequate governance or oversight is creating significant risks, including the "confused deputy" problem, where AI agents can be manipulated to misuse their privileges. The proliferation of AI-generated code further compounds these risks, as studies show a high prevalence of design flaws and security vulnerabilities in code produced by large language models, leading to increased technical debt and instability in software delivery. Organizations face mounting challenges in managing accountability and liability as AI systems act with greater autonomy. The lack of robust AI governance policies leaves enterprises exposed to breaches and regulatory risks, with a majority of organizations unprepared to manage the proliferation of "shadow AI." The surge in AI-driven web traffic is disrupting traditional business models in publishing and ecommerce, while adversaries exploit the gap between human and machine decision-making. Security leaders emphasize the need for human oversight, strong identity governance, and comprehensive risk management strategies to address the dual-front of human-AI business risk and to ensure that AI adoption does not outpace the organization’s ability to secure and govern these powerful new tools.
Mar 21, 2026
Security Risks and Challenges of AI-Generated Code for Developers
The widespread adoption of generative AI (GenAI) tools in software development has significantly increased productivity, enabling developers to document, write, and optimize code at unprecedented speeds. According to a 2023 McKinsey study, organizations have rapidly integrated AI into their development workflows, with 83% using AI for code creation and 57% relying on AI-powered coding tools as a standard practice. However, this surge in AI-assisted coding has introduced new security risks, as traditional security models focused on perimeter or infrastructure controls do not adequately protect the data and code generated by these tools. Studies have revealed that nearly half of code snippets produced by popular AI models contain vulnerabilities, underscoring the prevalence of insecure code generation. High-profile incidents, such as Samsung's 2023 ban on ChatGPT following a sensitive code leak, highlight the real-world consequences of insufficient safeguards when using GenAI in development environments. The responsibility for securing data and code remains with developers, even as cloud providers secure the underlying infrastructure. The rapid pace of AI-generated code has outstripped the ability of traditional secure coding training to keep up, shifting the focus from training human programmers to ensuring that AI systems themselves are capable of secure coding. Industry experts note that AI is currently less effective at producing secure code than human programmers, with multiple studies and reports from sources like Schneier on Security, Veracode, and SC Media confirming this trend. The volume of vulnerabilities continues to rise, with over 47,000 publicly known vulnerabilities expected in a single year and at least 130 new vulnerabilities reported daily. This ongoing wave of vulnerabilities leads to constant exploitation and patching, further emphasizing the need for secure coding practices at the AI level. While AI has delivered substantial productivity gains—developers report 30% to 40% increases—these benefits are undermined by the security shortcomings of AI-generated code. The industry is now at a crossroads, where the imperative is to teach AI systems to code securely, rather than relying solely on human oversight or post-development security reviews. Integrating security into the AI coding process and providing developers with tools that embed data protection are seen as essential steps to address these emerging challenges. The shift towards AI-driven development necessitates a reevaluation of security strategies, focusing on proactive measures that align with the realities of modern software engineering. Without such changes, organizations risk exposing themselves to significant security threats stemming from the very tools designed to enhance their productivity.
Mar 21, 2026
Security and Risk Implications of AI Tools in the Enterprise
Organizations are rapidly adopting artificial intelligence (AI) tools to enhance cybersecurity operations, streamline workflows, and improve productivity, but this trend introduces significant new risks and challenges. Reports indicate that cybersecurity professionals with AI security skills are in high demand, as companies seek to leverage AI for vulnerability management, threat detection, and automation of security tasks. The integration of AI into security teams’ arsenals is accelerating, with agentic AI tools becoming increasingly common for both defensive and operational purposes. However, the proliferation of AI-powered applications, such as AI notetakers in virtual meetings, raises concerns about data privacy, compliance, and the potential for sensitive information exposure. Many AI notetaking tools operate outside official enterprise systems, often lacking robust security controls such as SOC 2 certification, GDPR compliance, or strong encryption, making them vulnerable to data breaches and mishandling. The risk is compounded by the rapid spread of these tools within organizations, sometimes without proper vetting by legal, security, or procurement teams. Transcripts generated by these applications can be stored in third-party systems, increasing the risk of unauthorized access or legal discoverability. Security leaders are advised to develop clear policies and governance frameworks to manage the use of AI tools, ensuring that only approved applications with adequate security measures are deployed. The evolving landscape of AI in cybersecurity also includes increased merger and acquisition activity, as companies seek to acquire innovative AI security capabilities. Industry analysis highlights the need for continuous evaluation of AI models, such as DeepSeek, and the security implications of open-source agent frameworks like OpenAI’s AgentKit. The impact of AI-generated code on application security is another emerging concern, as automated code generation can introduce vulnerabilities if not properly reviewed. As AI becomes more embedded in business processes, organizations must balance the benefits of automation and efficiency with the imperative to safeguard sensitive data and maintain regulatory compliance. Security teams are encouraged to stay informed about the latest trends in AI security, invest in upskilling staff, and implement layered defenses to mitigate the unique risks posed by AI-driven tools. The convergence of AI and cybersecurity is reshaping the threat landscape, requiring proactive risk management and strategic investment in secure AI adoption.
Mar 21, 2026