Loading story…
Illinois, New York, and California have advanced frontier AI laws that would require major model developers to implement safety frameworks, disclose risks, report incidents, and in some cases undergo independent audits, creating a patchwork of state obligations as the United States lacks a comprehensive federal regime. The measures target highly capable models increasingly used in critical infrastructure and other sensitive environments, where policymakers and security leaders warn they could enable cyber abuse such as autonomous zero-day exploitation, guardrail evasion, deception by agentic systems, and AI-assisted ransomware.
At the same time, pressure is building for a broader U.S. oversight structure for frontier models. Google DeepMind CEO Demis Hassabis called for an independent, expert-led body to evaluate advanced AI systems before release, while OpenAI said the Trump administration is developing a federal cyber-testing framework for highly capable models and argued that national institutions should lead audits, incident reporting, security standards, and whistleblower protections. Together, the proposals point toward a de facto national baseline for frontier AI governance, though unresolved questions remain around fragmented state compliance, technical rigor, transparency, and how rules would apply to downstream users and modified or embedded models.
Mallory correlates global threat intelligence with your attack surface — know if you’re exposed before adversaries strike.
4 events from the most recent confirmed update back to the earliest known activity.
Demis Hassabis, CEO and co-founder of Google DeepMind, proposed creating an independent professional body in the United States to evaluate frontier AI models before release. He said the organization could begin as a voluntary public-private or self-regulatory effort and later become a mandatory certification gate.
The Trump administration imposed a requirement that advanced AI models undergo a government security review 30 days before launch. Critics cited in the coverage argued the process lacked technical rigor and transparency.
The Trump administration was reported to be developing a federal framework to test highly capable AI models for cyber-related risks. OpenAI said the goal was to have the framework in place by early August.
State-level legislation in Illinois, New York, and California advanced requirements for frontier AI developers, including safety frameworks, transparency or incident reporting, and oversight or audits. The measures were described as emerging in the absence of comprehensive federal U.S. rules.
Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.
3 references tracked. Mallory keeps watching after this page renders.
zdnet.fr
Open sourceopenai.com
Open sourcedarkreading.com
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
Governments, regulators, and major AI developers moved to formalize oversight of advanced AI systems as concerns grew that frontier and agentic models could accelerate cyberattacks, create liability exposure, and outpace existing governance. In the United States, **NIST** expanded work on AI security through its `AI Agent Standards Initiative`, the `Cyber AI Profile`, and the Commerce Department’s **Center for AI Standards and Innovation (CAISI)**, while Google, Microsoft, xAI, OpenAI, and Anthropic agreed to voluntary pre-release model testing with the government. The White House debated a broader executive order after reports that models such as Anthropic’s **Mythos** and OpenAI’s cyber-focused systems could rapidly identify vulnerabilities and support complex offensive operations; the final order reportedly shortened the review window and paired model access with an AI cybersecurity clearinghouse and vulnerability-sharing measures for critical infrastructure defenders. At the same time, Europe and U.S. states advanced a patchwork of AI governance rules that mixed delayed enforcement with tougher operational expectations. The EU agreed to simplify parts of the **AI Act**, delaying some high-risk obligations while banning nudification tools and preserving strong powers for the Commission’s AI Office over general-purpose AI, even as guidance on high-risk classification and logging requirements continued to emerge. States including Illinois, Utah, Maryland, and San Jose expanded governance-first programs through chief AI officers, sandboxes, incident-investigation frameworks, red teaming, and procurement controls, while insurers, auditors, and legal experts warned that **AI-washing**, weak board oversight, poor logging, and inadequate vendor controls are increasing D&O, regulatory, and tort risk. Across policy, industry, and academia, the direction of travel was toward stronger **auditing, verification, incident reporting, and lifecycle governance** rather than reliance on voluntary model promises alone.
Jul 12, 2026
A bipartisan discussion draft in the House, the **Great American Artificial Intelligence Act of 2026**, would create the first broad U.S. federal framework for regulating frontier AI developers such as OpenAI, Anthropic, Google DeepMind, and Meta. The proposal would require large model developers to publish safety and governance frameworks, issue transparency and incident reports, assess catastrophic risks, and undergo semiannual independent audits or verification. The bill defines catastrophic risks to include mass-casualty harms, major property damage, cyberattacks, CBRN weapon assistance, and loss-of-control scenarios, while also formalizing the **Center for AI Standards and Innovation** and funding it at **$100 million annually** from fiscal 2027 through 2029. The draft would also block states for **three years** from specifically regulating AI model development, a provision that drew immediate criticism from opponents who say it could suppress stronger state protections even as it preserves generally applicable state laws and post-deployment oversight. Beyond model governance, the measure would extend the **Cybersecurity Information Sharing Act** through 2035, direct DHS to support small and rural critical infrastructure operators, fund open-source software maintainers using frontier models for vulnerability discovery and patching, and establish AI testbeds across federal labs and private partners to evaluate threats including autonomous offensive cyber capabilities and risks to critical infrastructure.
Jun 29, 2026
Microsoft, Google, and xAI agreed to give the U.S. Commerce Department pre-release access to frontier AI models so the government can test them for national security and public safety risks before broader deployment. The evaluations will be led by the Center for AI Standards and Innovation (**CAISI**), housed within **NIST**, and will examine threats including AI-enabled cyberattacks, biosecurity concerns, chemical-weapons misuse, and other criminal abuse. Officials said the models will be assessed in classified environments, with some testing designed to study systems whose safeguards have been reduced or removed to better understand unmitigated capabilities and failure modes. The agreements expand earlier voluntary arrangements and align with a broader push for more formal federal oversight of advanced AI, including reported consideration of an executive order establishing government testing protocols before models reach the market. Microsoft said it will also work with CAISI, NIST, and the UK **AI Security Institute** on adversarial assessment methods, safeguard testing, and frontier safety research, while U.S. officials described the effort as part of a wider strategy to measure unexpected behaviors and misuse pathways in powerful models. Industry groups have largely backed the initiative, framing it as a way to improve trust in commercial AI systems while addressing mounting concern over models that could support offensive cyber operations or other high-risk uses.
Jun 29, 2026