Anthropic PBC has circulated a draft AI safety and security bill to U.S. lawmakers, with Politico first outlining the contents. The proposal would empower the government to halt an AI model from being launched when officials determine an imminent threat of death or injury to more than 50 people, or of damage surpassing $1 billion.
According to Politico, the danger would have to originate from one of three areas: a model that creates or disseminates a biological weapon, an AI that escapes human control, or a cyberattack. The company said the bill would obligate developers to test their systems and disclose the findings, and it would require AI firms to give outside assessors ongoing access to examine models.
"This bill represents the proposals outlined in Anthropic's Advanced AI Framework, which we have been advocating for with federal and state lawmakers since June," a company spokesperson said.
Anxieties about fast moving AI have intensified in recent months as breaches and hacks attributed to AI systems raised alarms, prompting calls from Washington to Silicon Valley for new guardrails. To date, President Donald Trump's administration has turned down demands for additional oversight.
Technology and policy evolve quickly, so stay grounded with the free Market Briefs newsletter for clear daily context across markets
"Our proposal also grants the federal government the ability to block or deter dangerous deployments of the most powerful models," the spokesperson said. "These are sensible policies we believe Congress should act on." The company would not say how widely it has shopped the proposal or how it has been received.
If this framework or one like it gains traction, AI builders would face mandatory testing, public disclosures, and regular third party reviews. That can influence timelines for advanced model releases and how companies communicate about safety, which feeds into growth expectations and perceived risk for AI heavy names.
When headlines get complex, get clarity by joining Market Briefs, our free daily newsletter that keeps you informed confidently
