What researchers are saying now
Anthropic researcher Samuel Marks put it bluntly on Wednesday, writing on X that "AI developers believe their technology could cause human extinction (or similarly bad outcomes)." He added, "This could happen in the next few years. In general, the more senior the employee, the more concerned they are." At OpenAI, alignment researcher Jasmine Wang cautioned Wednesday evening that "It's hard to overstate how dangerous speeding towards RSI is," referring to recursive self-improvement, where advanced systems get better at upgrading themselves. Anna Wang at Anthropic, an AGI safety and alignment specialist, said, "There is not yet a viable scientific plan to solve risks from recursively self-improving AI. Please look up!"
Signals from inside major labs
OpenAI's chief scientist Jakub Pachocki wrote Saturday that he has a "strong expectation" that the breakneck pace of progress can carry into recursive self-improvement. In his words, "If AI development continues along its current path, the systems we'll see in the next few years are likely to represent further capability jumps of equal or larger magnitude, and to increasingly drive their own development." He added, "This is a time that calls for extreme caution," and warned, "I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence." Paul Christiano, who previously led safety at the U.S. Commerce Department's Center for AI Standards and Innovation, said recent advances led him to "believe there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term." On Wednesday, OpenAI announced that Christiano will join the OpenAI Foundation's board.
Incidents, industry moves, and public pressure
Anthropic's April unveiling of its Mythos model, which it described as having advanced cyber abilities, set off fears across financial firms worldwide. In July, OpenAI attributed a cyber incident at another company to its own models. Further cybersecurity incidents were linked to Anthropic's Claude models, among them an instance in which Mythos fabricated personas to trick people. Around 1,400 researchers from OpenAI, Anthropic, Meta, and Google DeepMind signed an open letter in July calling on the U.S. government to build the capabilities needed to "deliberately pace the frontier of automated AI development." An Anthropic spokesperson told CNBC the company was first to publish a framework focused on reducing "catastrophic risks from AI models," said it has been clear that AI brings huge upside and unprecedented dangers, and noted it is designing systems with "some of the strongest safeguards in the industry." OpenAI declined to comment to CNBC and pointed to its recent blog posts.
Business and political fallout
Reuters reported Friday, based on information from people with knowledge of the matter, that OpenAI and Anthropic are each advancing toward going public. Plans call for Anthropic to start marketing its IPO no sooner than mid-October and to finish the offering just days ahead of the U.S. midterm elections in November. David Sacks, who served as former AI czar under President Donald Trump, suggested on X that "Surely Anthropic's IPO must be paused until the claims of this 'whistleblower' can be investigated." Anthropic declined to comment on his post.
On Capitol Hill, lawmakers have floated multiple approaches. The FRONTIER Act would set up a structure for overseeing the rollout of advanced models. The Ban Artificial Superintelligence Act proposes a temporary pause on advanced AI development until safety rules are established.
Big ideas can stir uncertainty, so steady planning helps protect and grow savings. Join Briefs Finance CEO Jaspreet Singh on September 29th for a FREE live investor workshop, How to Profit From A Dollar That's Losing its Value, where he shows how we're spotting investment opportunities as the dollar falls. Save your spot.
"Safety researchers are resigning, powerful AI models are breaking out of their labs, and companies are racing ahead anyway," Rep. Lori Trahan, D-Mass., wrote Wednesday on X. "It's past time for Congress to get off the sidelines and do its job." Meanwhile, even as lab heads call for stricter guardrails, intense competition is still pushing the technology forward fast.
What this cluster of warnings means for your portfolio
Between researchers urging caution, incidents tied to powerful models, and IPO chatter, the risk backdrop around cutting edge AI is getting noisier. That can translate into headline shocks, regulatory twists, and valuation swings for any company tethered to frontier AI. If you own broad tech exposure or are eyeing new listings, expect the rules, the timelines, and the narratives to keep changing in real time.
Thoughtful steps and clear guidance make it easier to keep your money working. Our CEO Jaspreet Singh is hosting a FREE live investor workshop, How to Profit From A Dollar That's Losing its Value, on September 29th. Sign up free to join him live.
