AI Safety Warnings Spark Debate Among Tech Leaders and Politicians

Recent warnings from Anthropic researchers about existential AI risks have drawn sharp criticism from Silicon Valley executives, while political tensions rise over regulation and national security.

Anthropic researcher Jacob Coxon recently resigned, stating that people building artificial intelligence believe the technology could destroy humanity. He described the situation as a gamble with lives. This sentiment was echoed by Evan Hubinger, an Anthropic team lead, who posted on X that he personally believes there is a greater than 10% chance AI could kill all humans within the next decade.

These warnings have met with skepticism from some industry leaders. Nvidia CEO Jensen Huang dismissed Coxon's comments as untrue and has previously labeled the idea that AI will end humanity as complete nonsense. Grindr CEO George Arison instructed engineers at his company to stop using Anthropic's technology, citing what he described as dangerous anti-civilisational views.

Despite the controversy, Anthropic was valued at $965bn in its most recent fundraising round earlier this year. OpenAI, another major player, was most recently valued at $852bn. OpenAI CEO Sam Altman stated that an initial public offering (IPO) would not happen this year, suggesting 2027 is more likely.

The debate occurs amidst growing political tensions. Senator Bernie Sanders co-sponsored the Ban Artificial Superintelligence Act, which would impose a temporary pause in advanced AI development. In contrast, President Donald Trump expressed no concern about AI leading to human extinction, citing fears of losing dominance to China instead.

Tensions between AI developers and the government have also surfaced. The White House designated Anthropic a supply chain risk after the company refused to allow the US military to use its AI models, a move later ruled illegal by a federal judge. Additionally, Anthropic announced it had found and stopped threat actors attempting to use its AI technology for bioweapons development and cyber-espionage.

Sources