A researcher at the AI company Anthropic, makers of Claude, recently resigned and went public to warn the world that AI companies are “gambling with our lives.” The pace of AI development is so rapid, Jacob Coxon warned, that there “will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.” Coxon claimed that there was a significant chance that all of humanity would be killed outright by out-of-control AI. Lest anyone think Coxon was just a disgruntled kook, one of Anthropic’s own top safety researchers, Evan Hubinger, came out and confirmed: “We really do earnestly believe AI could kill all humans!” putting the odds at over 10 percent in the next 10 years. Hubinger said, in essence, that the company has no plan for how to ensure AI is developed safely, but is proceeding in developing it anyway. Anthropic’s CEO, Dario Amodei, wrote an essay agreeing that “we must slow the pace at which we improve the capabilities of A.I. models” and arguing for more government regulation.

From blog via This RSS Feed.