His response follows the resignation of Jacob Coxon, who accused Anthropic and OpenAI of racing toward self-improving superintelligence without adequate safeguards to control it. The debate intensified after Anthropic alignment researcher Evan Hubinger personally estimated there was a greater than 10% chance AI could cause human extinction within the next decade, while stressing that he considers the risk from today’s models low.
