The part of the Coxon resignation that got less coverage is Hubinger agreeing with him on the record

Reddit r/ArtificialInteligence News
ai-alignment anthropic existential-risk superintelligence ai-safety resignation

Summary

Jacob Coxon's resignation from Anthropic highlighted concerns about AI racing towards superintelligence, and Evan Hubinger confirmed the lack of a plan for alignment, emphasizing existential risks.

Jacob Coxon left Anthropic on Tuesday after three years of pretraining work there and at OpenAI, saying the labs are racing to self-improving superintelligence and gambling with our lives. That got the headlines. More importantly, Evan Hubinger, who leads alignment science at Anthropic, replied that his team earnestly believes AI could kill all humans, putting it above 10 percent in the next decade, and saying there is no plan to solve alignment for superintelligence. Feels like the opening of a sci-fi disaster movie...
Original Article

Similar Articles

The Coxon resignation timeline is weirder than the “AI will kill us” part

Reddit r/ArtificialInteligence

Jacob Coxon, a Cambridge math prodigy, resigned from Anthropic after a short tenure, sparking discussions on AI safety and leading to scrutiny of the timeline. The incident coincided with political moves like the Ban Artificial Superintelligence Act and an upcoming event with figures like Bernie Sanders and Steve Bannon.