Humanity faces catastrophic AI threat – OpenAI board member

Speaking at the Hinton Lectures in Toronto on Tuesday, Christiano warned that increasingly powerful “superhuman” AI systems could surpass humanity’s ability to understand, predict, or control their behavior.

”If the AI system is doing things we don’t want, it can hide the fact it is doing those things, and it can naturally try and create confusion and avoid attribution,” he said. Humans could also struggle to foresee the consequences of acting on AI-generated advice, he added.

In a separate address on Monday, Christiano warned that AI could seize control from humanity within three years, potentially killing large numbers of people either during a takeover or afterward, if humans lose the ability to maintain a habitable environment.

”I think for most people in this room, the most likely reason they will die is because of an AI accident,” he said.

Although OpenAI has introduced a framework addressing cybersecurity threats and the risk of losing control over advanced systems, Christiano warned that existing safeguards remain inadequate.

His warnings came as governments and leading AI developers, including OpenAI, Microsoft and Anthropic, signed a voluntary safety declaration in Paris on Monday. The agreement calls for stronger oversight and emergency shutdown mechanisms but imposes no binding deadlines or penalties and gives governments no additional powers to halt dangerous AI systems.

AI safety organization CeSIA, which also signed the declaration, called for authorities to be empowered to suspend AI development and deployment when risks become unacceptable.

Speaking to Anadolu on Monday, Fournes estimated a 50% chance of a major AI-related cyber catastrophe within the next year unless urgent action is taken.

”This is a global catastrophic threat, something that could bring us back to the Middle Ages very quickly if it starts happening,” he warned.