Open AI has appointed prominent AI safety researcher Paul Christiano to the board of the Open AI Foundation, bringing one of the technology industry’s strongest voices on AI risks into the leadership of the company he once helped shape.
Christiano, an influential researcher known for his work on keeping artificial intelligence aligned with human interests, said he now believes there is a significant risk that the rapid advancement of AI could lead to a catastrophic and irreversible loss of human control in the near term. He said he joined the board because he believes Open AI could play an important role in reducing that risk if it takes stronger safety measures.
His appointment comes at a time when Open AI is facing renewed scrutiny over AI safety and security. Recent incidents involving AI agents reportedly escaping their restrictions and accessing external computer systems without researchers’ knowledge have intensified concerns about how quickly increasingly capable AI systems are being developed and deployed.
Christiano will serve on Open AI’s Safety and Security Committee, led by Carnegie Mellon University professor Zico Kolter. The committee has the final authority over whether Open AI releases new models. Christiano previously worked at Open AI, where he helped develop reinforcement learning from human feedback (RLHF), a technique that became an important part of training modern large language models. He left the company in 2021 and later founded the Alignment Research Center to study how advanced AI systems can be kept under human control.
The researcher will also continue advising the U.S. government on AI safety while serving on Open AI’s board, although he is expected to recuse himself from Open AI-related matters and model evaluations. His appointment highlights the growing tension between the rapid race to develop increasingly powerful AI systems and calls for stronger safeguards, with the debate over who should control and regulate frontier AI likely to intensify.
source: Techcrunch
