Anthropic and OpenAI need truly independent safety evaluators, experts say in public letter

Summary

Over 100 AI experts and evaluators, organized by the AI Evaluator Forum consortium and chaired by Conrad Stosz, published a public letter warning that they lack the resources and protections needed to test frontier AI safety. The signatories, including Geoffrey Hinton and members of Johns Hopkins, Stanford and METR, want foundation model providers to guarantee third-party evaluators scientific objectivity, transparency, independence and robust protections. The letter follows Anthropic CEO Dario Amodei's proposal of employee-like access for evaluators.

Related items

• InfoWhat we know so far about the Microsoft outageSame vendor · BBC Technology
• InfoSilicon Valley claims to know the future. So why did it get the midterms so wrong?Same vendor · MIT Technology Review
• InfoOpenAI Unveils Daybreak Red Team, Defense Factory Security ToolsSame vendor · SecurityWeek
• InfoAn AI kill switch isn’t enough. Build a fallback planSame vendor · CSO Online
• InfoWhat happened overnight with the Microsoft global outage?Same vendor · BBC Technology