Anthropic, OpenAI proposed new 'neutral' AI watchdogs. Why you should worry about the idea

Anthropic CEO Dario Amodei has proposed embedding third-party safety evaluators (external researchers who monitor AI systems from inside the company) inside major AI companies like Anthropic and OpenAI to oversee the development of large language models (AI systems trained on vast amounts of text). However, experts argue this proposal lacks real enforcement power compared to banking regulation, since these evaluators could only investigate and report findings but could not actually stop or prevent a model from being trained or released, unlike bank regulators who can force changes or shut down operations.