InfoResearchPeer-reviewed
When Annotators Disagree: A Principled Approach to Learning With Noisy Labels
- Published
- Record updated
Summary
Human annotators often disagree, which introduces label noise into classification datasets, and the true noise distribution is usually unknown. This research shows how interannotator agreement statistics can estimate that noise distribution and uses those estimates to train models on noisy data. It also derives generalization bounds within the empirical risk minimization framework that depend on the estimated noise characteristics.