Skip to content
InfoResearchPeer-reviewed

When Annotators Disagree: A Principled Approach to Learning With Noisy Labels

Published
Record updated
View JSON

Summary

Human annotators often disagree, which introduces label noise into classification datasets, and the true noise distribution is usually unknown. This research shows how interannotator agreement statistics can estimate that noise distribution and uses those estimates to train models on noisy data. It also derives generalization bounds within the empirical risk minimization framework that depend on the estimated noise characteristics.