InfoResearchPeer-reviewed
FauForensics: Boosting Audio-Visual Deepfake Detection With Facial Action Units
- Published
- Record updated
Summary
FauForensics is a framework for detecting audio-visual deepfakes that uses facial action units, which quantify facial muscle activity, as forgery-resistant features. It computes frame-wise audio-visual similarities through a fusion module with learnable cross-modal queries, aligning lip-audio relationships to address feature heterogeneity. Tested on four public datasets, it reports state-of-the-art results with a 5.17% average cross-dataset improvement over existing methods.