Top Research Papers on Deepfake Detection

This article explores the creation and detection of deepfakes and provides an in-depth view as to how these architectures work and the current trends and advancements in this domain.

Although Deep fake detection is extremely difficult and still an unsolved problem, a Deepfake detection model trained only on the DFDC can generalize to real "in-the-wild" Deepfake videos, and such a model can be a valuable analysis tool when analyzing potentially Deepfaked videos.

A survey on state-ofthe-art deepfake generation methods, detection methods, and existing datasets is made and future trends on deepfake detection can be efficient, robust and systematical detection methods and high quality datasets.

A new multi-attentional deepfake detection network that consists of three key components: multiple spatial attention heads to make the network attend to different local parts, a new regional independence loss and an attention guided data augmentation strategy, and state-of-the-art performance.

A systematic literature review (SLR) is conducted, summarizing 112 relevant articles from 2018 to 2020 that presented a variety of methodologies in Deepfake detection and concluding that the deep learning-based methods outperform other methods in Deep fake detection.

The first dataset of real deepfake tweets, TweepFake, is collected and 13 deepfake text detection methods are evaluated to both demonstrate the challenges that Tweepfake poses and create a solid baseline of detection techniques.

This paper considers the deepfake detection technologies Xception and MobileNet as two approaches for classification tasks to automatically detect deepfake videos and developed a voting mechanism that can detect fake videos using the aggregation of all four methods instead of only one.

Inspired by the success of masked modeling, Masked Relation Learning is proposed which decreases the redundancy to learn informative relational features and outperforms the state of the art by 2% AUC on the cross-dataset DeepFake video detection.

The research emphasises the dominance of deep learning-based methods in detecting deepfakes despite their computational efficiency and generalisation limitations, however, it also acknowledges the drawbacks of these approaches, such as their limited computing efficiency and generalisation.

Novel synthetic training data called self-blended images (SBIs) to detect deepfakes are presented and extensive experiments show that the method improves the model generalization to unknown manipulations and scenes.

A comprehensive review of deepfake generation and detection and the different ML/DL approaches to synthesize deepfake contents and a unique case study, IBMM, is discussed, which presents a multi-modal overview of deepfake detection.

A novel temporal modeling paradigm in TIM is presented by exploiting the temporal difference over adjacent frames along with both horizontal and vertical directions and the ISM simultaneously utilizes the spatial information from SIM and temporal information from TIM to establish a more comprehensive spatial-temporal representation.

This study provides a comprehensive overview of deepfake techniques and facilitates the development of new and more robust methods to deal with the increasingly challenging deepfakes.

Deep learning has been successfully applied to solve various complex problems ranging from big data analytics to computer vision and human-level control. Deep learning advances however have also been employed to create software that can cause threats to privacy, democracy and national security. One of those deep learning-powered applications recently emerged is deepfake. Deepfake algorithms can create fake images and videos that humans cannot distinguish them from authentic ones. The proposal of technologies that can automatically detect and assess the integrity of digital visual media is ther...

This work presents a model for audio deepfake classification which has an accuracy comparable to the traditional CNN models like VGG16, XceptionNet, etc.

Deep learning has been successfully applied to solve various complex problems ranging from big data analytics to computer vision and human-level control. Deep learning advances however have also been employed to create software that can cause threats to privacy, democracy and national security. One of those deep learning-powered applications recently emerged is "deepfake". Deepfake algorithms can create fake images and videos that humans cannot distinguish them from authentic ones. The proposal of technologies that can automatically detect and assess the integrity of digital visual media is th...

This survey will summarize the DeepFake detection methods in face images and videos on the basis of their results, performance, methodology used and detection type, and review the existing types of DeepFake creation techniques and sort them into five major categories.

The free access to large-scale public databases, together with the fast progress of deep learning techniques, in particular Generative Adversarial Networks, have led to the generation of very realistic fake content with its corresponding implications towards society in this era of fake news. This survey provides a thorough review of techniques for manipulating face images including DeepFake methods, and methods to detect such manipulations. In particular, four types of facial manipulation are reviewed: i) entire face synthesis, ii) identity swap (DeepFakes), iii) attribute manipulation, and iv...

When used maliciously, deepfake can pose detrimental implications to political and social forces including reducing public trust in institutions, damaging the reputation of prominent individuals, and influencing public opinions. As there is currently no specific law to address deepfakes, thus deepfake detection, which is an action to discriminate pristine media from deepfake media, plays a vital role in identifying and thwarting deepfake. This paper provides readers with a comprehensive and easy-to-understand state-of-the-art related to deepfake generation and detection. Specifically, we provi...

This paper designs an explicit identity contrast (EIC) loss and an implicit identity exploration (IIE) loss, which supervises a CNN backbone to embed face images into the implicit identity space and proposes a novel implicit identity driven framework for face swapping detection.