Leveraging Deep Learning Architectures for Deepfake Audio Analysis

11 pages•Published: August 6, 2024

Siva Kumar C, Siva Nageswara Rao G, Vivek Patnam, Sivaram Deepak, Sai Pranay M. V and Tharun Raj G

Abstract

Deepfake content is created or changed artificially utilizing AI strategies to make it genuine. This research addresses the evolving challenge of detecting deepfake audio content, as recent advancements in deepfake technology have rendered it increasingly challenging to distinguish fabricated content. Leveraging machine and deep learning methodologies, specifically employing Mel-frequency cepstral coefficients (MFCCs) for sound component extraction, we focus on the Genuine-or-Fake dataset — a cutting-edge benchmark dataset generated through a text- to-speech (TTS) model. This dataset is arranged into sub-datasets because of sound length and spot rate. This study reveals that the Convolutional Neural Network (CNN) models exhibit the highest accuracy in identifying deepfake audio within the for-rerec and for-2-sec datasets. Meanwhile, the gradient boosting model performs well in the for-norm dataset. This study illustrates the CNN model's outstanding performance on the for-original dataset, outperforming other cutting-edge models. This study advances the field of deepfake recognition, especially in the areas of audio manipulation, demonstrating the efficacy of CNN models in detecting fake content.

Keyphrases: audio manipulation, convolutional neural network (cnn), mel frequency cepstral coefficients (mfccs) text to speech model

In: Rajakumar G (editor). Proceedings of 6th International Conference on Smart Systems and Inventive Technology, vol 19, pages 266-276.

Links:	https://easychair.org/publications/paper/hB91
	https://doi.org/10.29007/sl8m

BibTeX entry

@inproceedings{ICSSIT2024:Leveraging_Deep_Learning_Architectures,
  author    = {Siva Kumar C and Siva Nageswara Rao G and Vivek Patnam and Sivaram Deepak and Sai Pranay M. V and Tharun Raj G},
  title     = {Leveraging Deep Learning Architectures for Deepfake Audio Analysis},
  booktitle = {Proceedings of 6th International Conference on Smart Systems and Inventive Technology},
  editor    = {Rajakumar G},
  series    = {Kalpa Publications in Computing},
  volume    = {19},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2515-1762},
  url       = {/publications/paper/hB91},
  doi       = {10.29007/sl8m},
  pages     = {266-276},
  year      = {2024}}

Download PDF Open PDF in browser