The Use of Regression Models for Detecting Digital Fingerprints in Synthetic Audio

Abstract

Modern advancements in text to speech and voice conversion techniques make it increasingly difficult to distinguish an authentic voice from a synthetically generated voice. These techniques, though complex, are relatively easy to use, even for non-technical users. It is important to develop mechanisms for detecting false content that easily scale to the size of the monitoring requirement. Current approaches for detecting spoofed audio are difficult to scale because of their processing requirements. Individually analyzing spectrograms for aberrations at higher frequencies relies too much on independent verification and is more resource intensive. Our method addresses the resource consideration by only looking at the residual differences between an audio files smoothed signal and its actual signal. We conjecture that natural audio has greater variance than spoofed audio because spoofed audios generation is conditioned on trying to mimic an existing pattern. To test this, we develop a classifier that distinguishes between spoofed and real audio by analyzing the differences in residual patterns between audio files.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2022
Accession Number
AD1184800

Entities

People

  • William B. Brown

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Autonomy
  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Artificial Intelligence Software
  • Authentication
  • Automata Theory
  • Computer Languages
  • Computer Programming
  • Computer Programs
  • Computer Science
  • Computers
  • Data Mining
  • Data Science
  • Deep Learning
  • Deepfakes
  • Hidden Markov Models
  • Information Operations
  • Information Science
  • Machine Learning
  • Network Science
  • Neural Networks
  • Python Programming Language
  • Recognition
  • Recurrent Neural Networks
  • Signal Processing
  • Social Media

Fields of Study

  • Computer science

Readers

  • Computer Networking
  • Neural Network Machine Learning.
  • Regression Analysis.