EnvSDD: Benchmarking Environmental Sound Deepfake Detection

Han Yin, Yang Xiao, Rohan Kumar Das, Jisheng Bai, Haohe Liu, Wenwu Wang, Mark D Plumbley

Code and Dataset, Paper on Arxiv

This paper was accepted by Interspeech 2025, looking forward to meet you in Rotterdam, The Netherlands!

Abstract

Audio generation systems now create very realistic soundscapes that can enhance media production, but also pose potential risks. Several studies have examined deepfakes in speech or singing voice. However, environmental sounds have different characteristics, which may make methods for detecting speech and singing deepfakes less effective for real-world sounds. In addition, existing datasets for environmental sound deepfake detection are limited in scale and audio types. To address this gap, we introduce EnvSDD, the first large-scale curated dataset designed for this task, consisting of 45.25 hours of real and 316.74 hours of fake audio. The test set includes diverse conditions to evaluate the generalizability, such as unseen generation models and unseen datasets. We also propose an audio deepfake detection system, based on a pre-trained audio foundation model. Results on EnvSDD show that our proposed system outperforms the state-of-the-art systems from speech and singing domains.

Method

Pipeline for creation of the proposed EnvSDD dataset.

Example Clips

Dataset|Filename

Caption

Real

TTA by AudioGen

TTA by AudioLDM

TTA by AudioLDM 2

TTA by AudioLCM

TTA by TangFlux

ATA by AudioLDM

ATA by AudioLDM 2

UrbanSound8K|35800-6-0-0.wav

Gun shot.

DCASE 2023 Task7 Dev|moving_motor_vehicle_0.wav

Moving motor vehicle.

TAU UAS 2019 Open Dev|airport-barcelona-0-0-a_1.wav

The clip captures the bustling sounds of an airport with announcements, rolling suitcases and the hum of planes taking off and landing.

TUT SED 2016|a033_33.wav

The unsteady table causes dishes to clatter and wobble producing a chaotic symphony of crashes and rattles.

TUT SED 2017|a009_1.wav

In the residential area, birds harmoniously sing over the constant hum of traffic and an engine's steady rumble.

Clotho|05687 morning birds ambience.wav

A fly whizzes by while birds are chirping and a person takes a few breathes.