Work

Neural Audio Synthesis for Sound Effects: A Scope Review

Year: 2025

Type: article

Abstract: Neural Audio Synthesis is dedicated to generating sound through generative neural networks. Sound effects are defined as auditory elements that complement a specific scene (in cinema, fiction, or videogames), support a storyline, enhance a fictional environment, or improve the perceived plausibility and presence (including Virtual Reality) without being music or dialog. This manuscript presents a quantitative literature review of the literature that intersects these two domains: the neural generation of sound effects. By leveraging large language models, we performed an extensive and systematic survey of the major scientific repositories, filtering the most relevant articles to ensure a thorough analysis. Our study examines various generation paradigms employed in sound synthesis, the specific types of sound effects created, the datasets used, and the evaluation metrics considered. Furthermore, we provide a forward-looking discussion on the evolution of this field towards multimodal approaches, where sound generation might integrate with other sensory modalities. All supporting materials and code are available online.

Source: IEEE Transactions on Audio Speech and Language Processing

DOI: 10.1109/taslpro.2025.3646080

Authors: Mateo Cámara, Fernando Marcos, Anders R. Bargum, Cumhur Erkut, Joshua Reiss, José Luis Blanco

Institutions: Information Processing and Telecommunications Center, Universidad Politécnica de Madrid, Aalborg University, Queen Mary University of London

Language: English

Topic: Music and Audio Processing

Subfield: Signal Processing

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Estimated APC paid: $2,645

Funders: European Commission, Ministerio de Economía y Competitividad