Work

Model-Based Deep Learning for Music Information Research: Leveraging diverse knowledge sources to enhance explainability, controllability, and resource efficiency

Year: 2024

Type: article

Abstract: In this article, we investigate the notion ofmodel-based deep learningin the realm of music information research (MIR). Loosely speaking, we refer to the term model-based deep learning for approaches that combine traditional knowledge-based methods with data-driven techniques, especially those based on deep learning, within a differentiable computing framework. In music, prior knowledge for instance related to sound production, music perception or music composition theory can be incorporated into the design of neural networks and associated loss functions. We outline three specific scenarios to illustrate the application of model-based deep learning in MIR, demonstrating the implementation of such concepts and their potential.

Source: IEEE Signal Processing Magazine

DOI: 10.1109/msp.2024.3415569

Authors: Gaël Richard, Vincent Lostanlen, Yi-Hsuan Yang, Meinard Müller

Institutions: Télécom Paris, Centre National de la Recherche Scientifique, National Taiwan University, International Audio Laboratories Erlangen

Language: English

Topic: Music and Audio Processing

Subfield: Signal Processing

Field: Computer Science

Domain: Physical Sciences

Open Access status: green