Work

On the reliability of feature attribution methods for speech classification

Year: 2025

Type: conference-paper

Abstract: As the capabilities of large-scale pre-trained models evolve, understanding the determinants of their outputs becomes more important. Feature attribution aims to reveal which parts of the input elements contribute the most to model outputs. In speech processing, the unique characteristics of the input signal make the application of feature attribution methods challenging. We study how factors such as input type and aggregation and perturbation timespan impact the reliability of standard feature attribution methods, and how these factors interact with characteristics of each classification task. We find that standard approaches to feature attribution are generally unreliable when applied to the speech domain, with the exception of word-aligned perturbation methods when applied to word-based classification tasks.

Source: Interspeech (USB)

DOI: 10.21437/interspeech.2025-1911

Authors: Gaofei Shen, Hosein Mohebbi, Arianna Bisazza, Afra Alishahi, Grzegorz Chrupala

Language: English

Topic: Explainable Artificial Intelligence (XAI)

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: Nederlandse Organisatie voor Wetenschappelijk Onderzoek

Award: InDeep: Interpreting Deep Learning Models for Text and Sound

OpenAlex ID: W4415432999

FWCI:

Cites:

Cited by:

Related to: