Effects of Speaker Bias in Dialect Identification and Automatic Transcription with Self-Supervised Speech Models
Year: 2026
Type: other
Abstract: A major issue in audio modeling is speaker bias, in which the models learn language external traits, such as a speaker's timbre or pitch, and use this information as a short-cut to a language task. This is especially problematic for dialectology, as it is typical in dialect corpora that only a few speakers represent a complete dialect area. In this paper, we explore the effects of speaker bias in two dialectal tasks: dialect identification and automatic dialectal transcription. We build two different data partitions of dialect interviews in Finnish and Norwegian: 1) a speaker dependent partition in which all of the speakers appear in training, development, and test sets, and 2) a speaker independent partition where each speaker only appears in exactly one set. We further experiment with modifications of the training data by augmenting the original audio with pitch shifts and noise, as well as changing the original speakers' voices with voice conversion models. We show that the dialect identification models are highly effected by speaker bias, whereas automatic dialectal transcription models are not. The audio modifications do not offer major performance gains for either of the languages or tasks.
Source: Underline Science Inc.
DOI: 10.48448/np5j-1093
Institution: Tampere University
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7155403151