Active listening
Year: 2020
Type: article
Abstract: This paper introduces active listening, as a unified framework for synthesising and recognising speech. The notion of active listening inherits from active inference, which considers perception and action under one universal imperative: to maximise the evidence for our (generative) models of the world. First, we describe a generative model of spoken words that simulates (i) how discrete lexical, prosodic, and speaker attributes give rise to continuous acoustic signals; and conversely (ii) how continuous acoustic signals are recognised as words. The 'active' aspect involves (covertly) segmenting spoken sentences and borrows ideas from active vision. It casts speech segmentation as the selection of internal actions, corresponding to the placement of word boundaries. Practically, word boundaries are selected that maximise the evidence for an internal model of how individual words are generated. We establish face validity by simulating speech recognition and showing how the inferred content of a sentence depends on prior beliefs and background noise. Finally, we consider predictive validity by associating neuronal or physiological responses, such as the mismatch negativity and P300, with belief updating under active listening, which is greatest in the absence of accurate prior beliefs about what will be heard next.
Source: Hearing Research
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $2,550
Awards: Wellcome Centre for Human Neuroimaging, G2761799724, Wellcome Centre for Human Neuroimaging, Towards a new neurological model of language that explains outcome after stroke., G5882669802, Explaining Language Outcome and Recovery After Stroke (ELORAS), G6020229975, Center for Music in the Brain (MIB), G6966048999, Functional architectures in the brain., 2018 National Productivity Investment Fund Studentships, G7765275075, What do you say? An investigation of how lesions cause language deficits in post-stroke
OpenAlex ID: W4206555638
