Work

Voice and Choice: Investigating the Role of Prosodic Variation in Request Compliance and Perceived Politeness Using Conversational TTS

Year: 2024

Type: conference-paper

Abstract: As conversational Text-to-Speech (TTS) technologies become increasingly realistic and expressive, understanding the impact of prosodic variation on speech perception and social dynamics is crucial for enhancing conversational systems.This study explores the influence of prosodic features on listener responses to indirect requests using a specifically designed conversational TTS engine capable of controlling prosody, and generating speech across three different speaker profiles: female, male, and gender-ambiguous.We conducted two experiments to analyse how naturalistic variations in speech rate and vocal effort impact the likelihood of request compliance and perceived politeness.In the first experiment, we examined how prosodic modifications affect the perception of politeness in permission-and action requests.In the second experiment participants compared pairs of spoken requests, each rendered with different prosodic features, and chose which they were more likely to grant.Results indicate that both faster speech rate and higher vocal effort increased the willingness to comply, though the extent of this influence varied by speaker gender.Higher vocal effort in action requests increases the chance of being granted more than in permission requests.Politeness has a demonstrated positive impact on the likelihood of requests being granted, this effect is stronger for the male voice compared to female and gender-ambiguous voices.

Source: Annual Meeting of the Special Interest Group on Discourse and Dialogue

DOI: 10.18653/v1/2024.sigdial-1.40

Authors: Eva Szekely, Jeff Higginbotham, Francesco Possemato

Institutions: KTH Royal Institute of Technology, University at Buffalo, State University of New York, University of Groningen

Language: English

Topic: Speech and dialogue systems

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funders: Vetenskapsrådet, Riksbankens Jubileumsfond, National Institute on Disability, Independent Living, and Rehabilitation Research

Awards: CAPTivating: Comparative Analysis of Public speaking with Text-to-speech, G3588519582, Perception of speaker stance - using spontaneous speech synthesis to explore the contribution of prosody, context and speaker