Year: 2025
Type: conference-paper
Abstract: The widespread use of language models, especially Large Language Models, paired with their inherent biases can propagate and amplify societal inequalities.While research has extensively explored methods for bias mitigation and measurement, limited attention has been paid to how such biases are communicated to users, which instead can have a positive impact on increasing user trust and understanding of these models.Our study addresses this gap by investigating user preferences for gender bias mitigation, measurement and communication in language models.To this end, we conducted a user study targeting female AI practitioners with eighteen female and one male participant.Our findings reveal that user preferences for bias mitigation and measurement show strong consensus, whereas they vary widely for bias communication, underscoring the importance of tailoring warnings to individual needs.Building on these findings, we propose a framework for user-centred bias reporting, which leverages runtime monitoring techniques to assess and visualise bias in real time and in a customizable fashion.
Authors: Chiara Di Bonaventura, Michelle Nwachukwu, Maria Stoica
Institutions: King's College London, Imperial College London
Language: English
Subfield: Safety Research
Field: Social Sciences
Domain: Social Sciences
Open Access status: hybrid
Award: G4269887845
OpenAlex ID: W4412944387