Detection and mitigation of biases in large language models through diverse lenses and methods for fairness
Year: 2025
Type: dissertation
Abstract: Advancements in language models have significantly improved the generation of coherent text. These models, alongside other neural network-based systems, have found success in various downstream applications within Natural Language Processing (NLP), including text classification and chatbot systems, thereby being integrated into various applications. However, a notable challenge arises as these models are susceptible to inheriting and perpetuating biases from their training data, particularly against certain demographics, such as gender and race, within specific contexts like professions and behavioral concepts. This underscores the importance of detecting bias within these systems and implementing measures to mitigate its impact. While there is a sizeable body of research on bias, detection, and mitigation, there are still important problems to be addressed. We extend this body of research in the following directions: (1) human traits and (2) leadership rating of public figures (3) we also introduce novel methodologies for detecting and mitigating bias, highlighting gaps in existing approaches. Our proposed approach introduces novel methods for detecting bias in upstream text generation systems, namely, Masked Language Models (MLMs) and Autoregressive Language Models (ALMs). In addition, we present strategies to mitigate bias in the upstream text generation systems and in downstream applications, specifically text classification systems.
DOI: 10.25820/etd.008128
Author: Shrestha, Ingroj
Language: English
Subfield: Safety Research
Field: Social Sciences
Domain: Social Sciences
SDG: Reduced inequalities
Open Access status: green
OpenAlex ID: W7105672243
Cites:
Cited by:
Related to: