Work

Examining Racial Bias in an Online Abuse Corpus with Structural Topic Modeling

Year: 2020
Type: preprint
Abstract: We use structural topic modeling to examine racial bias in data collected to train models to detect hate speech and abusive language in social media posts. We augment the abusive language dataset by adding an additional feature indicating the predicted probability of the tweet being written in African-American English. We then use structural topic modeling to examine the content of the tweets and how the prevalence of different topics is related to both abusiveness annotation and dialect prediction. We find that certain topics are disproportionately racialized and considered abusive. We discuss how topic modeling may be a useful approach for identifying bias in annotated data.
Authors: Davidson, Thomas, Bhattacharya, Debasmita
Institution: Cornell University
Language: English
Open Access status: green
OpenAlex ID: W3028915166
Cites: 18
Cited by: 12
Related to: 10