Work

Exploiting Unsupervised Pre-training and Automated Feature Engineering for Low-resource Hate Speech Detection in Polish

Year: 2019

Type: preprint

Abstract: This paper presents our contribution to PolEval 2019 Task 6: Hate speech and bullying detection. We describe three parallel approaches that we followed: fine-tuning a pre-trained ULMFiT model to our classification task, fine-tuning a pre-trained BERT model to our classification task, and using the TPOT library to find the optimal pipeline. We present results achieved by these three tools and review their advantages and disadvantages in terms of user experience. Our team placed second in subtask 2 with a shallow model found by TPOT: a~logistic regression classifier with non-trivial feature engineering.

Source: arXiv (Cornell University)

DOI: 10.48550/arxiv.1906.09325

Authors: Korzeniowski, Renard, Rolczyński, Rafał, Sadownik, Przemysław, Korbak, Tomasz, Możejko, Marcin

Language: English

Topic: Hate Speech and Cyberbullying Detection

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

OpenAlex ID: W2951727016

Cites: 13

Cited by: 3

Related to: 10