Work

From Transformers to Voting Ensembles for Interpretable Sentiment Classification: A Comprehensive Comparison

Year: 2025

Type: article

Abstract: This study conducts an in-depth investigation of the performance of six transformer models using 12 different datasets—10 with three classes and two with two classes—on sentiment classification. We use these six models and generate all combinations of triple schema ensembles, Majority and Soft vote. In total, we compare 46 classifiers on each dataset and see in one case up to a 7.6% increase in accuracy on a dataset with three classes from an ensemble scheme and, in a second case, up to 8.5% increase in accuracy on a dataset with two classes. Our study contributes to the field of natural language processing by exploring the reasons for the predominance, in this particular task, of Majority vote over Soft vote. The conclusions are drawn after a thorough investigation of the classifiers that are co-compared with each other through reliability charts, analyses of the confidence the models have in their predictions and their metrics, concluding with statistical analyses using the Friedman test and the Nemenyi post-hoc test with useful conclusions.

Source: Computers

DOI: 10.3390/computers14050167

Authors: Konstantinos Kyritsis, Charalampos M. Liapis, Isidoros Perikos, Michael Paraskevas, Vaggelis Kapoulas

Institutions: University of Peloponnese, Computer Technology Institute and Press “DIOPHANTUS”, University of Patras

Language: English

Topic: Sentiment Analysis and Opinion Mining

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $2,172

OpenAlex ID: W4409967444

FWCI: 2.447

Cites: 26

Cited by: 6

Related to: 10