Work

Imbalanced Multi-Class Research Article Classification using Sentence Transformers and Machine Learning Algorithms

Year: 2024

Type: conference-paper

Abstract: Categorizing scientific articles into specific research fields is a challenging problem, considering the volume and variety of published literature. However, existing classification systems often suffer from limitations regarding taxonomy or the models used for classification. This article explores approaches built on Sentence Transformer embeddings combined with Machine Learning algorithms to classify articles into 123 predefined classes, with the dataset being heavily imbalanced in nature. The effectiveness of Large Language Models (LLMs) for generating synthetic data is also experimented with, along with synonym augmentation and SMOTE. The best-performing model, the One vs Rest classifier trained on MP-Net sentence embeddings with SMOTE, achieved an accuracy of 77%, and outperformed all the other models.

DOI: 10.1145/3703323.3703698

Authors: Saliq Gowhar, Praveen Kempaiah, Sowmya Kamath S, Vijayan Sugumaran

Institutions: National Institute of Technology Karnataka, Oakland University

Language: English

Topic: Text and Document Classification Technologies

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

OpenAlex ID: W4411624583

FWCI:

Cites: 7

Cited by:

Related to: 10