A didactic overview of Transformer applications: model variations and user guidelines
Year: 2025
Type: article
Abstract: Transformers models were originally designed for the processing of textual data. In the last years they have been extended to handle different modalities of data including image and video, audio, tabular, and even multimodal data. Adapting the vanilla Transformer architecture is necessary to optimize the performance for each data type. The vast amount of new architectures that have emerged makes it difficult to detect and understand the differences with the original Transformer. This paper provides an overview of Transformer applications for various input modalities, and recommendations to guide the development and use of models.
Source: Logic Journal of IGPL
Authors: MI Cabrera-Bermejo, M Germán, D de la Rosa, MJ Del Jesus, AJ Rivera, D Elizondo, F Charte, MD Pérez Godoy
Institutions: Universidad de Jaén, De Montfort University
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $4,533
OpenAlex ID: W7127372158