Work

Speed and Conversational Large Language Models: Not All Is About Tokens per Second

Year: 2024

Type: article

Abstract: The speed of open-weights large language models (LLMs) and its dependency on the task at hand, when run on GPUs, is studied to present a comparative analysis of the speed of the most popular open LLMs.

Source: Computer

DOI: 10.1109/mc.2024.3399384

Authors: Javier Conde, Miguel González, Pedro Reviriego, Zhen Gao, Shanshan Liu, Fabrizio Lombardi

Institutions: Universidad Politécnica de Madrid, Tianjin University, University of Electronic Science and Technology of China, Northeastern University

Language: English

Topic: Topic Modeling

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: Agencia Estatal de Investigación

Award: G8649509292

OpenAlex ID: W4401453602

FWCI: 1.786

Cites: 13

Cited by: 12

Related to: 10