Small Language Models (SLMs)- Concepts, Advantages, Limitations and Applications
Year: 2026
Type: article
Abstract: This article explores Small Language Models (SLMs) as an efficient and sustainable alternative to Large LanguageModels (LLMs). While LLMs such as GPT-4, Llama 3, and Google Gemini demonstrate impressive capabilities,their billions or trillions of parameters demand massive computational and energy resources. SLMs, withparameters ranging from a few million to a few billion, offer comparable performance in specific domains, withsignificant advantages: faster and more economical training, 5 to 10 times faster inference, 10 to 20 times greaterenergy efficiency, and the ability to run on edge devices. The article examines definitions, training and inferencecharacteristics, competitive advantages, and known limitations.
Author: Ricardo, Murer
Institution: SKF (Sweden)
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7118996837
FWCI:
Cites:
Cited by:
Related to: