Fluent but Unfounded: A Review of Hallucination in Small Language Models
Year: 2026
Type: article
Abstract: Small language models (SLMs), compact generative models ranging from a few hundred million to roughly ten billion parameters, are increasingly chosen for on-device, private and cost-sensitive deployments. Their tendency to produce fluent but unsupported statements is nevertheless rarely treated as a distinct engineering problem. This review synthesizes research published up to November 2026 on why SLMs hallucinate, how the problem is measured, and which countermeasures exist at the model, inference and operational levels. Three arguments are made. First, the evidence points to several interacting causes, namely limited capacity for rare facts, training and evaluation incentives that reward guessing, unstable retrieval of knowledge the model does hold, and weak calibration, rather than to a single deficit. Second, reported hallucination rates depend strongly on model variant, decoding settings and task, so figures cannot be compared across studies without care. Third, no single safeguard suffices: reliability is better pursued as a layered stack that combines targeted fine-tuning, retrieval grounding, sampling-based consistency checks, abstention, and risk-proportionate human oversight. The review then maps these layers onto accountability and regulatory expectations and lists open problems, including size-controlled benchmarks and independent replication of promising small-scale methods.
Author: Salih, Youssef Ghalib
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7225824329
FWCI:
Cites:
Cited by:
Related to: