Work

Large Language Models as Neurolinguistic Subjects: Discrepancy between Performance and Competence

Year: 2025

Type: conference-paper

Abstract: This study investigates the linguistic understanding of Large Language Models (LLMs) regarding signifier (form) and signified (meaning) by distinguishing two LLM assessment paradigms: psycholinguistic and neurolinguistic.Traditional psycholinguistic evaluations often reflect statistical rules that may not accurately represent LLMs' true linguistic competence.We introduce a neurolinguistic approach, utilizing a novel method that combines minimal pairs and diagnostic probing to analyze activation patterns across model layers.This method allows for a detailed examination of how LLMs represent form and meaning, and whether these representations are consistent across languages.We found: (1) Psycholinguistic and neurolinguistic methods reveal that language performance and competence are distinct; (2) Direct probability measurement may not accurately assess linguistic competence; (3) Instruction tuning won't change much competence but improve performance; (4) LLMs exhibit higher competence and performance in form compared to meaning.Additionally, we introduce new conceptual minimal pair datasets for Chinese (COMPS-ZH) and German (COMPS-DE), complementing existing English datasets.1

DOI: 10.18653/v1/2025.findings-acl.986

Authors: Linyang He, Ercong Nie, Helmut Schmid, Hinrich Schuetze, Nima Mesgarani, Jonathan Brennan

Institutions: University of Michigan, Columbia University, Munich Center for Machine Learning, Ludwig-Maximilians-Universität München

Language: English

Topic: Natural Language Processing Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Funder: Deutsche Forschungsgemeinschaft

Award: G7578079922

OpenAlex ID: W4412887882