Year: 2025
Type: conference-paper
Abstract: This paper evaluates the ability of seven Large Language Models(LLMs) to solve logic challenges. The models tested include GPT-4, Claude 3.5 (Sonnet and Haiku), Gemini 1.5, Llama 3.1, Grok,and Mistral 7B. Four challenges were proposed, and the resultsdemonstrate that none of the LLMs were able to solve all challengescorrectly. The study highlights the current limitations of LLMs inlogical reasoning tasks, despite advancements in other areas ofnatural language processing.
Source: Anais do Computer on the Beach
Author: Benjamin Grando Moreira
Institution: Universidade Federal de Santa Catarina
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: diamond
OpenAlex ID: W4410770399