Work

Demo-ToT: Enhancing the Reasoning Capabilities of AI Agent via Improved Demonstrations Retrieval Strategy

Year: 2025

Type: article

Abstract: Innovative reasoning frameworks have been proposed to enhance the reasoning capabilities of AI agents, improving their performance in various tasks. However, most existing research has focused on enhancing designing frameworks for LLMs, with limited attention on leveraging in-context learning to boost their reasoning power. This paper proposes a novel approach, Demo-ToT, which enhances the Tree-of-Thought (ToT) reasoning framework by dynamically retrieving relevant demonstrations to improve reasoning accuracy. Various demonstration retrieval strategies, including vector similarity, sparse retrieval, and string similarity, were explored to identify the most effective methods for optimizing LLM performance. Experiments conducted across multiple benchmarks and language models of varying sizes demonstrated that Demo-ToT substantially enhanced the reasoning ability of smaller LLMs, achieving performance comparable to or even surpassing that of much larger models such as GPT-4.

Source: Big Data and Cognitive Computing

DOI: 10.3390/bdcc9110276

Authors: Jiahui Li, Bangbang Ren, Mengmeng Zhang, Honghui Chen

Institution: National University of Defense Technology

Language: English

Topic: Topic Modeling

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $2,172

Funder: National Natural Science Foundation of China