The Effect of Prompt Types on Text Summarization Performance With Large Language Models
Year: 2024
Type: article
Abstract: This article presents a comparative analysis of three distinct prompting techniques—simple zero-shot, few-shot, and role-based—for the task of summarizing articles from diverse domains, using two large language models (LLMs): GPT 3.5 and Llama 2. The study investigates the efficacy of each prompt type in aiding summarization algorithms. The authors utilize two separate scoring metrics to ascertain the accuracy and cohesiveness of the generated summaries. Remarkably, findings indicate a predominant success of simple zero-shot prompts over their few-shot and role-based counterparts, for both LLMs. The superiority of simple zero-shot prompts underscores their versatility and potential for effective use across various topical spheres. The implications of this are significant, offering a streamlined approach to article summarization tasks and potential improvements in machine learning model training.
Source: Journal of Database Management
DOI: 10.4018/jdm.358475
Authors: Iffat Borhan, Akhilesh Bajaj
Institution: University of Tulsa
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4404131291