Work

Evaluation of Prompt Engineering on the Performance of a Large Language Model in Document Information Extraction

Year: 2025

Type: article

Abstract: The accelerated digitization of documentation, including paper invoices and receipts, has mitigated the necessity for precise and expeditious information management. Nevertheless, it has become unfeasible for humans to manually capture data due to the laborious and time-consuming nature of the process. The paper proposed a low training cost, prompt-based applied key information extraction (applied KIE) pipeline of the information extraction approach with Amazon Textract and Automatic Prompt Engineer (APE) using large language models (LLMs). A series of experiments were conducted to evaluate the performance of the proposed approach, with the results indicating an average precision of 95.5% and document information extraction accuracy of 91.5% on the SROIE (a widely used English dataset), and an average precision of 97.15% and a document information extraction accuracy of 85.29% on the invoice dataset from a Taiwanese shipping company.

Source: Electronics

DOI: 10.3390/electronics14112145

Authors: Lun-Chi Chen, Hsin-Tzu Weng, Mayuresh Sunil Pardeshi, Chien-Ming Chen, Ruey-Kai Sheu, Kai-Chih Pai

Institutions: Tunghai University, University of Petroleum and Energy Studies, National Taichung University of Science and Technology

Language: English

Topic: Handwritten Text Recognition Techniques

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $2,896

OpenAlex ID: W4410721853

FWCI: 4.672

Cites: 37

Cited by: 13

Related to: 10