Work

Domain Specific Data Quality Framework

Year: 2024
Type: dissertation
Abstract: Organizations are generating large volumes of data, including structured and unstructured types from various sources. Financial institutions, which rely heavily on accurate data, face unique challenges that require more knowledge related to the domain. This thesis develops a framework using a Retrieval-Augmented Generation (RAG) model, trained on financial data quality issues and solutions, to provide a context-aware data validation approach. \n \nThe research aims to bridge the gap between generic data quality checks and context aware approach. By comparing the RAG model's performance with traditional data quality management tools, this study evaluates its effectiveness based on metrics like timeliness, consistency, and completeness. \n \nThe findings suggest that integrating domain-specific knowledge into data validation processes can provide relevant information and can be utilized in financial data quality management. Future work will focus on improving and implementing the framework’s scalability and performance through using more relevant data and real-world testing.
Author: Raja, Komal
Language: English
Open Access status: green
OpenAlex ID: W7046441454
Cites: 8
Cited by:
Related to: 10