Hybrid Data Management Architecture with Microservices Integrating SQL and NoSQL Databases for Asset Management Companies
Year: 2024
Type: article
Abstract: In today's financial technology ecosystem, asset management companies require the simultaneous processing of large volumes of structured and unstructured data. Traditional database systems alone are insufficient to address these complex requirements. This study presents a novel hybrid data management framework built on a microservices architecture, integrating SQL and NoSQL databases. The proposed architecture incorporates an innovative adapter layer that combines the flexible document-based structure of MongoDB with the robust relational capabilities of PostgreSQL. This adapter enables real-time data synchronization between the two database paradigms, leveraging the strengths of both systems. The architecture is designed to support complex data models required for managing non-performing loans in the asset management sector while offering high scalability. The paper details the key components of the hybrid architecture, data transformation strategies, and inter-service communication protocols. The proposed solution is built on a three-layered microservices architecture—data access layer, synchronization layer, and application layer—ensuring high performance and flexibility while maintaining data consistency. The design adheres to CAP theorem and ACID principles, guaranteeing data integrity and system consistency. This study introduces a new approach to integrating different database paradigms, addressing the complex data management needs of modern financial systems. The proposed architecture is adaptable not only for the asset management sector but also for other industries with similar hybrid data management requirements.
Institution: Istanbul Commerce University
Language: English
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: diamond
OpenAlex ID: W4406433840