Work

A Review on Real-time Data Pipelines for E-commerce Transactional Data Analytics

Year: 2025

Type: article

Abstract: The exponential growth of e-commerce has necessitated the development of robust real-time data pipelines capable of processing high-velocity transactional data for instant decision-making. This review paper systematically examines existing methodologies, tools, and challenges in designing and implementing such pipelines, focusing on ingestion, processing, and analytics layers. By analyzing recent literature, we evaluate architectural frameworks (e.g., Kafka, Spark, Flink), performance trade-offs (latency vs. throughput), and emerging trends (AutoML, event-driven architectures). The paper highlights gaps in scalability, privacy, and interpretability while proposing future directions for intelligent, self-optimizing pipelines. Keywords: Real-Time Data Processing, E-Commerce, Stream Processing, Apache Kafka, Fraud Detection, Automl,Genai, E-Commerce Data

Source: EPRA International Journal of Multidisciplinary Research (IJMR)

DOI: 10.36713/epra23838

Authors: Mahesha K, Sagar BR, Tejonidhi M, Yashwanth N, Ambika V

Language: English

Topic: Advanced Database Systems and Queries

Subfield: Computer Networks and Communications

Field: Computer Science

Domain: Physical Sciences

SDG: Industry, innovation and infrastructure

Open Access status: diamond

OpenAlex ID: W4413849764

FWCI:

Cites:

Cited by:

Related to: 10