Work

Performance Evaluation of SQL-on-Lake Engines and Traditional Data Warehouses for Analytical Workloads

Year: 2026
Type: article
Abstract: The rapid growth of big data and cloud computing has transformed the way organizations store, manage, and analyse large volumes of data. Among the emerging analytical platforms, SQL-on-Lake engines and traditional data warehouses have become widely adopted for supporting business intelligence and decision-making. However, selecting the most appropriate architecture remains challenging because each platform offers distinct advantages in terms of performance, scalability, and resource utilization. This study evaluated and compared the performance of SQL-on-Lake engines and traditional data warehouses for analytical workloads using an experimental approach. Performance evaluation was based on six metrics: query execution time, throughput, CPU utilization, memory utilization, scalability, and storage efficiency. The results showed that the traditional data warehouse consistently achieved lower query execution times, higher throughput, and more efficient CPU and memory utilization for structured analytical queries. In contrast, the SQL-on-Lake engine demonstrated superior scalability and storage efficiency, particularly as dataset size increased, making it more suitable for processing large-scale and heterogeneous datasets. The findings reveal that each architecture exhibits unique strengths depending on workload characteristics and operational requirements. The study concludes that neither architecture is universally superior for all analytical scenarios. It is therefore recommended that traditional data warehouses be adopted for latency-sensitive business intelligence applications, while SQL-on-Lake engines should be preferred for cloud-native environments requiring scalable, flexible, and cost-efficient analytics over diverse and rapidly growing datasets. The study contributes empirical evidence to support informed architectural decisions in modern data analytics.
Language: English
Open Access status: bronze
OpenAlex ID: W7235459144
FWCI:
Cites: 15
Cited by:
Related to: 10