Year: 2024
Type: preprint
Abstract: In Polaris, we introduced a cloud-native distributed query processor to perform analytics at scale. In this paper, we extend the underlying Polaris distributed computation framework, which can be thought of as a read-only transaction engine, to execute general transactions (including updates, deletes, inserts and bulk loads, in addition to queries) for Tier 1 warehousing workloads in a highly performant and predictable manner. We take advantage of the immutability of data files in log-structured data stores and build on SQL Server transaction management to deliver full transactional support with Snapshot Isolation semantics, including multi-table and multi-statement transactions. With the enhancements described in this paper, Polaris supports both query processing and transactions for T-SQL in Microsoft Fabric.
Source: arXiv (Cornell University)
Authors: Aguilar-Saborit, Josep, Ramakrishnan, Raghu, Bocksrocker, Kevin, Halverson, Alan, Kosinsky, Konstantin, O'Connor, Ryan, Poliakova, Nadejda, Shafiei, Moe, Kim, Taewoo, Kon-Kim, Phil, Mahmud-Ansari, Haris, Matuszyk, Blazej, Miles, Matt, Mohanan, Sumin, Petculescu, Cristian, Rahesh-Madan, Ishan, Rose-Wirshing, Emma, Yousefi, Elias
Institution: Microsoft (United States)
Language: English
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4391157491