Type-Aware Programming Models for Distributed Applications
Year: 2016
Type: dissertation
Abstract: Modern applications are distributed: from the simplest interactive web applications to social networks with massive datacenters around the world.Even simple distributed applications depend on a complex ecosystem of servers, databases, and caches to operate.In order to scale services and handle turbulent internet traffic, developers of distributed applications constantly balance fundamental tradeoffs between parallelism and locality, replication and synchronization, consistency and availability.This task is made more difficult by the fact that each component operates independently by design, knowing little about the original intent of the application or its specific performance needs.Layers of abstraction between the application and its data prevent the system from adapting itself to better meet the requirements of the application.Distributed application developers need interfaces that can communicate the structure and semantics of their programs to distributed systems that know how to use that information to optimize performance.Programmers should be able to improve data layout without completely re-architecting the system, and tell the system which data accesses should be less accurate or the highest priority.The system should be able to find concurrency and exploit it, leveraging weaker constraints to improve performance.Programmers should be protected from common mistakes, such as consistency bugs, by the languages and platforms they use.This dissertation explores new programming models that use type systems and abstract data types to communicate application semantics to distributed systems.The new interfaces place minimal burden on programmers by using the abstract behavior of existing data structures to naturally express high-level properties.New runtime techniques and optimizations are proposed to correspond with each additional piece of information passed down to the underlying system.These techniques leverage concurrency both in massively data-parallel analytics workloads and in web-service workloads with abundant inter-request parallelism.First, we propose a way to automatically move computation closer to data, statically analyzing remote data accesses and improving locality through compiler-assisted lightweight thread migrations.Next, we present the design of global shared data structures that enable threads to cooperate rather than contend for access using distributed combining.Then we explore ways of exposing concurrency between transactions in distributed datastores using abstract properties of the datatypes, such as commutativity.Finally, we introduce a programming model, IPA, that makes it safer to trade off consistency for performance.Explicit performance and correctness constraints allow the system to adapt to changing conditions by relaxing the consistency of some operations, secure in the knowledge that the type system will enforce safety by requiring the developer to consider the effects of weak operations.Together, these programming models and techniques in this work contribute to the toolkit available to distributed application developers to make their lives easier and their software more robust.i There is an art, or rather, a knack to flying.The knack lies in learning how to throw yourself at the ground and miss.… Clearly, it is this second part, the missing, which presents the difficulties.-Douglas Adams, Life, the Universe and Everything I have been incredibly blessed during grad school to be surrounded by an amazing community of people who have challenged and inspired me to learn and do my best work, while also welcoming, supporting, and guiding me in this journey.First and foremost, I have had the distinct honor of having two fantastic advisors who have not only guided my research but mentored me in my development as a researcher.Luis's unstoppable stream of ideas, bubbling enthusiasm, and deep care for all his students has made everything fun, fostered my creativity, and helped me grow.Mark's solid advice, practical help, and healthy amount of cynicism has made me much more productive and successful than I would ever have been without his help.I am deeply grateful for all their guidance and fellowship.Thank you to all of my other mentors who have helped me grow as a researcher.A sincere thanks to Dan Ports, who has served as my advisor in all things "systems" and "distributed" as my research interests have drifted during my PhD.Thank you to the rest of my committee: Jevin West whose helpful advice guided me during
Author: Brandon Alexander Holt
Institution: University of Washington
Language: English
Subfield: Hardware and Architecture
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2585364659
