SerPyTor: A distributed context-aware computational graph execution framework for durable execution
Year: 2023
Type: preprint
Abstract: Distributed computation is always a tricky topic to deal with, especially in context of various requirements in various scenarios. A popular solution is to use Apache Spark with a setup of multiple systems forming a cluster. However, the prerequisite setup for a Spark cluster often induces an additional overhead, often limiting usage in constrained scenarios, especially in scenarios requiring context propagation. In this paper, we explore a relatively lightweight computational graph execution framework requiring little setup and fast speeds, coupled with context awareness.
Source: arXiv (Cornell University)
Authors: Roy, Anuran, S, Sridhar Raj
Institution: Vellore Institute of Technology University
Language: English
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4366342511