Year: 2025
Type: article
Abstract: This paper discusses the migration of data orchestration workflows from a legacy tool like Autosys to a modern, cloud -based solution, Google Cloud Composer. It explores the transition from traditional job scheduling to Directed Acyclic Graph (DAG) -based workflows using Apache Airflow, culminating in the deployment and management of these workflows in Cloud Composer. The benefits and challenges of this migration are examined, highlighting the advantages of scalability, flexibility, and cloud integration offered by Cloud Composer.
Author: Gautami Nadkarni
Institution: University at Buffalo, State University of New York
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: diamond
OpenAlex ID: W4409182443