Using Globus as the high-performance data transport mechanism at Monash University
Year: 2024
Type: article
Abstract: Current in-house solutions have been pivotal in Monash University's data storage and transfer infrastructure; however, the data management requirements have outgrown currently used systems, particularly in their ability to provide data reliable ingest from the instruments generating large datasets and large volumes of data, ability to easily move the data between the storage and computing facilities, to automate the data processing pipelines, and easily share and collaborate on data. We ve been investigating various data orchestration solutions and deployed Globus as a pilot solution of choice. We report on our journey in trialling Globus. We will share our experience, challenges, and will discuss the deployed solutions across the Monash network and Monash eResearch infrastructure.
Author: Hargreaves, Mitchell
Institution: Monash University
Language: English
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W6912258526
FWCI:
Cites:
Cited by:
Related to: