Factors Impacting I/O Time Proportion in AI Workloads
Year: 2025
Type: conference-paper
Abstract: The decision to optimize I/O in scientific applications often depends on the proportion of I/O time within an application's runtime. For AI workloads, such as machine learning (ML), we observe that different configurations with the same data size can lead to varying I/O impacts. In this work, we analyze common tunable parameters—batch size, number of samples, and number of files—typically adjusted when adapting ML models to new datasets or use cases. Using the XGBoost model, we predict the I/O percentage for ResNet50 and UNet3D workloads and identify feature combinations that influence I/O behavior. Our results provide practical guidance for optimizing I/O performance in AI workloads.
Authors: Zoya Masih, Radita Liem, Julian Kunkel
Language: English
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4414210498