Work

A High-Performance Computing Cluster Intelligent Scheduling Algorithm Based on Graph Neural Network and Actor–Critic

Year: 2025

Type: article

Abstract: With the rapid growth of computation-intensive applications, high-performance computing (HPC) clusters have become essential for scientific computing, AI training, and industrial simulation. However, job scheduling in HPC clusters remains challenging due to heterogeneous resources, diverse task demands, and complex constraints. Traditional scheduling methods such as FCFS, SJF, and Backfilling show limited adaptability and struggle to achieve global optimization in large-scale environments. To address these issues, this paper proposes an intelligent scheduling method based on graph neural networks (GNNs) and deep reinforcement learning. A resource-constrained job–node bipartite graph is constructed to model task–node matching relationships, with node and task features capturing resource states and task demands. A GNN is employed to encode the scheduling state, and an Actor–Critic reinforcement learning framework is used to guide scheduling decisions. Simulation results show that, compared with other schedulers, the proposed GNN–Actor–Critic approach significantly improves average waiting time, average turnaround time, average slowdown, and overall resource utilization, demonstrating its effectiveness and practicality for HPC cluster scheduling.

Source: Electronics

DOI: 10.3390/electronics15010116

Authors: Xuemei Bai, Jingbo Zhou, Zhijun Wang

Institutions: Changchun University of Science and Technology, Changchun Normal University

Language: English

Topic: Distributed and Parallel Computing Systems

Subfield: Computer Networks and Communications

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $2,896

Funders: People's Government of Jilin Province, Changchun Normal University