Work

Short-term spatial-temporal energy forecasting in a Danish distribution grid using a hybrid transformer-graph neural network model

Year: 2025

Type: article

Abstract: The integration of renewable energy resources and the increasing need for grid balancing have intensified the demand for accurate short-term consumption and production forecasting in electricity grids. This progress has been facilitated by greater data availability and the development of advanced machine and deep learning algorithms. While models such as the Transformer have revolutionised temporal sequential data processing, spatial dependencies between nodes in electrical grids could improve predictions. This study proposes a spatial-temporal hybrid model that integrates a Graph Neural Network with a Transformer to capture both temporal and spatial relationships. The results show that the Transformer outperforms benchmark models, Long Short-Term Memory and Multilayer Perceptron, for consumption forecasting. Furthermore, incorporating a Graph Neural Network enhances consumption prediction accuracy. For production forecasting, the standalone Transformer slightly outperforms the hybrid model, suggesting less useful spatial correlations among production nodes. However, the hybrid model reduced trainable parameters by 57 %, making it more compact with minimal accuracy loss.

Source: Smart power & energy security.

DOI: 10.1016/j.spes.2025.05.002

Authors: Frederik Wagner Madsen, Theis Bank, Hamid Mirshekali, Hamid Reza Shaker

Institution: University of Southern Denmark

Language: English

Topic: Energy Load and Power Forecasting

Subfield: Electrical and Electronic Engineering

Field: Engineering

Domain: Physical Sciences

SDGs: Affordable and clean energy, Industry, innovation and infrastructure, Climate action

Open Access status: hybrid

Estimated APC paid: