Work

Hierarchical deep reinforcement learning for resilient de-icing in power-traffic coupled distribution networks

Year: 2026

Type: article

Abstract: Frequent extreme ice storms threaten the operational resilience of modern distribution networks. While coordinating Soft Open Points (SOPs) and Mobile De-icing Devices (MDIDs) offers a flexible spatiotemporal de-icing solution, jointly optimizing MDID traffic routing (discrete) and SOP power control (continuous) constitutes a complex bi-level problem. Traditional heuristics suffer from unacceptable online computational delays, and standard single-agent reinforcement learning struggles with gradient conflicts in mixed-action spaces. To address this, we propose a novel Goal-Conditioned Hierarchical Reinforcement Learning (HRL) framework. A Manager agent optimizes macroscopic MDID routing, while a Worker agent simultaneously regulates high-frequency SOP power flows to prevent cascading failures and electrical over-limits. Simulations on a 114-bus power-traffic coupled network demonstrate that HRL guarantees stable convergence, achieves millisecond-level real-time execution, and exhibits exceptional dynamic robustness against sudden traffic disturbances, significantly enhancing smart grid resilience.

Source: Energy Reports

DOI: 10.1016/j.egyr.2026.109850

Authors: Yuan Li, Tao Zheng, Shu Zheng, Jingtao Zhao, Yonghua Chen

Institutions: NARI Group (China), Xi'an Jiaotong University

Language: English

Topic: Optimal Power Flow Distribution

Subfield: Electrical and Electronic Engineering

Field: Engineering

Domain: Physical Sciences

SDGs: Industry, innovation and infrastructure, Affordable and clean energy

Open Access status: gold

Estimated APC paid: $3,040