Work

Enhancing offline reinforcement learning for wastewater treatment via transition filter and prioritized approximation loss

Year: 2025

Type: article

Abstract: Wastewater treatment plays a crucial role in urban society, requiring efficient control strategies to optimize its performance. In this paper, we propose an enhanced offline reinforcement learning (RL) approach for wastewater treatment. Our algorithm improves the learning process. It uses a transition filter to sort out low-performance transitions and employs prioritized approximation loss to achieve prioritized experience replay with uniformly sampled loss. Additionally, the variational autoencoder is introduced to address the problem of distribution shift in offline RL. The proposed approach is evaluated on a nonlinear system and wastewater treatment simulation platform, demonstrating its effectiveness in achieving optimal control. The contributions of this paper include the development of an improved offline RL algorithm for wastewater treatment and the integration of transition filtering and prioritized approximation loss. Evaluation results demonstrate that the proposed algorithm achieves lower tracking error and cost.

Source: Neurocomputing

DOI: 10.1016/j.neucom.2025.129977

Authors: Ruyue Yang, Ding Wang, Menghua Li, Chengyu Cui, Junfei Qiao

Institutions: Beijing University of Technology, State Grid Corporation of China (China)

Language: English

Topic: Reinforcement Learning in Robotics

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

SDG: Clean water and sanitation

Open Access status: hybrid

Estimated APC paid: $2,670