Work

Heat Transfer and Drag Control in Tandem Circular Cylinders Using PPO-Based Deep Reinforcement Learning for Synthetic-Jet Actuation

Year: 2026
Type: article
Abstract: This study investigates heat-transfer and drag control in tandem circular cylinders using proximal policy optimization (PPO)-based deep reinforcement learning for closed-loop synthetic-jet actuation. Two-dimensional unsteady laminar computational fluid dynamics simulations were coupled with PPO controllers. Separate policies were trained for six spacing ratios (L/D = 5–10) at Reynolds numbers Re = 100, 150, and 200, using equally weighted heat-transfer and drag objectives. The sum of the percentage drag reductions and heat-transfer changes of both cylinders was positive at all 18 training conditions (5.2–40.3). Upstream heat transfer increased by 2.3–4.4% across all training conditions, while downstream drag reduction reached 49.3%. At Re = 100, downstream heat transfer was largely maintained, whereas higher Reynolds numbers exhibited reduced downstream heat transfer accompanying greater drag reduction, revealing a thermal–aerodynamic trade-off. Representative flow-field analyses associated downstream responses with changes in mean velocity and temperature, and upstream drag responses with distinct vorticity and temperature distributions. This sum remained positive at all 12 untrained conditions at Re = 125 and 175 but decreased markedly at L/D = 9 and 10. These findings highlight the potential and limitations of PPO-based synthetic-jet control for balancing heat-transfer enhancement and drag reduction in tandem-cylinder configurations.
Source: Energies
Language: English
Open Access status: gold
Estimated APC paid: $3,137
OpenAlex ID: W7225906600
FWCI:
Cites: 25
Cited by:
Related to: 10