Work

RL-Ad: Integrating Eye-Tracking into a Reinforcement Learning Model for VR Video Ad Implantation

Year: 2025

Type: article

Abstract: The implantation of advertisement (ad) within VR videos presents a meaningful opportunity to engage users in immersive and interactive ways, enhancing the potential for effective advertising. However, the challenge lies in seamlessly implanting ad while maintaining the user’s immersive experience. To solve this problem, we construct a dataset comprising VR images and videos with eye tracking data, providing a crucial resource for gaining in-depth insights into user interactions within virtual environments. Based on this dataset, we propose a reinforcement learning model called RL-Ad, built on a Deep Q-Network (DQN), which can dynamically adjust ad implantation regions according to users’ eye movements. The proposed RL-Ad model aims at more precisely capturing user attention and increase their viewing duration on the implanted ads. Experimental results demonstrate that the proposed model can significantly improve the ad implantation by optimizing ad position and size to capture user attention while avoiding the interference in user experience.

Source: ACM Transactions on Sensor Networks

DOI: 10.1145/3744647

Authors: Qian Zhang, Yahui Tang, Chen Wang, Xun Zhang, Xiaoming Chen, Vera Chung

Institutions: Beijing Technology and Business University, The University of Sydney

Language: English

Topic: Gaze Tracking and Assistive Technology

Subfield: Human-Computer Interaction

Field: Computer Science

Domain: Physical Sciences

Open Access status: bronze

Funder: National Natural Science Foundation of China

Awards: G5854459504, G7885347620