Work

Gaze Estimation Network Based on Multi-Head Attention, Fusion, and Interaction

Year: 2025

Type: article

Abstract: Gaze is an externally observable indicator of human visual attention, and thus, recording the gaze position can help to solve many problems. Existing gaze estimation models typically utilize separate neural network branches to process data streams from both eyes and the face, failing to fully exploit their feature correlations. This study presents a gaze estimation network that integrates multi-head attention mechanisms, fusion, and interaction strategies to fuse facial features with eye features, as well as features from both eyes, separately. Specifically, multi-head attention and channel attention are used to fuse features from both eyes, and a face and eye interaction module is designed to highlight the most important facial features guided by the eye features; in addition, the channel attention in the Convolutional Block Attention Module (CBAM) is replaced with minimum pooling instead of maximum pooling, and a shortcut connection is added to enhance the network's attention to eye region details. Comparative experiments on three public datasets-Gaze360, MPIIFaceGaze, and EYEDIAP-validate the superiority of the proposed method.

Source: Sensors

DOI: 10.3390/s25061893

Authors: Changli Li, Fangfang Li, Kao Zhang, Nenglun Chen, Zhigeng Pan

Institution: Nanjing University of Information Science and Technology

Language: English

Topic: Gaze Tracking and Assistive Technology

Subfield: Human-Computer Interaction

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $3,137

Funder: National Natural Science Foundation of China