Skip to content

Attention mechanism based real-time gaze tracking in natural scenes with residual blocks

Research output: Contribution to journalArticlepeer-review

Gaze tracking is widely used in fatigue driving detection, eye disease diagnosis, mental illness diagnosis, website or advertising design, virtual reality, gaze-control devices and human-computer interaction. However, the influence of light, specular reflection and occlusion, the change of head pose, especially the ever-changing human pose in natural scenes, have brought great challenges to the accurate gaze tracking. In this paper, gaze tracking in natural scenes is studied, and a method based on Convolutional Neural Network (CNN) with residual blocks is proposed, in which attention mechanism is integrated into the network to improve the accuracy of gaze tracking. Furthermore, it is tested on the GazeFollow database which contains six kinds of databases. The results show that the performance of proposed method outperforms that of other state-of-the-art methods in natural scenes. Moreover, the proposed method has better real-time performance and is more suitable for practical applications.
Original languageEnglish
Number of pages11
JournalIEEE Transactions on Cognitive and Developmental Systems
Early online date8 Mar 2021
Publication statusEarly online - 8 Mar 2021


  • Postprint

    Rights statement: © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

    Accepted author manuscript (Post-print), 1.09 MB, PDF document

Related information

Relations Get citation (various referencing formats)

ID: 26667234