Research on the Gaze Direction of Head-Eye Data Fusion

International Journal of Advanced Network, Monitoring, and Controls

article

Xin Xu¹  Changyuan Wang¹ 

[1] School of Computer Science and Engineering Xi’an Technological University Xi’an

关键词: Head Pose Estimation;    Pupil Center Detection;    Line of Sight Direction;    Data Fusion;    Neural Network;   

DOI  :  10.21307/ijanmc-2021-031

学科分类：社会科学、人文和艺术（综合）

来源: Asociación Regional De Diálisis Y Trasplantes Renales

【 摘 要 】

The line of sight refers to the gaze direction of the human eye and reflects the focus of human attention. Head movement is an important accompanying behavior in the process of human gaze, and it is of great significance to human visual attention. This paper intends to combine the gaze focus calculation modeling of head movement and eye movement combined with deep learning data fusion. By combining the gaze direction calculation model of data fusion and neural network algorithm, deep learning technology is used to reveal the relationship between head movement and eye movement, and the data of head movement and eye movement are merged to realize accurate and fast real-time gaze spatial direction calculation. New ideas for improving the efficiency, reliability, usability and functionality of the gaze tracking system. In this paper, the convolutional neural network method is used, and the classification accuracy of the line of sight direction reaches 99% when the head posture is free.

【 授权许可】

CC BY-NC-ND