Progress on Human-Object Interaction Detection of Deep Learning

Jisuanji kexue yu tansuo

RUAN Chenzhao, ZHANG Xiangsen, LIU Ke, ZHAO Zengshun¹ 

[1] College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao, Shandong 266590, China;

关键词: |human-object interaction (hoi) detection|computer vision|object detection|deep learning;   

DOI  :  10.3778/j.issn.1673-9418.2106004

来源: DOAJ

【 摘 要 】

The task of human-object interaction (HOI) detection takes the image as the input to detect the interaction between people and objects in the image and the interaction verbs between them. It is a new task besides target detection, image segmentation and target tracking in the field of computer vision, in order that the image can be understood deeply. Aiming at filling the gap in the current review article of HOI detection based on deep learning, the methods for HOI detection are classified and analyzed. Firstly, the early methods are summarized briefly, the two-stage methods and one-stage methods are investigated according to the structure of model, and some representative algorithms are analyzed and introduced. The two-stage methods are focused on, which are divided into 3 categories: attention-aware, graph model, posture and body parts. What’s more, the basic ideas, advantages and disadvantages of each type of method are summarized. Besides, the experimental evaluation metrics, the benchmark data sets of HOI detection and the experimental results of most existing methods are introduced in detail and the results obtained by different types of methods are described. Finally, the main challenges of this technology are summarized and the future direction of development is prospected.

【 授权许可】

Unknown