Classroom student posture recognition based on an improved high-resolution network

EURASIP Journal on Wireless Communications and Networking

Huansheng Ning¹  Yiwen Zhang²  Tao Zhu³  Zhenyu Liu³ 

[1] School of Computer and Communication Engineering, University of Science & Technology Beijing, Beijing, China;School of Computer, University of South China, 421001, Hengyang, Hunan, China;School of Computer, University of South China, 421001, Hengyang, Hunan, China;Hunan Provincial Base for Scientific and Technological Innovation Cooperation for Medical Big Data, Hengyang, China;

关键词: Pose estimation;    Support vector machine;    High-resolution networks;    Squeeze-and-excitation networks;    Object detection;   

DOI  :  10.1186/s13638-021-02015-0

来源: Springer

【 摘 要 】

Due to the large number of students in a typical classroom and crowded seating, most features of student posture are often obscured, making it difficult to balance the accuracy in identifying student postures with computational efficiency. To solve this issue, a novel classroom student posture recognition method is proposed. First, to recognize the poses of multiple students in the classroom, we use the you-only-look-once (YOLOv3) algorithm for object detection and retrain it to detect human objects that are hunching on a table, creating the pose estimation network. Next, to improve the accuracy of the pose estimation network, we use the squeeze-and-excitation network structure that is embedded in the residual structure of high-resolution networks (HRNet). Finally, with the improved HRNet algorithm’s outputs of key human body points, we design a pose classification algorithm based on a support vector machine, to classify human poses in the classroom. Experiments show that the improved HRNet multi-person pose estimation algorithm yields the best mean average precision performance of 73.76% on the common objects in context (COCO) validation dataset. We further test the proposed algorithm on a customer dataset collected in a classroom and achieved a high recognition rate of 90.1% and good robustness.

【 授权许可】

CC BY