Research on Chinese traditional opera costume recognition based on improved YOLOv5

Heritage Science

Research

Kaixuan Liu¹  Kai Lin¹  Chun Zhu¹ 

[1] School of Fashion and Art Design, Xi’an Polytechnic University, 710048, Xi’an, China;

关键词: Chinese opera;    Opera costume;    Costume image recognition;    YOLOv5;    Machine learning;   

DOI  :  10.1186/s40494-023-00883-x

 received in 2022-12-09, accepted in 2023-02-16,  发布年份 2023

来源: Springer

【 摘 要 】

In order to protect the cultural heritage of opera costumes, establish visual labels for opera costumes, accelerate the establishment of a database for opera costumes, and increase the dissemination of opera culture, we propose an improved You Only Look Once (YOLO) v5-based opera costume recognition model for opera costumes with a wide range of styles, rich colors, and complex stage environments. By adding Coordinate Attention (CA) mechanism to the backbone of YOLOv5, the network can focus on more interesting information when extracting features; replacing the original feature pyramid module with a weighted bidirectional feature pyramid module in the Neck part to achieve efficient fusion of features; replacing the original loss function GIOU with DIOU to improve the detection accuracy and convergence speed. The average detection accuracy of the improved YOLOv5 model reaches 86.3% and its inference speed reaches 28 ms per frame through experiments on the homemade Chinese costume dataset, which improves the average detection accuracy by 3.1% compared with the original model, and has good robustness in detecting complex scenes such as covered targets, light-colored costumes, cross targets, dense targets and different angles. The model meets the requirements for accuracy and real-time costume recognition in complex theatrical environments.

【 授权许可】

CC BY   
© The Author(s) 2023

【 图 表 】

Fig. 5

Fig. 1

Fig. 3

Fig. 1

Fig. 5

Fig. 4

Fig. 2

Fig. 4

40708_2023_185_Article_IEq24.gif

Fig. 1