Monitoring of Assembly Process Using Deep Learning Technology

Sensors

Jun Hong¹  Yang Guo²  Chengjun Chen²  Zhengxu Zhao²  Dongnian Li²  Chunlin Zhang²  Tiannuo Wang² 

[1] School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an 711049, China;School of Mechanical and Automotive Engineering, Qingdao University of Technology, Qingdao 266520, China;

关键词: monitoring of assembly process;    assembly action recognition;    segmentation of assembled products;    3D CNN;    batch normalization;    fully convolutional network;   

DOI  :  10.3390/s20154208

来源: DOAJ

【 摘 要 】

Monitoring the assembly process is a challenge in the manual assembly of mass customization production, in which the operator needs to change the assembly process according to different products. If an assembly error is not immediately detected during the assembly process of a product, it may lead to errors and loss of time and money in the subsequent assembly process, and will affect product quality. To monitor assembly process, this paper explored two methods: recognizing assembly action and recognizing parts from complicated assembled products. In assembly action recognition, an improved three-dimensional convolutional neural network (3D CNN) model with batch normalization is proposed to detect a missing assembly action. In parts recognition, a fully convolutional network (FCN) is employed to segment, recognize different parts from complicated assembled products to check the assembly sequence for missing or misaligned parts. An assembly actions data set and an assembly segmentation data set are created. The experimental results of assembly action recognition show that the 3D CNN model with batch normalization reduces computational complexity, improves training speed and speeds up the convergence of the model, while maintaining accuracy. Experimental results of FCN show that FCN-2S provides a higher pixel recognition accuracy than other FCNs.

【 授权许可】

Unknown