Vision-Based Moving Obstacle Detection and Tracking in Paddy Field Using Improved Yolov3 and Deep SORT

Sensors

卷:20

Yufei Liu¹  Hui Fang¹  Nan Zhao¹  Lei Zhou¹  Yong He¹  Zhengjun Qiu¹  Liangliang Yang²  Mengcen Wang³ 

[1] College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou 310058, China;

[2] Faculty of Engineering, Kitami Institute of Technology, Koen-cho 165, Kitami, Hokkaido 090-8507, Japan;

[3] Ministry of Agriculture Key Laboratory of Molecular Biology of Crop Pathogens and Insects, Institute of Pesticide and Environmental Toxicology, Zhejiang University, Hangzhou 310058, China;

关键词: machine vision;    deep learning;    detecting and tracking;    moving obstacles;    paddy field;   

DOI  :  10.3390/s20154082

来源: DOAJ

【 摘 要 】

Using intelligent agricultural machines in paddy fields has received great attention. An obstacle avoidance system is required with the development of agricultural machines. In order to make the machines more intelligent, detecting and tracking obstacles, especially the moving obstacles in paddy fields, is the basis of obstacle avoidance. To achieve this goal, a red, green and blue (RGB) camera and a computer were used to build a machine vision system, mounted on a transplanter. A method that combined the improved You Only Look Once version 3 (Yolov3) and deep Simple Online and Realtime Tracking (deep SORT) was used to detect and track typical moving obstacles, and figure out the center point positions of the obstacles in paddy fields. The improved Yolov3 has 23 residual blocks and upsamples only once, and has new loss calculation functions. Results showed that the improved Yolov3 obtained mean intersection over union (mIoU) score of 0.779 and was 27.3% faster in processing speed than standard Yolov3 on a self-created test dataset of moving obstacles (human and water buffalo) in paddy fields. An acceptable performance for detecting and tracking could be obtained in a real paddy field test with an average processing speed of 5–7 frames per second (FPS), which satisfies actual work demands. In future research, the proposed system could support the intelligent agriculture machines more flexible in autonomous navigation.

【 授权许可】

Unknown