Crop monitoring is one of the most important tasks in precision agriculture, and to reduce cost, such task is often performed autonomously by unmanned aerial and ground vehicles. To capture 3D geometric information about crops, existing systems mostly use LIDAR, but LIDAR is expensive and there is a desire to replace it with cheaper sensors like monocular cameras coupled with techniques to obtain 3D reconstructions from 2D images. One of the major disadvantages of many existing 3D reconstruction algorithms is that they assume the scene is static, and they cannot be used to monitor crops growing over time. Moreover, many existing 3D reconstruction algorithms are not designed to handle multi-spectral or hyper-spectral images, which are commonly used in precision agriculture to recover information that cannot be seen by naked eye. In this work I propose a full pipeline for building 3D reconstructions from temporal and multi-modal image sequences to use in precision agriculture applications. The three major technical contributions are: (1) 3D reconstruction for low-cost systems enabled by Gaussian process based continuous-time SLAM, (2) spatio-temporal 4D reconstruction to enable the monitoring of crops over time, and (3) weakly-supervised learning of local image descriptors between multiple image modalities. I also collected a multi-year growing crop dataset in order to evaluate the performance of the proposed pipeline.
【 预 览 】
附件列表
Files
Size
Format
View
Extending 3D reconstruction to temporal and multi-model sensor data for precision agriculture