Semantic Mapping and Object Detection for Indoor Mobile Robots

2nd International Conference on Robotics and Mechantronics

计算机科学;无线电电子学

Kowalewski, S.^1 ; Maurin, A.L.^1 ; Andersen, J.C.^1

Department of Electrical Engineering, Danmarks Tekniske Universitet, Kgs. Lyngby, Denmark^1

关键词: Encountered objects;    Indoor mobile robots;    Point-clouds;    Semantic mapping;    SLAM algorithm;    State of the art;   

Others  :  https://iopscience.iop.org/article/10.1088/1757-899X/517/1/012012/pdf
DOI  :  10.1088/1757-899X/517/1/012012

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

In this paper the authors present a full solution for object-level semantic perception of the environment by indoor mobile robots. The proposed solution not only provides means for semantic mapping but also division of the environment into clusters representing singular object instances. The robot is provided with information that not only allows it to avoid collisions with obstacles present in the environment, but also information about the localization, the class and the shape of each encountered object instance. This level of perception enhances the robot's ability to interact with the environment. The state-of-the-art deep learning solution, Mask-RCNN, is used for the image segmentation task. The image processing network is combined with an RTAB-Map SLAM algorithm to generate semantic pointclouds of the environment. The final part of the paper is focused on pointcloud processing: providing methods for instance extraction and instance processing. To verify the performance of the proposed methodology multiple experiments are conducted. Through the evaluation of the results it is possible to identify possible improvements.