Fusion-based holistic road scene understanding

The Journal of Engineering

Wenqi Huang¹  Fuzheng Zhang² 

[1] Electric Power Research Institute , China Southern Power Grid, Guangzhou 510663 , People's Republic of China

关键词: 3D point clustering;    deep learning method;    conditional r;    om field framework;    object-level image segmentation;    semantic region labelling problem;    fusion-based holistic road scene underst;    ing;    CRF framework;    semantic object hypotheses;    KITTI dataset;   

DOI  :  10.1049/joe.2018.8319

学科分类：工程和技术（综合）

来源: IET

【 摘 要 】

This study addresses the problem of holistic road scene understanding based on the integration of visual and range data. To achieve the grand goal, the authors propose an approach that jointly tackles object-level image segmentation and semantic region labelling within a conditional random field (CRF) framework. Specifically, the authors first generate semantic object hypotheses by clustering 3D points, learning their prior appearance models, and using a deep learning method for reasoning their semantic categories. The learned priors, together with spatial and geometric contexts, are incorporated in CRF. With this formulation, visual and range data are fused thoroughly, and moreover, the coupled segmentation and semantic labelling problem can be inferred via graph cuts. The authors’ approach is validated on the challenging KITTI dataset that contains diverse complicated road scenarios. Both quantitative and qualitative evaluations demonstrate its effectiveness.

【 授权许可】

CC BY