Point Cloud Semantic Segmentation Using a Deep Learning Framework for Cultural Heritage

Remote Sensing

Roberto Pierdicca¹  EvaSavina Malinverni¹  Francesca Matrone²  AndreaMaria Lingua²  Christian Morbidoni³  Emanuele Frontoni³  Marina Paolanti³  Massimo Martini³ 

[1] Dipartimento di Ingegneria Civile, Edile e dell’Architettura, Università Politecnica delle Marche, 60100 Ancona, Italy;Dipartimento di Ingegneria dell’Ambiente, del Territorio e delle Infrastrutture, Politecnico di Torino, 10129 Torino, Italy;Dipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, 60100 Ancona, Italy;

关键词: classification;    semantic segmentation;    digital cultural heritage;    point clouds;    deep learning;   

DOI  :  10.3390/rs12061005

来源: DOAJ

【 摘 要 】

In the Digital Cultural Heritage (DCH) domain, the semantic segmentation of 3D Point Clouds with Deep Learning (DL) techniques can help to recognize historical architectural elements, at an adequate level of detail, and thus speed up the process of modeling of historical buildings for developing BIM models from survey data, referred to as HBIM (Historical Building Information Modeling). In this paper, we propose a DL framework for Point Cloud segmentation, which employs an improved DGCNN (Dynamic Graph Convolutional Neural Network) by adding meaningful features such as normal and colour. The approach has been applied to a newly collected DCH Dataset which is publicy available: ArCH (Architectural Cultural Heritage) Dataset. This dataset comprises 11 labeled points clouds, derived from the union of several single scans or from the integration of the latter with photogrammetric surveys. The involved scenes are both indoor and outdoor, with churches, chapels, cloisters, porticoes and loggias covered by a variety of vaults and beared by many different types of columns. They belong to different historical periods and different styles, in order to make the dataset the least possible uniform and homogeneous (in the repetition of the architectural elements) and the results as general as possible. The experiments yield high accuracy, demonstrating the effectiveness and suitability of the proposed approach.

【 授权许可】

Unknown