FUSION OF HYPERSPECTRAL, MULTISPECTRAL, COLOR AND 3D POINT CLOUD INFORMATION FOR THE SEMANTIC INTERPRETATION OF URBAN ENVIRONMENTS

International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences

Weinmann, M.^1¹ 

[1]Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, Germany^1

关键词: Scene Interpretation;    Classification;    Data Fusion;    Multispectral;    Hyperspectral;    3D;    Aerial Sensor Platform;   

DOI  :  10.5194/isprs-archives-XLII-2-W13-1899-2019

学科分类：地球科学(综合)

来源: Copernicus Publications

【 摘 要 】

In this paper, we address the semantic interpretation of urban environments on the basis of multi-modal data in the form of RGB color imagery, hyperspectral data and LiDAR data acquired from aerial sensor platforms. We extract radiometric features based on the given RGB color imagery and the given hyperspectral data, and we also consider different transformations to potentially better data representations. For the RGB color imagery, these are achieved via color invariants, normalization procedures or specific assumptions about the scene. For the hyperspectral data, we involve techniques for dimensionality reduction and feature selection as well as a transformation to multispectral Sentinel-2-like data of the same spatial resolution. Furthermore, we extract geometric features describing the local 3D structure from the given LiDAR data. The defined feature sets are provided separately and in different combinations as input to a Random Forest classifier. To assess the potential of the different feature sets and their combination, we present results achieved for the MUUFL Gulfport Hyperspectral and LiDAR Airborne Data Set.

【 授权许可】

CC BY