Classification of tree symbiotic fungi based on hyperspectral imagery and hybrid convolutional neural networks

Frontiers in Forests and Global Change

Forests and Global Change

Mahmoud Al-Sarayreh¹  Yanjie Li²  Zhilin Yuan²  Zhuo Liu³ 

[1] Department of Computer Engineering, German Jordanian University, Amman, Jordan;Research Institute of Subtropical Forestry, Chinese Academy of Forestry, Hangzhou, China;Research Institute of Subtropical Forestry, Chinese Academy of Forestry, Hangzhou, China;College of Forestry, Nanjing Forestry University, Nanjing, China;

关键词: dark septate endophytes (DSEs);    2D-CNN;    3D-CNN;    deep learning;    spectral pre-processing;    hyperspectral imaging (HSI);   

DOI  :  10.3389/ffgc.2023.1179910

 received in 2023-03-05, accepted in 2023-04-20,  发布年份 2023

来源: Frontiers

【 摘 要 】

Hyperspectral imagery and machine learning have proven to be powerful, non-invasive, and chemical-free tools for studying tree symbiotic fungi. However, traditional machine learning requires manual feature extraction (feature engineering) of spectral and spatial features of tree symbiotic fungi. Deep convolutional neural networks (CNNs) can extract self and robust features directly from the raw data. In the current study, a deep CNN architecture is proposed to recognize the isolates of dark septate endophytic (DSE) fungal in hyperspectral images. The performance of different CNN approaches (two-dimensional and three-dimensional CNNs) was compared and evaluated based on two independent datasets collected using visible-near-infrared (VNIR) and short-wave-infrared (SWIR) hyperspectral imaging systems. Moreover, the impact of different spectral pre-processing techniques was investigated. The results show that a hybrid CNN architecture (3D-2D CNN), which combines three and two-dimensional CNNs, achieved the best performance for the classification of fungal isolates on SWIR hyperspectral data compared to the same architecture on VNIR hyperspectral data. The best performance is 100% for precision, recall, and overall accuracy. The results also demonstrate that combining different pre-processing techniques on raw SWIR spectra can significantly improve the performance of the CNN models for fungal classification. The hybrid CNN approach with SWIR hyperspectral data provides an efficient method for classifying fungal isolates, which can contribute to the development of accurate and non-destructive tools for evaluating the occurrence of fungal isolates on trees. Such tools can be beneficial for both sustainable agriculture and preserving fungal diversity.

【 授权许可】

Unknown   
Copyright © 2023 Liu, Al-Sarayreh, Li and Yuan.