Frontiers in Plant Science | |
Cotton leaf segmentation with composite backbone architecture combining convolution and attention | |
Plant Science | |
Wei Xu1  Jingkun Yan2  Pan Gao2  Weixin Ye2  Tianying Yan2  Xin Lv3  | |
[1] College of Agriculture, Shihezi University, Shihezi, China;College of Information Science and Technology, Shihezi University, Shihezi, China;National-Local Joint Engineering Research Center for Agricultural Big Data, Xinjiang Production and Construction Group, Shihezi, China;National-Local Joint Engineering Research Center for Agricultural Big Data, Xinjiang Production and Construction Group, Shihezi, China;College of Agriculture, Shihezi University, Shihezi, China; | |
关键词: cotton leaf segmentation; composite backbone; convolutional neural network; attention mechanism; transformer; | |
DOI : 10.3389/fpls.2023.1111175 | |
received in 2022-11-29, accepted in 2023-01-13, 发布年份 2023 | |
来源: Frontiers | |
【 摘 要 】
Plant leaf segmentation, especially leaf edge accurate recognition, is the data support for automatically measuring plant phenotypic parameters. However, adjusting the backbone in the current cutting-edge segmentation model for cotton leaf segmentation applications requires various trial and error costs (e.g., expert experience and computing costs). Thus, a simple and effective semantic segmentation architecture (our model) based on the composite backbone was proposed, considering the computational requirements of the mainstream Transformer backbone integrating attention mechanism. The composite backbone was composed of CoAtNet and Xception. CoAtNet integrated the attention mechanism of the Transformers into the convolution operation. The experimental results showed that our model outperformed the benchmark segmentation models PSPNet, DANet, CPNet, and DeepLab v3+ on the cotton leaf dataset, especially on the leaf edge segmentation (MIoU: 0.940, BIoU: 0.608). The composite backbone of our model integrated the convolution of the convolutional neural networks and the attention of the Transformers, which alleviated the computing power requirements of the Transformers under excellent performance. Our model reduces the trial and error cost of adjusting the segmentation model architecture for specific agricultural applications and provides a potential scheme for high-throughput phenotypic feature detection of plants.
【 授权许可】
Unknown
Copyright © 2023 Yan, Yan, Ye, Lv, Gao and Xu
【 预 览 】
Files | Size | Format | View |
---|---|---|---|
RO202310102550436ZK.pdf | 13864KB | download |