CropPainter: an effective and precise tool for trait-to-image crop visualization based on generative adversarial networks

Plant Methods

Research

Lingfeng Duan¹  Hanzhi Wei¹  Jinyang Fu¹  Hongfei Chen¹  Wanneng Yang¹  Zhihao Wang¹  Zedong Geng¹ 

[1] National Key Laboratory of Crop Genetic Improvement, Key Laboratory of Agricultural Equipment for the Middle and Lower Reaches of the Yangtze River, Ministry of Agriculture, and College of Engineering, Hubei Hongshan Laboratory, National Center of Plant Gene Research, Huazhong Agricultural University, 430070, Wuhan, People’s Republic of China;

关键词: Crop visualization;    Virtual plant;    Crop phenotypic traits;    Deep learning;    Generative adversarial network;   

DOI  :  10.1186/s13007-022-00970-3

 received in 2022-07-04, accepted in 2022-12-05,  发布年份 2022

来源: Springer

【 摘 要 】

BackgroundVirtual plants can simulate the plant growth and development process through computer modeling, which assists in revealing plant growth and development patterns. Virtual plant visualization technology is a core part of virtual plant research. The major limitation of the existing plant growth visualization models is that the produced virtual plants are not realistic and cannot clearly reflect plant color, morphology and texture information.ResultsThis study proposed a novel trait-to-image crop visualization tool named CropPainter, which introduces a generative adversarial network to generate virtual crop images corresponding to the given phenotypic information. CropPainter was first tested for virtual rice panicle generation as an example of virtual crop generation at the organ level. Subsequently, CropPainter was extended for visualizing crop plants (at the plant level), including rice, maize and cotton plants. The tests showed that the virtual crops produced by CropPainter are very realistic and highly consistent with the input phenotypic traits. The codes, datasets and CropPainter visualization software are available online.ConclusionIn conclusion, our method provides a completely novel idea for crop visualization and may serve as a tool for virtual crops, which can assist in plant growth and development research.

【 授权许可】

CC BY   
© The Author(s) 2022

【 图 表 】

Fig. 1

Fig. 4

Fig. 4

Fig. 2

12888_2022_4482_Article_IEq1.gif

12982_2022_119_Article_IEq80.gif

12982_2022_119_Article_IEq75.gif

12982_2022_119_Article_IEq217.gif

Fig. 1

12982_2022_119_Article_IEq72.gif

12982_2022_119_Article_IEq65.gif