Classification of benign and malignant subtypes of breast cancer histopathology imaging using hybrid CNN-LSTM based transfer learning

BMC Medical Imaging

Research

Sathishkumar Natarajan¹  Junhyung Park¹  Dawood Babu Dudekula²  Mahati Munikoti Srikantamurthy²  V. P. Subramanyam Rallabandi² 

[1] 3BIGS Co. Ltd, 156, B-831, Geumgang Penterium IX Tower, 18469, Hwaseong, Republic of Korea;3BIGS Omicscore Pvt. Ltd., 909 Lavelle Building, Richmond Circle, 560025, Bangalore, India;

关键词: Histopathology;    Breast cancer;    Deep learning;    Image classification;   

DOI  :  10.1186/s12880-023-00964-0

 received in 2022-08-12, accepted in 2023-01-12,  发布年份 2023

来源: Springer

【 摘 要 】

BackgroundGrading of cancer histopathology slides requires more pathologists and expert clinicians as well as it is time consuming to look manually into whole-slide images. Hence, an automated classification of histopathological breast cancer sub-type is useful for clinical diagnosis and therapeutic responses. Recent deep learning methods for medical image analysis suggest the utility of automated radiologic imaging classification for relating disease characteristics or diagnosis and patient stratification.MethodsTo develop a hybrid model using the convolutional neural network (CNN) and the long short-term memory recurrent neural network (LSTM RNN) to classify four benign and four malignant breast cancer subtypes. The proposed CNN-LSTM leveraging on ImageNet uses a transfer learning approach in classifying and predicting four subtypes of each. The proposed model was evaluated on the BreakHis dataset comprises 2480 benign and 5429 malignant cancer images acquired at magnifications of 40×, 100×, 200× and 400×.ResultsThe proposed hybrid CNN-LSTM model was compared with the existing CNN models used for breast histopathological image classification such as VGG-16, ResNet50, and Inception models. All the models were built using three different optimizers such as adaptive moment estimator (Adam), root mean square propagation (RMSProp), and stochastic gradient descent (SGD) optimizers by varying numbers of epochs. From the results, we noticed that the Adam optimizer was the best optimizer with maximum accuracy and minimum model loss for both the training and validation sets. The proposed hybrid CNN-LSTM model showed the highest overall accuracy of 99% for binary classification of benign and malignant cancer, and, whereas, 92.5% for multi-class classifier of benign and malignant cancer subtypes, respectively.ConclusionTo conclude, the proposed transfer learning approach outperformed the state-of-the-art machine and deep learning models in classifying benign and malignant cancer subtypes. The proposed method is feasible in classification of other cancers as well as diseases.

【 授权许可】

CC BY   
© The Author(s) 2023

【 图 表 】

41116_2022_35_Article_IEq621.gif

41116_2022_35_Article_IEq593.gif

41116_2022_35_Article_IEq588.gif

41116_2022_35_Article_IEq574.gif

41116_2022_35_Article_IEq562.gif

41116_2022_35_Article_IEq550.gif

41116_2022_35_Article_IEq544.gif

Fig. 1

41116_2022_35_Article_IEq498.gif

Fig. 23

Fig. 21

41116_2022_35_Article_IEq446.gif