Comparison of the effectiveness of different machine learning algorithms in predicting new fractures after PKP for osteoporotic vertebral compression fractures

Journal of Orthopaedic Surgery and Research

Research Article

Feng Yuan¹  Hongliang Chen¹  Qi Lu²  Yiming Ma² 

[1] Department of Orthopaedic Surgery, Affiliated Hospital of Xuzhou Medical University, 99 Huaihai Road, 221006, Xuzhou, Jiangsu, China;Department of Orthopaedic Surgery, Affiliated Hospital of Xuzhou Medical University, 99 Huaihai Road, 221006, Xuzhou, Jiangsu, China;Xuzhou Medical University, 209 Tongshan Road, 221004, Xuzhou, Jiangsu, China;

关键词: Machine learning;    Random forest;    Logistic regression;    Osteoporosis;    Percutaneous kyphoplasty;    New fracture;   

DOI  :  10.1186/s13018-023-03551-9

 received in 2022-08-16, accepted in 2023-01-19,  发布年份 2023

来源: Springer

【 摘 要 】

BackgroundThe use of machine learning has the potential to estimate the probability of a second classification event more accurately than traditional statistical methods, and few previous studies on predicting new fractures after osteoporotic vertebral compression fractures (OVCFs) have focussed on this point. The aim of this study was to explore whether several different machine learning models could produce better predictions than logistic regression models and to select an optimal model.MethodsA retrospective analysis of 529 patients who underwent percutaneous kyphoplasty (PKP) for OVCFs at our institution between June 2017 and June 2020 was performed. The patient data were used to create machine learning (including decision trees (DT), random forests (RF), support vector machines (SVM), gradient boosting machines (GBM), neural networks (NNET), and regularized discriminant analysis (RDA)) and logistic regression models (LR) to estimate the probability of new fractures occurring after surgery. The dataset was divided into a training set (75%) and a test set (25%), and machine learning models were built in the training set after ten cross-validations, after which each model was evaluated in the test set, and model performance was assessed by comparing the area under the curve (AUC) of each model.ResultsAmong the six machine learning algorithms, except that the AUC of DT [0.775 (95% CI 0.728–0.822)] was lower than that of LR [0.831 (95% CI 0.783–0.878)], RA [0.953 (95% CI 0.927–0.980)], GBM [0.941 (95% CI 0.911–0.971)], SVM [0.869 (95% CI 0.827–0.910), NNET [0.869 (95% CI 0.826–0.912)], and RDA [0.890 (95% CI 0.851–0.929)] were all better than LR.ConclusionsFor prediction of the probability of new fracture after PKP, machine learning algorithms outperformed logistic regression, with random forest having the strongest predictive power.Graphical Abstract

【 授权许可】

CC BY   
© The Author(s) 2023

【 图 表 】

41116_2022_35_Article_IEq161.gif

Fig. 2

41116_2022_35_Article_IEq158.gif

41116_2022_35_Article_IEq152.gif

41116_2022_35_Article_IEq146.gif

41116_2022_35_Article_IEq142.gif