The use of machine learning and deep learning techniques to assess proprioceptive impairments of the upper limb after stroke

Journal of NeuroEngineering and Rehabilitation

Research

Stephen H. Scott¹  Delowar Hossain²  Sean P. Dukelow²  Tyler Cluff³ 

[1] Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, ON, Canada;Department of Clinical Neuroscience, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada;Faculty of Kinesiology, University of Calgary, Calgary, AB, Canada;

关键词: Stroke;    Proprioception;    Robotics;    Position sense;    Machine learning;    Deep learning;   

DOI  :  10.1186/s12984-023-01140-9

 received in 2022-04-01, accepted in 2023-01-18,  发布年份 2023

来源: Springer

【 摘 要 】

BackgroundRobots can generate rich kinematic datasets that have the potential to provide far more insight into impairments than standard clinical ordinal scales. Determining how to define the presence or absence of impairment in individuals using kinematic data, however, can be challenging. Machine learning techniques offer a potential solution to this problem. In the present manuscript we examine proprioception in stroke survivors using a robotic arm position matching task. Proprioception is impaired in 50–60% of stroke survivors and has been associated with poorer motor recovery and longer lengths of hospital stay. We present a simple cut-off score technique for individual kinematic parameters and an overall task score to determine impairment. We then compare the ability of different machine learning (ML) techniques and the above-mentioned task score to correctly classify individuals with or without stroke based on kinematic data.MethodsParticipants performed an Arm Position Matching (APM) task in an exoskeleton robot. The task produced 12 kinematic parameters that quantify multiple attributes of position sense. We first quantified impairment in individual parameters and an overall task score by determining if participants with stroke fell outside of the 95% cut-off score of control (normative) values. Then, we applied five machine learning algorithms (i.e., Logistic Regression, Decision Tree, Random Forest, Random Forest with Hyperparameters Tuning, and Support Vector Machine), and a deep learning algorithm (i.e., Deep Neural Network) to classify individual participants as to whether or not they had a stroke based only on kinematic parameters using a tenfold cross-validation approach.ResultsWe recruited 429 participants with neuroimaging-confirmed stroke (< 35 days post-stroke) and 465 healthy controls. Depending on the APM parameter, we observed that 10.9–48.4% of stroke participants were impaired, while 44% were impaired based on their overall task score. The mean performance metrics of machine learning and deep learning models were: accuracy 82.4%, precision 85.6%, recall 76.5%, and F1 score 80.6%. All machine learning and deep learning models displayed similar classification accuracy; however, the Random Forest model had the highest numerical accuracy (83%). Our models showed higher sensitivity and specificity (AUC = 0.89) in classifying individual participants than the overall task score (AUC = 0.85) based on their performance in the APM task. We also found that variability was the most important feature in classifying performance in the APM task.ConclusionOur ML models displayed similar classification performance. ML models were able to integrate more kinematic information and relationships between variables into decision making and displayed better classification performance than the overall task score. ML may help to provide insight into individual kinematic features that have previously been overlooked with respect to clinical importance.

【 授权许可】

CC BY   
© The Author(s) 2023

【 图 表 】

41116_2022_35_Article_IEq433.gif

12888_2022_4443_Article_IEq13.gif

12888_2022_4443_Article_IEq12.gif

12888_2022_4443_Article_IEq11.gif

12888_2022_4443_Article_IEq10.gif

12888_2022_4443_Article_IEq9.gif

12888_2022_4443_Article_IEq8.gif

Fig. 7

41116_2022_35_Article_IEq425.gif

12888_2022_4443_Article_IEq7.gif

12888_2022_4443_Article_IEq6.gif

12888_2022_4443_Article_IEq5.gif

41116_2022_35_Article_IEq421.gif

41116_2022_35_Article_IEq420.gif

41116_2022_35_Article_IEq419.gif

Fig. 6

41116_2022_35_Article_IEq412.gif

41116_2022_35_Article_IEq409.gif

Fig. 4

41116_2022_35_Article_IEq403.gif

41116_2022_35_Article_IEq348.gif