Review: Are we stumbling in our quest to find the best predictor? Over-optimism in sensor-based models for predicting falls in older adults

Healthcare Technology Letters

article

Tal Shany¹  Kejia Wang¹  Ying Liu¹  Nigel H. Lovell¹  Stephen J. Redmond¹ 

[1] Graduate School of Biomedical Engineering, University of New South Wales

关键词: geriatrics;    biomechanics;    body sensor networks;    feature extraction;    medical signal processing;    feature selection;    patient monitoring;    reviews;    telemedicine;    review;    sensor-based models;    fall prediction;    older adults;    fall risk testing;    wearable sensors;    feature extraction;    statistical models;    cross-validation technique;    feature selection;    prognostic tools;   

DOI  :  10.1049/htl.2015.0019

学科分类：肠胃与肝脏病学

来源: Wiley

【 摘 要 】

The field of fall risk testing using wearable sensors is bustling with activity. In this Letter, the authors review publications which incorporated features extracted from sensor signals into statistical models intended to estimate fall risk or predict falls in older people. A review of these studies raises concerns that this body of literature is presenting over-optimistic results in light of small sample sizes, questionable modelling decisions and problematic validation methodologies (e.g. inherent problems with the overly-popular cross-validation technique, lack of external validation). There seem to be substantial issues in the feature selection process, whereby researchers select features before modelling begins based on their relation to the target, and either perform no validation or test the models on the same data used for their training. This, together with potential issues related to the large number of features and their correlations, inevitably leads to models with inflated accuracy that are unlikely to maintain their reported performance during everyday use in relevant populations. Indeed, the availability of rich sensor data and many analytical options provides intellectual and creative freedom for researchers, but should be treated with caution, and such pitfalls must be avoided if we desire to create generalisable prognostic tools of any clinical value.

【 授权许可】

CC BY|CC BY-ND|CC BY-NC|CC BY-NC-ND