Eating and Drinking Recognition in Free-Living Conditions for Triggering Smart Reminders

Sensors

Joana Silva¹  Diana Gomes¹  Inês Sousa¹  João Mendes-Moreira² 

[1] Fraunhofer Portugal AICOS, 4200-135 Porto, Portugal;LIAAD-INESC TEC, 4200-465 Porto, Portugal;

关键词: classification;    data segmentation;    drinking recognition;    eating recognition;    elderly care;    human activity recognition;   

DOI  :  10.3390/s19122803

来源: DOAJ

【 摘 要 】

The increasingly aging society in developed countries has raised attention to the role of technology in seniors’ lives, namely concerning isolation-related issues. Independent seniors that live alone frequently neglect meals, hydration and proper medication-taking behavior. This work aims at eating and drinking recognition in free-living conditions for triggering smart reminders to autonomously living seniors, keeping system design considerations, namely usability and senior-acceptance criteria, in the loop. To that end, we conceived a new dataset featuring accelerometer and gyroscope wrist data to conduct the experiments. We assessed the performance of a single multi-class classification model when compared against several binary classification models, one for each activity of interest (eating vs. non-eating; drinking vs. non-drinking). Binary classification models performed consistently better for all tested classifiers (k-NN, Naive Bayes, Decision Tree, Multilayer Perceptron, Random Forests, HMM). This evidence supported the proposal of a semi-hierarchical activity recognition algorithm that enabled the implementation of two distinct data stream segmentation techniques, the customization of the classification models of each activity of interest and the establishment of a set of restrictions to apply on top of the classification output, based on daily evidence. An F1-score of 97% was finally attained for the simultaneous recognition of eating and drinking in an all-day acquisition from one young user, and 93% in a test set with 31 h of data from 5 different unseen users, 2 of which were seniors. These results were deemed very promising towards solving the problem of food and fluids intake monitoring with practical systems which shall maximize user-acceptance.

【 授权许可】

Unknown