Facial affect recognition in context in adults with and without TBI

Frontiers in Psychology

Psychology

Sara V. Nurre¹  Sophie Wohltjen²  Bilge Mutlu²  Melissa C. Duff³  Lyn S. Turkstra⁴  Sam Hosseini-Moghaddam⁵ 

[1] American Speech-Language-Hearing Association, Rockville, MD, United States;Department of Computer Sciences, University of Wisconsin-Madison, Madison, WI, United States;Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, TN, United States;Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada;University of Toronto Schools, Toronto, ON, Canada;

关键词: traumatic brain injury;    speech-language pathology;    emotion recognition;    affect recognition;    social cognition;    facial expression;    eye-tracking;    communication;   

DOI  :  10.3389/fpsyg.2023.1111686

 received in 2022-11-29, accepted in 2023-07-31,  发布年份 2023

来源: Frontiers

【 摘 要 】

IntroductionSeveral studies have reported impaired emotion recognition in adults with traumatic brain injury (TBI), but studies have two major design features that limit application of results to real-world contexts: (1) participants choose from among lists of basic emotions, rather than generating emotion labels, and (2) images are typically presented in isolation rather than in context. To address these limitations, we created an open-labeling task with faces shown alone or in real-life scenes, to more closely approximate how adults with TBI label facial emotions beyond the lab.MethodsParticipants were 55 adults (29 female) with moderate to severe TBI and 55 uninjured comparison peers, individually matched for race, sex, and age. Participants viewed 60 photographs of faces, either alone or in the pictured person’s real-life context, and were asked what that person was feeling. We calculated the percent of responses that were standard forced-choice-task options, and also used sentiment intensity analysis to compare verbal responses between the two groups. We tracked eye movements for a subset of participants, to explore whether gaze duration or number of fixations helped explain any group differences in labels.ResultsOver 50% of responses in both groups were words other than basic emotions on standard affect tasks, highlighting the importance of eliciting open-ended responses. Valence of labels by participants with TBI was attenuated relative to valence of Comparison group labels, i.e., TBI group responses were less positive to positive images and the same was true for negative images, although the TBI group responses had higher lexical diversity. There were no significant differences in gaze duration or number of fixations between groups.DiscussionResults revealed qualitative differences in affect labels between adults with and without TBI that would not have emerged on standard forced-choice tasks. Verbal differences did not appear to be attributable to differences in gaze patterns, leaving open the question of mechanisms of atypical affect processing in adults with TBI.

【 授权许可】

Unknown   
Copyright © 2023 Turkstra, Hosseini-Moghaddam, Wohltjen, Nurre, Mutlu and Duff.