Spatiotemporal patterns of parietofrontal activity and eye movements underlying the visual perception of complex human tool use

Electroencephalography;Eye tracking;Parietal;Frontal;Perception;Vision;Pattern recognition

Natraj, Nikhilesh ; Wheaton, Lewis A Nichols, Richard T Prilutsky, Boris I Shinohara, Minoru Schumacher, Eric Applied Physiology ; Wheaton, Lewis A

University:Georgia Institute of Technology

Department:Applied Physiology

关键词: Electroencephalography;    Eye tracking;    Parietal;    Frontal;    Perception;    Vision;    Pattern recognition;   

Others  :  https://smartech.gatech.edu/bitstream/1853/56207/1/NATRAJ-DISSERTATION-2015.pdf

美国|英语

来源: SMARTech Repository

【 摘 要 】

When watching a child learning to use a spoon, a mother is immediately able to recognize the error when the child grabs the bowl rather than the stem, or when the child uses the spoon to try and scoop paper. Recognizing proper tool grasp-postures and use-contexts is an ability vital for daily life and can be lost due to brain injury. A better understanding of how the brain encodes contextual and grasp-specific tool-use not only furthers basic neuroscience, but also has strong relevance to deficits arising from neural pathologies. However, the majority of research till date has studied the neural response to viewing tools in isolation or viewing simple tool-grasps. These studies have shown that the recognition of tools to be a complex visuomotor process, as not only was the visual cortex engaged but also parietal and frontal regions that underlie actual tool-use. The recognition of tools therefore involves automatically recalling their motor information (graspability and manipulability) via activation of parietofrontal motor regions, a property called action affordances. Yet, it is still unclear how parietofrontal regions encode the combination of contextual and grasp-specific tool-use scenes. In addition, parietofrontal regions are multifaceted and also underlie visuospatial attention and eye movements. It is possible a relationship might exist between eye movements, attention and tool-use understanding over parietofrontal regions. Therefore the overall goal of this thesis was to understand the spatiotemporal patterns of parietofrontal activity and eye movements underlying the perceptual of contextual and grasp-specific static tool use images. Electroencephalography (EEG) was used to measure neural activity, combined with eye tracking to measure fixation and saccades. Overall, results from this thesis present evidence that the affordances of non-functional grasp-postures perturbed an observer from understanding the contextual uses of tools, with corresponding unique patterns of parietofrontal activity and eye movements. This effect was most robust when the tool was placed in contexts that afforded a certain degree of tool-use. Results also revealed a relationship between attention, eye movements and action perception over parietofrontal regions. Specifically, saccades perturbed activity over frontal regions during the perception of non-functional grasp postures and in addition, there was greater engagement of the left precuneus in the superior parietal lobe if the observer had to quickly parse the scene information using peripheral vision and rely on short term memory. In contrast, there was greater engagement of the left middle temporal gyrus if the observer had the ability to parse scene information continuously using foveal attention. Results in this thesis shed light on the neural and visual mechanisms in understanding the affordances of non-functional grasp postures, and the relation between the two mechanisms. The automatic sensitivity in understanding the intent of non-functional grasp-postures may correspond to a lifetime of learning the affordances of grasp-specific action outcomes with tools. Such cognitive motor knowledge may be vital in navigating a human environment almost entirely constructed on advanced tool-use knowledge and findings from this thesis have many potential applications in the field of neuro-rehabilitation.