Event-related potentials reveal early visual-tactile integration in the deaf

Psihologija

article

Siyi Liu¹  Aitao Lu¹  Haiping Tian¹  Yuexin Cai¹  Meifang Zhang¹  Tianhua Song¹  Guisheng Chen⁴  Dianning Qu⁷ 

[1] Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education;School of Psychology, Center of Studies of Psychological Application, and Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University;Longshan High School of Zhongshan;Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University;Institute of Hearing and Speech-Language Science, Sun Yat-sen University;Zhongshan School of Medicine, Sun Yat-sen University;School of Foreign Languages, Central South University

关键词: Hearing loss;    Visual-tactile interaction;    Perceptual encoding;    Multisensory integration;    Event-related Potential;   

DOI  :  10.2298/PSI210407003L

学科分类：内科医学

来源: Drustvo Psihologa Srbije

【 摘 要 】

This study examined visual-tactile perceptual integration in deaf and normal hearing individuals. Participants were presented with photos of faces or pictures of an oval in either a visual mode or a visual-tactile mode in a recognition learning task. Event-related potentials (ERPs) were recorded when participants recognized real faces and pictures of ovals in learning stage. Results from the parietal-occipital region showed that photos of faces accompanied with vibration elicited more positive-going ERP responses than photos of faces without vibration as indicated in the components of P1 and N170 in both deaf and hearing individuals. However, pictures of ovals accompanied with vibration produced more positive-going ERP responses than pictures of ovals without vibration in N170, which was only found in deaf individuals. A reversed pattern was shown in the temporal region indicating that real faces with vibration elicited less positive ERPs than photos of faces without vibration in both N170 and N300 for deaf, but such pattern did not appear in N170 and N300 for normal hearing. The results suggest that multisensory integration across the visual and tactile modality involves more fundamental perceptual regions than auditory regions. Moreover, auditory deprivation played an essential role at the perceptual encoding stage of the multisensory integration.

【 授权许可】

CC BY-SA