Incongruent visual cues affect the perception of Mandarin vowel but not tone

Frontiers in Psychology

Psychology

Biao Zeng¹  Shanhu Hong²  Rui Wang³ 

[1] Department of Psychology, Bournemouth University, Poole, United Kingdom;EEG Lab, Department of Psychology, University of South Wales, Newport, United Kingdom;Institute of Foreign Language and Tourism, Quanzhou Preschool Education College, Quanzhou, China;Department of Psychology, Bournemouth University, Poole, United Kingdom;School of Foreign Languages, Guangdong Pharmaceutical University, Guangzhou, China;

关键词: incongruence effect;    lexical tone;    Mandarin;    audiovisual speech;    visual timing;    lip movement;    vowel;   

DOI  :  10.3389/fpsyg.2022.971979

 received in 2022-06-17, accepted in 2022-12-01,  发布年份 2023

来源: Frontiers

【 摘 要 】

Over the recent few decades, a large number of audiovisual speech studies have been focusing on the visual cues of consonants and vowels but neglecting those relating to lexical tones. In this study, we investigate whether incongruent audiovisual information interfered with the perception of lexical tones. We found that, for both Chinese and English speakers, incongruence between auditory and visemic mouth shape (i.e., visual form information) significantly interfered with reaction time and reduced the identification accuracy of vowels. However, incongruent lip movements (i.e., visual timing information) did not interfere with the perception of auditory lexical tone. We conclude that, in contrast to vowel perception, auditory tone perception seems relatively impervious to visual congruence cues, at least under these restricted laboratory conditions. The salience of visual form and timing information is discussed based on this finding.

【 授权许可】

Unknown   
Copyright © 2023 Hong, Wang and Zeng.