The interaction between stimulus factors and cognitive factors during multisensory integration of audiovisual speech

Frontiers in Psychology

Ryan A. Stevenson¹ 

关键词: multisensory processing;    audiovisual integration;    speech perception;    temporal processing;    sensory processing;    crossmodal;    perceptual binding;    speech integration;   

DOI  :  10.3389/fpsyg.2014.00352

学科分类：心理学（综合）

来源: Frontiers

【 摘 要 】

The amount of research focused on multisensory speech perception has expanded considerably in recent years. Much of this research has focused on which factors influence whether or not an auditory and a visual speech input are “integrated” (i.e., perceptually bound); a special case of how our perceptual systems solve the “binding problem” (Treisman, 1996). The factors that have been identified as influencing multisensory integration can be roughly divided into two groups. First are the low-level stimulus factors that include the physical characteristics of the sensory signals. The most commonly studied of these include the spatial (e.g., Macaluso et al., 2004; Wallace et al., 2004) and temporal (e.g., Miller and D'Esposito, 2005; Stevenson et al., 2011) relationship of the two inputs, and their relative effectiveness (e.g., James et al., 2012; Kim et al., 2012) in driving a neural, perceptual, or behavioral response. The second group of factors can be considered more higher-order or cognitive, and include factors such as the semantic congruence of the auditory and visual signals (Laurienti et al., 2004) or whether or not the gender of the speaker's voice is matched to the face (Lachs and Pisoni, 2004).

【 授权许可】

CC BY