期刊论文详细信息
Frontiers in Psychology
Auditory scene analysis and sonified visual images. Does consonance negatively impact on object formation when using complex sonified stimuli?
David J. Brown1 
关键词: auditory scene analysis;    consonance;    signal complexity;    blindness;    cross-modal;    sensory substitution;   
DOI  :  10.3389/fpsyg.2015.01522
学科分类:心理学(综合)
来源: Frontiers
PDF
【 摘 要 】

A critical task for the brain is the sensory representation and identification of perceptual objects in the world. When the visual sense is impaired, hearing and touch must take primary roles and in recent times compensatory techniques have been developed that employ the tactile or auditory system as a substitute for the visual system. Visual-to-auditory sonifications provide a complex, feature-based auditory representation that must be decoded and integrated into an object-based representation by the listener. However, we don’t yet know what role the auditory system plays in the object integration stage and whether the principles of auditory scene analysis apply. Here we used coarse sonified images in a two-tone discrimination task to test whether auditory feature-based representations of visual objects would be confounded when their features conflicted with the principles of auditory consonance. We found that listeners (N = 36) performed worse in an object recognition task when the auditory feature-based representation was harmonically consonant. We also found that this conflict was not negated with the provision of congruent audio–visual information. The findings suggest that early auditory processes of harmonic grouping dominate the object formation process and that the complexity of the signal, and additional sensory information have limited effect on this.

【 授权许可】

CC BY   

【 预 览 】
附件列表
Files Size Format View
RO201904024678882ZK.pdf 1359KB PDF download
  文献评价指标  
  下载次数:21次 浏览次数:3次