Tactile and Crossmodal Change Blindness and its Implications for Display Design.

Change Blindness;Multimodal Interfaces;Adaptive Interfaces;Industrial and Operations Engineering;Engineering;Industrial & Operations Engineering

Lu, Sara AnnMartin, Bernard J. ;

University of Michigan

关键词: Change Blindness;    Multimodal Interfaces;    Adaptive Interfaces;    Industrial and Operations Engineering;    Engineering;    Industrial & Operations Engineering;   

Others  :  https://deepblue.lib.umich.edu/bitstream/handle/2027.42/108870/salu_1.pdf?sequence=1&isAllowed=y

瑞士|英语

来源: The Illinois Digital Environment for Access to Learning and Scholarship

【 摘 要 】

Data overload, especially in the visual channel, and associated breakdowns in monitoring already represent a major challenge in data-rich environments. One promising means of overcoming data overload is through the introduction of multimodal displays, i.e., displays which distribute information across various sensory channels (including vision, audition, and touch). This approach has been shown to be effective in offloading the overburdened visual channel and thus reduce data overload. However, the effectiveness of these displays may be compromised if their design does not take into consideration limitations of human perception and cognition. One important question is the extent to which the tactile modality is susceptible to change blindness. Change blindness refers to the failure to detect even large and expected changes when these changes coincide with a ;;transient” stimulus. To date, the phenomenon has been studied primarily in vision, but there is limited empirical evidence that the tactile modality may also be subject to change blindness. If confirmed, this raises concerns about the robustness of multimodal displays and their use. A series of research activities described in this dissertation sought to answer the following questions: (1) to what extent, and under what circumstances, is the sense of touch susceptible to change blindness, (2) does change blindness occur crossmodally between vision and touch, and (3) how effective are three different display types for overcoming these phenomena. The effect of transient type, transient duration, and task demands were also investigated in the context of Unmanned Aerial Vehicle (UAV) control, the selected domain of application. The findings confirmed the occurrence of intramodal tactile change blindness, but not crossmodal change blindness. Subsequently, three countermeasures to intramodal tactile change blindness were developed and evaluated. The design of these countermeasures focused on supporting four of the five steps required for change detection and was found to significantly improve performance compared to when there was no countermeasure in place. Overall, this research adds to the knowledge base in multimodal and redundant information processing and can inform the design of multimodal displays not only for UAV control, but also other complex, data-rich domains.