Marble melancholy: using crossmodal correspondences of shapes, materials, and music to predict music-induced emotions

Frontiers in Psychology

Psychology

German Molina¹  Mats B. Küssner²  Laura H. Gunn³  Sebastián Tedesco⁴  Bruno Mesz⁵  Felipe Reinoso-Carvalho⁶  Enrique Ter Horst⁶ 

[1] Bayesian Solutions LLC, Charlotte, NC, United States;Department of Musicology and Media Studies, Humboldt-Universität zu Berlin, Berlin, Germany;Department of Public Health Sciences, University of North Carolina at Charlotte, Charlotte, NC, United States;School of Data Science, University of North Carolina at Charlotte, Charlotte, NC, United States;Faculty of Medicine, Department of Primary Care and Public Health, Imperial College London, London, United Kingdom;Instituto de Investigación en Arte y Cultura, Universidad Nacional de Tres de Febrero, Sáenz Peña, Argentina;Instituto de Investigación en Arte y Cultura, Universidad Nacional de Tres de Febrero, Sáenz Peña, Argentina;Programa de Investigación STSEAS, EUdA, UNQ, Bernal, Argentina;Universidad de los Andes School of Management, Bogotá, Colombia;

关键词: crossmodal correspondences;    music-induced emotions;    shapes;    materials;    machine learning;    random forests;    sensory interactions;   

DOI  :  10.3389/fpsyg.2023.1168258

 received in 2023-02-17, accepted in 2023-08-08,  发布年份 2023

来源: Frontiers

【 摘 要 】

IntroductionMusic is known to elicit strong emotions in listeners, and, if primed appropriately, can give rise to specific and observable crossmodal correspondences. This study aimed to assess two primary objectives: (1) identifying crossmodal correspondences emerging from music-induced emotions, and (2) examining the predictability of music-induced emotions based on the association of music with visual shapes and materials.MethodsTo achieve this, 176 participants were asked to associate visual shapes and materials with the emotion classes of the Geneva Music-Induced Affect Checklist scale (GEMIAC) elicited by a set of musical excerpts in an online experiment.ResultsOur findings reveal that music-induced emotions and their underlying core affect (i.e., valence and arousal) can be accurately predicted by the joint information of musical excerpt and features of visual shapes and materials associated with these music-induced emotions. Interestingly, valence and arousal induced by music have higher predictability than discrete GEMIAC emotions.DiscussionThese results demonstrate the relevance of crossmodal correspondences in studying music-induced emotions. The potential applications of these findings in the fields of sensory interactions design, multisensory experiences and art, as well as digital and sensory marketing are briefly discussed.

【 授权许可】

Unknown   
Copyright © 2023 Mesz, Tedesco, Reinoso-Carvalho, Ter Horst, Molina, Gunn and Küssner.