An Approach to Aligning Categorical and Continuous Time Series for Studying the Dynamics of Complex Human Behavior

Frontiers in Psychology

卷:12

Rick Dale¹  Daichi Shimizu²  Kazuki Sekine³  Kentaro Kodama⁴ 

[1] Department of Communication, University of California, Los Angeles, Los Angeles, CA, United States;

[2] Department of Integrated Educational Sciences, Graduate School of Education, University of Tokyo, Tokyo, Japan;

[3] Faculty of Human Sciences, Waseda University, Saitama, Japan;

[4] University Education Center, Tokyo Metropolitan University, Tokyo, Japan;

关键词: visualization;    quantification;    recurrence analysis;    speech-motion coupling;    rap;   

DOI  :  10.3389/fpsyg.2021.614431

来源: DOAJ

【 摘 要 】

An emerging perspective on human cognition and performance sees it as a kind of self-organizing phenomenon involving dynamic coordination across the body, brain and environment. Measuring this coordination faces a major challenge. Time series obtained from such cognitive, behavioral, and physiological coordination are often complicated in terms of non-stationarity and non-linearity, and in terms of continuous vs. categorical scales. Researchers have proposed several analytical tools and frameworks. One method designed to overcome these complexities is recurrence quantification analysis, developed in the study of non-linear dynamics. It has been applied in various domains, including linguistic (categorical) data or motion (continuous) data. However, most previous studies have applied recurrence methods individually to categorical or continuous data. To understand how complex coordination works, an integration of these types of behavior is needed. We aimed to integrate these methods to investigate the relationship between language (categorical) and motion (continuous) directly. To do so, we added temporal information (a time stamp) to categorical data (i.e., language), and applied joint recurrence analysis methods to visualize and quantify speech-motion coordination coupling during a rap performance. We illustrate how new dynamic methods may capture this coordination in a small case-study design on this expert rap performance. We describe a case study suggesting this kind of dynamic analysis holds promise, and end by discussing the theoretical implications of studying complex performances of this kind as a dynamic, coordinated phenomenon.

【 授权许可】

Unknown