Cardiac Cycle Affects the Asymmetric Value Updating in Instrumental Reward Learning

Frontiers in Neuroscience

Asako Toyama¹  Kentaro Katahira²  Kenta Kimura²  Noriaki Kanayama² 

[1] Graduate School of the Humanities, Senshu University, Tokyo, Japan;Human Informatics and Interaction Research Institute, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Japan;Japan Society for the Promotion of Science, Tokyo, Japan;

关键词: cardiac cycle;    decision-making;    interoception;    reinforcement leaning;    instrumental learning;    baroreflex;   

DOI  :  10.3389/fnins.2022.889440

来源: DOAJ

【 摘 要 】

This study aimed to investigate whether instrumental reward learning is affected by the cardiac cycle. To this end, we examined the effects of the cardiac cycle (systole or diastole) on the computational processes underlying the participants’ choices in the instrumental learning task. In the instrumental learning task, participants were required to select one of two discriminative stimuli (neutral visual stimuli) and immediately receive reward/punishment feedback depending on the probability assigned to the chosen stimuli. To manipulate the cardiac cycle, the presentation of discriminative stimuli was timed to coincide with either cardiac systole or diastole. We fitted the participants’ choices in the task with reinforcement learning (RL) models and estimated parameters involving instrumental learning (i.e., learning rate and inverse temperature) separately in the systole and diastole trials. Model-based analysis revealed that the learning rate for positive prediction errors was higher than that for negative prediction errors in the systole trials; however, learning rates did not differ between positive and negative prediction errors in the diastole trials. These results demonstrate that the natural fluctuation of cardiac afferent signals can affect asymmetric value updating in instrumental reward learning.

【 授权许可】

Unknown