Hierarchical Action Control: Adaptive Collaboration Between Actions and Habits

Frontiers in Psychology

article

Bernard W. Balleine¹  Amir Dezfouli² 

[1] Decision Neuroscience Laboratory, School of Psychology, University of New South Wales Sydney;Commonwealth Scientific and Industrial Research Organisation

关键词: goal-directed action;    habits;    action sequences;    chunking;    model-based;    model-free;    reinforcement learning;   

DOI  :  10.3389/fpsyg.2019.02735

学科分类：社会科学、人文和艺术（综合）

来源: Frontiers

【 摘 要 】

It is now commonly accepted that instrumental actions can reflect goal-directed control; i.e., they can show sensitivity to changes in the relationship to and the value of their consequences. With overtraining, stress, neurodegeneration, psychiatric conditions, or after exposure to various drugs of abuse, goal-directed control declines and instrumental actions are performed independently of their consequences. Although this latter insensitivity has been argued to reflect the development of habitual control, the lack of a positive definition of habits has rendered this conclusion controversial. Here we consider various alternative definitions of habit, including recent suggestions they reflect chunked action sequences, to derive criteria with which to categorize responses as habitual. We consider various theories regarding the interaction between goal-directed and habitual controllers and propose a collaborative model based on their hierarchical integration. We argue that this model is consistent with the available data, can be instantiated both at an associative level and computationally and generates interesting predictions regarding the influence of this collaborative integration on behavior.

【 授权许可】

CC BY