Why and how the brain weights contributions from a mixture of experts

NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS

卷:123

Review

O'Doherty, John P.^1,2  Lee, Sang Wan^3,4  Tadayonnejad, Reza^1,5  Cockburn, Jeff¹  Iigaya, Kyo¹  Charpentier, Caroline J.¹ 

[1] CALTECH, Div Humanities & Social Sci, Pasadena, CA 91125 USA

[2] CALTECH, Computat & Neural Syst Program, Pasadena, CA 91125 USA

[3] Korea Adv Inst Sci Technol KAIST, Dept Bio & Brain Engn, Daejeon 34141, South Korea

[4] Korea Adv Inst Sci Technol KAIST, Program Brain & Cognit Engn, Daejeon 34141, South Korea

[5] Univ Calif Los Angeles, Semel Inst Neurosci & Behav, Div Neuromodulat, Los Angeles, CA 90095 USA

关键词: Cognitive control;    Prefrontal cortex;    Basal ganglia;    Theoretical neuroscience;    Decision-making;   

DOI  :  10.1016/j.neubiorev.2020.10.022

来源: Elsevier

【 摘 要 】

It has long been suggested that human behavior reflects the contributions of multiple systems that cooperate or compete for behavioral control. Here we propose that the brain acts as a Mixture of Experts in which different expert systems propose strategies for action. It will be argued that the brain determines which experts should control behavior at any one moment in time by keeping track of the reliability of the predictions within each system, and by allocating control over behavior in a manner that depends on the relative reliabilities across experts. fMRI and neurostimulation studies suggest a specific contribution of the anterior prefrontal cortex in this process. Further, such a mechanism also takes into consideration the complexity of the expert, favoring simpler over more cognitively complex experts. Results from the study of different expert systems in both experiential and social learning domains hint at the possibility that this reliability-based control mechanism is domain general, exerting control over many different expert systems simultaneously in order to produce sophisticated behavior.

【 授权许可】

Free