Population response magnitude variation in inferotemporal cortex predicts image memorability

eLife

  ^{1    2    3    3    3    3} 

[1] Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, United States;Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, United States;Brain and Mind Institute, Western University, London, Canada;Department of Computer Science, Western University, London, Canada;Department of Psychology, University of Pennsylvania, Philadelphia, United States;

关键词: visual memory;    memorability;    inferotemporal cortex;    population coding;    neural network;    Rhesus macaque;   

DOI  :  10.7554/eLife.47596

来源: publisher

【 摘 要 】

10.7554/eLife.47596.001Most accounts of image and object encoding in inferotemporal cortex (IT) focus on the distinct patterns of spikes that different images evoke across the IT population. By analyzing data collected from IT as monkeys performed a visual memory task, we demonstrate that variation in a complementary coding scheme, the magnitude of the population response, can largely account for how well images will be remembered. To investigate the origin of IT image memorability modulation, we probed convolutional neural network models trained to categorize objects. We found that, like the brain, different natural images evoked different magnitude responses from these networks, and in higher layers, larger magnitude responses were correlated with the images that humans and monkeys find most memorable. Together, these results suggest that variation in IT population response magnitude is a natural consequence of the optimizations required for visual processing, and that this variation has consequences for visual memory.

【 授权许可】

CC BY