Large-scale simulations of plastic neural networks on neuromorphic hardware

Frontiers in Neuroanatomy

Philip Joseph Tully²  Anders eLansner²  James Courtney Knight³  Steve B Furber³  Bernhard A Kaplan⁵ 

[1] Royal Institute of Technology (KTH);Stockholm University;University Of Manchester;University of Edinburgh;Zuse Institute Berlin;

关键词: Learning;    plasticity;    SpiNNaker;    digital neuromorphic hardware;    Bayesian confidence propagation neural network (BCPNN);    event-driven simulation;   

DOI  :  10.3389/fnana.2016.00037

来源: DOAJ

【 摘 要 】

SpiNNaker is a digital, neuromorphic architecture designed for simulating large-scale spiking neural networks at speeds close to biological real-time. Rather than using bespoke analog or digital hardware, the basic computational unit of a SpiNNaker system is a general-purpose ARM processor, allowing it to be programmed to simulate a wide variety of neuron and synapse models. This flexibility is particularly valuable in the study of biological plasticity phenomena. A recently proposed learning rule based on the Bayesian Confidence Propagation Neural Network (BCPNN) paradigm offers a generic framework for modeling the interaction of different plasticity mechanisms using spiking neurons. However, it can be computationally expensive to simulate large networks with BCPNN learning since it requires multiple state variables for each synapse, each of which needs to be updated every simulation time-step. We discuss the trade-offs in efficiency and accuracy involved in developing an event-based BCPNN implementation for SpiNNaker based on an analytical solution to the BCPNN equations, and detail the steps taken to fit this within the limited computational and memory resources of the SpiNNaker architecture. We demonstrate this learning rule by learning temporal sequences of neural activity within a recurrent attractor network which we simulate at scales of up to 20000 neurons and 51200000 plastic synapses: the largest plastic neural network ever to be simulated on neuromorphic hardware. We also run a comparable simulation on a Cray XC-30 supercomputer system and find that, if it is to match the run-time of our SpiNNaker simulation, the super computer system uses approximatelymore power. This suggests that cheaper, more power efficient neuromorphic systems are becoming useful discovery tools in the study of plasticity in large-scale brain models.

【 授权许可】

Unknown