This is an open access article published by the IET under the Creative Commons Attribution License(http://creativecommons.org/licenses/by/3.0/)
The inner workings of the brain as a biological information processing system remain largely a mystery to science. Yet there is a growing interest in applying what is known about the brain to the design of novel computing systems, in part to explore hypotheses of brain function, but also to see if brain-inspired approaches can point to novel computational systems capable of circumventing the limitations of conventional approaches, particularly in the light of the slowing of the historical exponential progress resulting from Moore's Law. Although there are, as yet, few compelling demonstrations of the advantages of such approaches in engineered systems, a number of large-scale platforms have been developed recently that promise to accelerate progress both in understanding the biology and in supporting engineering applications. SpiNNaker (Spiking Neural Network Architecture) is one such large-scale example, and much has been learnt in the design, development and commissioning of this machine that will inform future developments in this area.
References
-
-
1)
-
8. Bi, G.Q., Poo, M.M.: ‘Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type’, J. Neurosci., 1998, 18, pp. 10464–10472.
-
2)
-
20. Brown, A.D., Furber, S., Reeve, J.S., et al: ‘SpiNNaker – programming model’, IEEE Trans. Comput., 2015, 64, (6), pp. 1769–1782.
-
3)
-
17. Painkras, E., Plana, L.A., Garside, J.D., et al: ‘SpiNNaker: a 1W 18-core system-on-chip for massively-parallel neural network simulation’, IEEE J. Solid-State Circuits, 2013, 48, (8), pp. 1943–1953 (doi: 10.1109/JSSC.2013.2259038).
-
4)
-
3. Mahowald, M.: ‘VLSI analogs of neuronal visual processing: a synthesis of form and function’. Ph.D. dissertation, , Pasadena, CA, 1992.
-
5)
-
24. Mundy, A., Knight, J., Stewart, T., et al: ‘An efficient SpiNNaker implementation of the neural engineering framework’. Proc. IJCNN 2015, Killarney, Ireland, 2015.
-
6)
-
7. Hebb, D.O.: ‘The organization of behavior: a neuropsychological theory’ (Wiley, New York, NY, 1949).
-
7)
-
12. Ahmad, S., Hawkins, J.: ‘Properties of sparse distributed representations and their application to hierarchical temporal memory’, CoRR, 2015, abs/1503.07469, pp. 1–18.
-
8)
-
18. Furber, S.B., Lester, D.R., Plana, L.A., et al: ‘Overview of the SpiNNaker system architecture’, IEEE Trans. Comput., 2013, 62, (12), pp. 2454–2467 (doi: 10.1109/TC.2012.142).
-
9)
-
6. Rall, W.: ‘Branching dendritic trees and motoneuron membrane resistivity’, Exp. Neurol., 1959, 1, pp. 491–527 (doi: 10.1016/0014-4886(59)90046-9).
-
10)
-
1. Kanerva, P.: ‘Sparse distributed memory’ (The MIT Press, 1988).
-
11)
-
9. Tully, P.J., Hennig, M.H., Lansner, A.: ‘Synaptic and nonsynaptic plasticity approximating probabilistic inference’, Front. Synaptic Neurosci., 2014, 6, (8), pp. 1–16.
-
12)
-
8. Bi, G.Q., Poo, M.M.: ‘Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type’, J. Neurosci., 1998, 18, pp. 10464–10472.
-
13)
-
26. Galluppi, F., Lagorce, X., Stromatias, E., et al: ‘A framework for plasticity implementation on the SpiNNaker neural architecture’, Front. Neurosci., 2014, 8, (429), .
-
14)
-
2. Moore, G.E.: ‘Cramming more components onto integrated circuits’, Electronics, 1965, 38, (8), pp. 114–117.
-
15)
-
19. Furber, S.B., Galluppi, F., Temple, S., et al: ‘The SpiNNaker project’, Proc. IEEE, 2014, 102, (5), pp. 652–665 (doi: 10.1109/JPROC.2014.2304638).
-
16)
-
25. Hopkins, M., Furber, S.: ‘Accuracy and efficiency in fixed-point neural ODE solvers’, Neural Comput., 2015, 27, (10), pp. 2148–2182 (doi: 10.1162/NECO_a_00772).
-
17)
-
16. Fox, P.J., Moore, S.W., Marsh, S.J.T., et al: ‘BluehiveVA field-programmable custom computing machine for extreme-scale real-time neural network simulation’. Proc. IEEE 20th Int. Symp. Field-Programmable Custom Comput.,March 2012, pp. 133–140.
-
18)
-
5. Hodgkin, A., Huxley, A.F.: ‘A quantitative description of membrane current and its application to conduction and excitation in nerve’, J. Physiol., 1952, 117, pp. 500–544 (doi: 10.1113/jphysiol.1952.sp004764).
-
19)
-
15. Schemmel, J., Bruderle, D., Grubl, A., et al: ‘A wafer-scale neuromorphic hardware system for large-scale neural modeling’. Proc. Int. Symp. Circuits System, 2010, pp. 1947–1950.
-
20)
-
14. Silver, R., Boahen, K., Grillner, S., et al: ‘Neurotech for neuroscience: unifying concepts, organizing principles, and emerging tools’, J. Neurosci., 2007, 27, (44), pp. 11807–11819 (doi: 10.1523/JNEUROSCI.3575-07.2007).
-
21)
-
23. Eliasmith, C., Stewart, T., Choo, X., et al: ‘A large-scale model of the functioning brain’, Science, 2012, 338, (6111), pp. 1202–1205 (doi: 10.1126/science.1225266).
-
22)
-
22. Eliasmith, C., Anderson, C.H.: ‘Neural engineering: computation, representation, and dynamics in neurobiological systems’ (MIT Press, Cambridge, MA, 2003).
-
23)
-
11. Stromatias, E., Neil, D., Pfeiffer, M., et al: ‘Robustness of spiking deep nelief networks to noise and reduced bit precision of neuro-inspired hardware platforms’, Front. Neurosci., 2015, 9, (222), .
-
24)
-
13. Merolla, P.A., Arthur, J.V., Alvarez-Icaza, R., et al: ‘A million spiking-neuron integrated circuit with a scalable communication network and interface’, Science, 2014, 345, (6197), pp. 668–673 (doi: 10.1126/science.1254642).
-
25)
-
21. Plana, L.A., Clark, D., Davidson, S., et al: ‘SpiNNaker: design and implementation of a GALS multi-core system-on-chip’, ACM J. Emerg. Technol. Comput. Syst., 2011, 7, (4), pp. 17:1–17:18 (doi: 10.1145/2043643.2043647).
-
26)
-
4. Izhikevich, E.M.: ‘Which model to use for cortical spiking neurons?’, IEEE Trans. Neural Netw., 2004, 15, pp. 1063–1070 (doi: 10.1109/TNN.2004.832719).
-
27)
-
10. LeCun, Y., Bengio, Y., Hinton, G.: ‘Deep learning’, Nature, 2015, 521, pp. 436–444 (doi: 10.1038/nature14539).
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cdt.2015.0171
Related content
content/journals/10.1049/iet-cdt.2015.0171
pub_keyword,iet_inspecKeyword,pub_concept
6
6