© The Institution of Engineering and Technology
This study presents energy and area-efficient hardware architectures to map fully parallel cortical columns on reconfigurable platform – field programmable gate arrays (FPGAs). An area-efficient architecture is proposed at the system level and benchmarked with a speech recognition application. Owing to the spatio-temporal nature of spiking neurons it is more suitable to map such architectures on FPGAs where signals can be represented in binary form and communication can be performed through the use of spikes. The viability of implementing multiple recurrent neural reservoirs is demonstrated with a novel multiplier-less reconfigurable architectures and a design strategy is devised for its implementation.
References
-
-
1)
-
10. Ghani, A., McGinnity, T.M., Maguire, L.P., Harkin, J.G.: ‘Neuro-inspired speech recognition with recurrent spiking neurons’. 5163), Springer-Verlag, 2008, pp. 513–522.
-
2)
-
2. Jaeger, H., Haas, H.: ‘Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication’, Science, 2004, 304, (5667), pp. 78–80 (doi: 10.1126/science.1091277).
-
3)
-
4)
-
24. Gerstner, W., Kistler, W.: ‘Spiking neuron models – single neurons, populations, plasticity’ (Cambridge University Press, UK, 2002).
-
5)
-
6. Vandoorne1, K., Fiers, M., Vaerenbergh, T., , et al: ‘Advances in photonic reservoir computing on an integrated platform’. Int. Conf. on Transparent Optical Networks, 2011, pp. 1–4.
-
6)
-
17. Rabiner, L.R., Schafer, R.W.: ‘Digital processing of speech signals’, J. Acoust. Soc. Am., 1980, 67, (4), pp. 1406–1407. ( (doi: 10.1121/1.384160).
-
7)
-
4. Joshi, P., Maass, W.: ‘Movement generation and control with generic neural microcircuits’. BIO-ADIT, 2004.
-
8)
-
5. Yin, J., Meng, Y., Jin, Y.: ‘A developmental approach to structural self-organisation in reservoir computing’, IEEE Trans. Auton. Mental Dev., 2012, 4, (4), pp. 273–289 (doi: 10.1109/TAMD.2012.2182765).
-
9)
-
22. Yoshimura, Y., Dantzker, J.L.M., Callaway, E.M.: ‘Excitatory cortical neurons form fine scale functional networks’, Nature, 2005, 433, pp. 868–873 (doi: 10.1038/nature03252).
-
10)
-
8. Skowronski, M.D., Harris, J.G.: ‘Automatic speech recognition using a predictive echo state network classifier’, Neural Netw., 2007, 20, (3), pp. 414–423 (doi: 10.1016/j.neunet.2007.04.006).
-
11)
-
26. Xilinx Virtex II Pro. Hardware, Xilinx Inc.: .
-
12)
-
16. Alexander, , O'Shaughnessy, D.: . 1998, pp. 29–32.
-
13)
-
11. Ghani, A., McGinnity, T.M., Maguire, L., McDaid, L., Belatreche, A.: ‘Neuro-inspired speech recognition based on reservoir computing’. Advances in Speech Recognition, September 2010, pp. 164, .
-
14)
-
13. Maguire, L.P., McGinnity, T.M., Glackin, B., Ghani, A., Belatreche, A., Harkin, J.: ‘Challenges for large-scale implementations of spiking neural networks on FPGAs’, J. Neurocomput., 2006, 71, (1–3), pp. 13–29 (doi: 10.1016/j.neucom.2006.11.029).
-
15)
-
15. Doddington, G.R., Schalk, T.B.: ‘Speech recognition: turning theory to practice’, IEEE Spectrum, 1981, 18, (9), pp. 26–32 (doi: 10.1109/MSPEC.1981.6369809).
-
16)
-
14. Ghani, A., McGinnity, T.M., Maguire, L.P., Harkin, J.G.: ‘Area efficient architecture for large scale implementation of biologically plausible spiking neural networks on reconfigurable hardware’. FPL, 2006, pp. 1–2.
-
17)
-
9. Uysal, I., Sathyendra, H., Harris, J.G.: ‘Spike based feature extraction for noise robust speech recognition using phase synchrony coding’. ISCAS, 2007, pp. 1529–1532.
-
18)
-
19. Braitenberg, V., Schuz, A.: ‘Anatomy of the cortex: statistics and geometry’ (Springer-Verlag, NY, 1991).
-
19)
-
12. Ghani, A., McDaid, L.J., Belatreche, A., Ahmed, W.: ‘Neuro-inspired reconfigurable architecture for hardware/software co-design’. IEEE Int. Conf. on System on Chip, SOCC, 2009, pp. 287–290.
-
20)
-
21. Foldy, C., Dyhrfjeld-Johnsen, J., Soltesz, I.: ‘Structure of cortical microcircuit theory’, J. Physiol., 2005, 562, pp. 47–54 (doi: 10.1113/jphysiol.2004.076448).
-
21)
-
20. Holmgren, C., Harkany, T., Svennenfors, B., Zilberter, Y.: ‘Pyramidal cell communication within local networks in layer 2/3 of rat neocortex’, J. Physiol., 2003, 551, pp. 139–153 (doi: 10.1113/jphysiol.2003.044784).
-
22)
-
18. Gupta, A., Wang, Y., Markram, H.: ‘Organizing principles for a diversity of GABAergic interneuron and synapses in the neocortex’, Science, 2000, 287, pp. 273–278 (doi: 10.1126/science.287.5451.273).
-
23)
-
23. Maass, W., Bishop, C.: ‘Pulsed neural networks’ (The MIT Press, Massachusetts, 1999).
-
24)
-
1. Maass, W., Natschläger, T., Markram, H.: ‘Real-time computing without stable states: a new framework for neural computation based on perturbations’, Neural Comput., 2002, 14, (11), pp. 2531–2560 (doi: 10.1162/089976602760407955).
-
25)
-
3. Verstraeten, D., Schrauwen, B., D'Haene, M., Stroobandt, D.: ‘An experimental unification of reservoir computing methods’, Neural Netw., 2007, 20, pp. 391–403 (doi: 10.1016/j.neunet.2007.04.003).
-
26)
-
7. Yin, J., Meng, Y.: ‘Reservoir computing ensembles for multi-object behavior recognition’. IEEE World Congress on Computational Intelligence, 2012, pp. 1–8.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-smt.2014.0004
Related content
content/journals/10.1049/iet-smt.2014.0004
pub_keyword,iet_inspecKeyword,pub_concept
6
6