Real-time P300-based BCI in mechatronic control by using a multi-dimensional approach

Real-time P300-based BCI in mechatronic control by using a multi-dimensional approach

For access to this article, please select a purchase option:

Buy article PDF
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
IET Software — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

This study presents a P300-based brain-computer interface (BCI) for mechatronic device driving, i.e. without the need for any physical control. The technique is based on a machine learning (ML) algorithm, which exploits a spatio-temporal characterization of the P300, analyses all the discrimination scenarios through a multiclass classification problem. The BCI is composed of the acquisition unit, the processing unit and the navigation unit. The acquisition unit is a wireless 32-channel electroencephalography headset collecting data from six electrodes. The processing unit is a dedicated µPC performing stimuli delivery, ML and classification, leading to the user intention interpretation. The ML stage is based on a custom algorithm (tuned residue iteration decomposition) which trains the classifier on the user-tuned P300 features. The extracted features undergo a dimensionality reduction and are used to define decision boundaries for the real-time classification. The real-time classification performs a functional approach for the features extraction, reducing the amount of data to be analyzed. The Raspberry-based navigation unit actuates the received commands, supporting the wheelchair motion. The experimental results, based on a dataset of seven subjects, demonstrate that the classification chain is performed in 8.16 ms with an accuracy of 84.28 ± 0.87%, allowing the real-time control of the wheelchair.


    1. 1)
      • 1. Brunner, C., Birbaumer, N., Blankertz, B., et al: ‘BNCI horizon 2020: towards a roadmap for the BCI community’, BCIs, 2015, 2, (1), pp. 110.
    2. 2)
      • 2. Person, L.: ‘Brain computer interface market by type (invasive, non-invasive and partially invasive) and application (communication and control, gaming and entertainment, smart home control and others) – global opportunity analysis and industry forecast, 2013–2020’. High Tech, Enterprise & Consumer IT, April 2015.
    3. 3)
      • 3. Fernández-Rodríguez, Á., Velasco-Álvarez, F., Ron-Angevin, R.: ‘Review of real brain-controlled wheelchairs’, J. Neural Eng., 2016, 13, (6), p. 061001.
    4. 4)
      • 4. De Venuto, D., Annese, V.F., Mezzina, G.: ‘An embedded system remotely driving mechanical devices by P300 brain activity’. Design, Automation & Test in Europe Conf. & Exhibition (DATE), Lausanne, Switzerland, March 2017, pp. 10141019.
    5. 5)
      • 5. De Venuto, D., Annese, V.F., Mezzina, G.: ‘Towards P300-based mind-control: a non-invasive quickly trained BCI for remote car driving’, 7th International Conference on Sensor Systems and Software, Nice, France, December 2016.
    6. 6)
      • 6. Annese, V.F., De Venuto, D.: ‘Fall-risk assessment by combined movement related potentials and co-contraction index monitoring’. 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS), Atlanta, GA, USA, October 2015, pp. 14.
    7. 7)
      • 7. De Venuto, D., Annese, V.F., Mezzina, G.: ‘Remote neuro-cognitive impairment sensing based on P300 spatio-temporal monitoring’, IEEE Sens. J., 2016, 16, (23), pp. 83488356.
    8. 8)
      • 8. Annese, V.F., Mezzina, G., De Venuto, D.: ‘Towards mobile health care: neurocognitive impairment monitoring by BCI-based game’, 2016 IEEE Sensors, Orlando, FL, USA, November 2016, pp. 13.
    9. 9)
      • 9. De Venuto, D., Annese, V.F., Mezzina, G., et al: ‘Brain-computer interface using P300: a gaming approach for neurocognitive impairment diagnosis’. 2016 IEEE Int. High Level Design Validation and Test Workshop (HLDVT), Santa Cruz, CA, USA, October 2016, pp. 9399.
    10. 10)
      • 10. Hwang, H.J., Kim, S., Choi, S., et al: ‘EEG-based brain-computer interfaces: a thorough literature survey’, Int. J. Hum.-Comput. Interact., 2013, 29, (12), pp. 814826.
    11. 11)
      • 11. Mason, S.G., Birch, G.E.: ‘A general framework for brain-computer interface design’, Neural Syst. Rehabil. Eng., 2003, 11, (1), pp. 7085.
    12. 12)
      • 12. Farwell, L.A., Donchin, E.: ‘Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials’, Electroencephalogr. Clin. Neurophysiol., 1988, 70, (6), pp. 510523.
    13. 13)
      • 13. Pfurtscheller, G., Müller-Putz, G.R., Scherer, R., et al: ‘Rehabilitation with brain-computer interface systems’, Comput. J., 2008, 41, (10), pp. 5865.
    14. 14)
      • 14. Tanaka, K., Matsunaga, K., Wang, H.O.: ‘Electroencephalogram-based control of an electric wheelchair’, IEEE Trans. Robot., 2005, 21, pp. 762766.
    15. 15)
      • 15. Grychtol, B., Lakany, H., Valsan, G., et al: ‘Human behavior integration improves classification rates in real-time BCI’, Neural Syst. Rehabil. Eng., 2010, 8, (4), pp. 362368.
    16. 16)
      • 16. Bogue, R.: ‘Brain-computer interfaces: control by thought’, Ind. Robot, 2010, 37, (2), pp. 126132.
    17. 17)
      • 17. De Venuto, D., Torre, M.D., Boero, C., et al: ‘A novel multi-working electrode potentiostat for electrochemical detection of metabolites’, 2010 IEEE Sensors, Kona, HI, USA, November 2010, pp. 15721577.
    18. 18)
      • 18. Annese, V.F., De Venuto, D.: ‘Gait analysis for fall prediction using EMG triggered movement related potentials’. 2015 10th IEEE Int. Conf. on Design and Technology of Integrated Systems in Nanoscale Era, DTIS, Naples, Italy, April 2015, pp. 16.
    19. 19)
      • 19. Patel, S.H., Azzam, P.N.: ‘Characterization of N200 and P300: selected studies of the event-related potential’, Int. J. Med. Sci., 2005, 2, (4), pp. 147154.
    20. 20)
      • 20. De Venuto, D., Annese, V.F., Ruta, M., et al: ‘Designing a cyber-physical system for fall prevention by cortico-muscular coupling detection’, IEEE Des. Test, 2016, 33, (3), pp. 6676.
    21. 21)
      • 21. Annese, V.F., De Venuto, D.: ‘FPGA based architecture for fall-risk assessment during gait monitoring by synchronous EEG/EMG’. 6th Int. Workshop on Advances in Sensors and Interfaces (IWASI), Gallipoli, Italy, June 2015, pp. 116121.
    22. 22)
      • 22. Annese, V.F., Crepaldi, M., Demarchi, D., et al: ‘A digital processor architecture for combined EEG/EMG falling risk prediction’. Design, Automation & Test in Europe Conf. & Exhibition (DATE), Dresden, Germany, March 2016, pp. 714719.
    23. 23)
      • 23. Weinberger, K.Q., Saul, L.K.: ‘Distance metric learning for large margin nearest neighbour classification’, J. Mach. Learn. Res., 2009, 10, pp. 207244.
    24. 24)
      • 24. Fan, R.-E., Chen, P.-H., Lin, C.-J.: ‘Working set selection using second order information for training support vector machines’, J. Mach. Learn. Res., 2005, 6, pp. 18891918.
    25. 25)
      • 25. De Venuto, D., Castro, D.T., Ponomarev, Y., et al: ‘Low power 12-bit SAR ADC for autonomous wireless sensors network interface’. 3rd Int. Workshop on Advances in Sensors and Interfaces, Trani, Italy, June 2009, pp. 115120.
    26. 26)
      • 26. De Venuto, D., Stikvoort, E., Tio Castro, D., et alUltra-low-power 12-bit SAR ADC for RFID applications’, 2010 Design, Automation & Test in Europe Conf. & Exhibition (DATE), Dresden, Germany, March 2010, pp. 10711075.
    27. 27)
      • 27. Jin, J., Sellers, E.W., Zhou, S., et al: ‘A P300 brain–computer interface based on a modification of the mismatch negativity paradigm’, Int. J. Neural Syst., 2015, 25, (03), pp. 1550011.11550011.12.
    28. 28)
      • 28. Serby, H., Yom-Tov, E., Inbar, G.F.: ‘An improved P300-based brain-computer interface’, IEEE Trans. Neural Syst. Rehabili. Eng., 2005, 13, (1), pp. 8998.
    29. 29)
      • 29. Annese, V.F., De Venuto, D.: ‘The truth machine of involuntary movement: FPGA based cortico-muscular analysis for fall prevention’. 2015 IEEE Int. Symp. on Signal Processing and Information Technology (ISSPIT), Abu Dhabi, UAE, December 2015, pp. 553558.

Related content

This is a required field
Please enter a valid email address