Your browser does not support JavaScript!

Multimodal BCIs–the hands-free Tetris paradigm

Multimodal BCIs–the hands-free Tetris paradigm

For access to this article, please select a purchase option:

Buy chapter PDF
(plus tax if applicable)
Buy Knowledge Pack
10 chapters for $120.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
Signal Processing to Drive Human-Computer Interaction: EEG and eye-controlled interfaces — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

In this chapter, we will explore ways to integrate three natural sensory modalities, i.e. vision, brain commands and stress levels into a single visceral experience that allows simultaneous control of various interface options. In this direction, we present MM-Tetris, the multimodal reinvention of the popular Tetris game, modified to be controlled with the user's eye-movements, mental commands and bio-measurements. MM-Tetris is intended for use by motor -impaired people who are not able to operate computing devices through the regular controllers (i.e. mouse and keyboard). In the proposed version of the game, the use of eye -movements and mental commands works in a complementary fashion, by facilitating two different controls, the horizontal movement of the tiles (i.e. tetriminos) through the coordinates of the gaze and the tile rotation through sensorimotor rhythm (SMR) signals detection, respectively. Additionally, bio-measurements provide the stress levels of the player, which in turn determines the speed of the tiles' drop. In this way, the three modalities smoothly collaborate to facilitate playing a game like Tetris. Eventually, the design of the game provides a natural gamified interface for user training in generating more discriminative SMR signals for better detection of imaginary movements.

Chapter Contents:

  • 12.1 Introduction
  • 12.2 Gameplay design
  • 12.3 Algorithms and associated challenges
  • 12.3.1 Navigating with the eyes
  • 12.3.2 Rotating with the mind
  • Sensorimotor rhythm
  • Challenges
  • Algorithm for SMR detection
  • 12.3.3 Regulating drop speed with stress
  • Galvanic skin response
  • Signal preprocessing
  • Personalised stress level detection
  • 12.4 Experimental design and game setup
  • 12.4.1 Apparatus
  • 12.4.2 Events, sampling and synchronisation
  • 12.4.3 EEG sensors
  • 12.4.4 Calibration
  • 12.5 Data processing and experimental results
  • 12.5.1 Data segmentation
  • 12.5.2 Offline classification
  • 12.5.3 Online classification framework
  • 12.6 Summary
  • References

Inspec keywords: brain-computer interfaces

Other keywords: natural gamified interface; tile rotation; MM-Tetris; mental commands; hands-free Tetris paradigm; user eye-movements; imaginary movements; horizontal movement; stress levels; bio-measurements; SMR signals detection; multimodal BCIs; discriminative SMR signals; natural sensory modalities; user training; sensorimotor rhythm; motor-impaired people

Subjects: User interfaces; Interactive-input devices

Preview this chapter:
Zoom in

Multimodal BCIs–the hands-free Tetris paradigm, Page 1 of 2

| /docserver/preview/fulltext/books/ce/pbce129e/PBCE129E_ch12-1.gif /docserver/preview/fulltext/books/ce/pbce129e/PBCE129E_ch12-2.gif

Related content

This is a required field
Please enter a valid email address