Current trends in multimodal input recognition
Current trends in multimodal input recognition
- Author(s): B. Salem ; R. Yates ; R. Saatchi
- DOI: 10.1049/ic:19980750
For access to this article, please select a purchase option:
Buy conference paper PDF
Buy Knowledge Pack
IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.
IEE Colloquium Virtual Reality: Personal, Mobile and Practical Applications — Recommend this title to your library
Thank you
Your recommendation has been sent to your librarian.
- Author(s): B. Salem ; R. Yates ; R. Saatchi Source: IEE Colloquium Virtual Reality: Personal, Mobile and Practical Applications, 1998 page ()
- Conference: IEE Colloquium Virtual Reality: Personal, Mobile and Practical Applications
In order to optimise the effectiveness of a personal virtual reality (VR) system, it is necessary to have a natural and efficient way of interacting with it. This can be achieved by incorporation of a direct multimodal user interface. To communicate with such an interface the user can perform speech input, hand gestures, facial expressions or body movements. The VR system therefore needs to have an appropriate pattern recognition module so that it can deal with the interpretation, classification and recognition of the different human actions, which are then translated into inputs. We look at the different pattern recognition techniques currently available in the area of speech recognition, facial gesture recognition, body tracking and hand gesture recognition (e.g. artificial neural networks, statistical tools and template matching). The implementation of these techniques in a multimodal user interface was investigated and the effectiveness of such user interface was compared with the now widely used Window Icon Mouse Pointer (WIMP) interface. This was done with the intent of developing a personal VR system user interface. (6 pages)
Inspec keywords: gesture recognition; image recognition; speech recognition; virtual reality; user interfaces
Subjects: Speech processing techniques; Virtual reality; Natural language interfaces; User interfaces; Computer vision and image processing techniques
Related content
content/conferences/10.1049/ic_19980750
pub_keyword,iet_inspecKeyword,pub_concept
6
6