Deep neural networks for mobile person recognition with audio-visual signals

Deep neural networks for mobile person recognition with audio-visual signals

For access to this article, please select a purchase option:

Buy chapter PDF
(plus tax if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
Mobile Biometrics — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

This chapter starts with a general and brief introduction of biometrics and audiovisual person recognition using mobile phone data. It begins with a discussion of what constitutes a biometric recognition system, and it then details the steps followed when audio-visual signals are used as inputs. This is followed by a review of the existing speaker and face recognition systems which have been evaluated on a mobile biometric database. We then discuss the key motivations of using deep neural network (DNN) for person recognition. We finally introduce a Deep Boltzmann Machine (DBM)- DNN, in short DBM-DNN, based framework for person recognition. An overview of the sections and sub-sections of this chapter is shown in Figure 4.1.

Chapter Contents:

  • 4.1 Biometric systems
  • 4.1.1 What is biometrics?
  • 4.1.2 Multimodal biometrics
  • 4.2 Audio-visual biometric systems
  • 4.2.1 Preprocessing
  • 4.2.2 Feature extraction
  • Acoustic features
  • Visual features
  • 4.2.3 Classification
  • Support vector machine (SVM)
  • Linear regression-based classifier (LRC)
  • 4.2.4 Fusion
  • Non-adaptive fusion
  • Adaptive fusion
  • Linear logistic regression (logReg) fusion
  • 4.2.5 Audio-visual corporation
  • M2VTS and XM2VTS
  • VidTIMIT
  • AusTalk
  • 4.3 Mobile person recognition
  • 4.3.1 Speaker recognition systems
  • GMM-based methods
  • Parts-based method
  • 4.3.2 Face recognition systems
  • Template-based
  • GMM based
  • 4.3.3 Audio-visual person recognition on MOBIO
  • 4.4 Deep neural networks for person recognition
  • 4.4.1 A DBN-DNN for unimodal person recognition
  • 4.4.2 A DBM-DNN for person recognition
  • DBM training
  • Person recognition using DBM-DNN
  • 4.5 Summary
  • References

Inspec keywords: speaker recognition; face recognition; mobile computing; audio signal processing; database management systems; biometrics (access control); Boltzmann machines

Other keywords: deep neural networks; mobile phone data; speaker recognition; audio-visual signals; face recognition; DBM; biometrics; DNN; audiovisual person recognition; mobile person; mobile biometric database; deep Boltzmann machine

Subjects: Ubiquitous and pervasive computing; Image recognition; Database management systems (DBMS); Speech processing techniques; Data security; Computer vision and image processing techniques; Speech recognition and synthesis; Neural computing techniques

Preview this chapter:
Zoom in

Deep neural networks for mobile person recognition with audio-visual signals, Page 1 of 2

| /docserver/preview/fulltext/books/sc/pbse003e/PBSE003E_ch4-1.gif /docserver/preview/fulltext/books/sc/pbse003e/PBSE003E_ch4-2.gif

Related content

This is a required field
Please enter a valid email address