Your browser does not support JavaScript!

Stochastic-binary convolutional neural networks with deterministic bit-streams

Stochastic-binary convolutional neural networks with deterministic bit-streams

For access to this article, please select a purchase option:

Buy chapter PDF
(plus tax if applicable)
Buy Knowledge Pack
10 chapters for $120.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
Hardware Architectures for Deep Learning — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

In this chapter, we proposed a low-cost and energy -efficient design for hardware implementation of CNNs. LD deterministic bit -streams and simple standard AND gates are used to perform fast and accurate multiplication operations in the first layer of the NN. Compared to prior random bit -stream -based designs, the proposed design achieves a lower misclassification rate for the same processing time. Evaluating LeNet5 NN with MINIST dataset as the input, the proposed design achieved the same classification rate as the conventional fixed-point binary design with 70% saving in the energy consumption of the first convolutional layer. If accepting slight inaccuracies, higher energy savings are also feasible by processing shorter bit -streams.

Chapter Contents:

  • 4.1 Overview
  • 4.2 Introduction
  • 4.3 Background
  • 4.3.1 Stochastic computing
  • 4.3.2 Deterministic low-discrepancy bit-streams
  • 4.3.3 Convolutional neural networks
  • 4.4 Related work
  • 4.5 Proposed hybrid binary-bit-stream design
  • 4.5.1 Multiplications and accumulation
  • 4.5.2 Handling negative weights
  • 4.6 Experimental results
  • 4.6.1 Performance comparison
  • 4.6.2 Cost comparison
  • 4.7 Summary
  • Acknowledgment
  • References

Inspec keywords: logic design; logic gates; convolutional neural nets; optical character recognition

Other keywords: fixed-point binary design; LD deterministic bit-streams; stochastic-binary convolutional neural networks; multiplication operations; AND gates; LeNet5 NN; MINIST dataset; CNN

Subjects: Image recognition; Logic circuits; Digital circuit design, modelling and testing; Computer vision and image processing techniques; Logic elements; Neural net devices; Logic design methods; Neural nets (circuit implementations)

Preview this chapter:
Zoom in

Stochastic-binary convolutional neural networks with deterministic bit-streams, Page 1 of 2

| /docserver/preview/fulltext/books/cs/pbcs055e/PBCS055E_ch4-1.gif /docserver/preview/fulltext/books/cs/pbcs055e/PBCS055E_ch4-2.gif

Related content

This is a required field
Please enter a valid email address