Your browser does not support JavaScript!

Integrated optical flow for situation awareness, detection and avoidance systems in UAV systems

Integrated optical flow for situation awareness, detection and avoidance systems in UAV systems

For access to this article, please select a purchase option:

Buy chapter PDF
(plus tax if applicable)
Buy Knowledge Pack
10 chapters for $120.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
Imaging and Sensing for Unmanned Aircraft Systems. Volume 1: Control and Performance — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Optical flow (OF) plays a decisive role in visual situation awareness, detection and obstacle avoidance systems for unmanned aerial vehicles (UAVs), which are cyberphysical systems (CPSs) that interact with the environment through sensors and actuators. The use of cameras allows the integration of computer vision (CV) algorithms with the inertial navigation systems (INS). The movement of characteristics of the image fused with the dynamic of the UAVs allows us to improve the process of remoting sense, avoid obstacles or estimate the position and velocity of the UAV. In the literature, there are various algorithms to locate characteristics points between two consecutive images. However, the computation time and consumption of physical resources such as memory features are due to embedded systems. This chapter shows (i) how to integrate the movement of the pixel textures (OF) in the image with INS data, (ii) compares different algorithms to match points between consecutive images, (iii) implements a process to encounter points between consecutive images and (iv) implements a computationally less expensive and with less memory consumption algorithm. A case study about using the field-programmable gate array (FPGA) as part of the visual servoing is discussed showing how to integrate results into the CV hardware system of a UAV and addressing the need to handle issues such as multi-resolution.

Chapter Contents:

  • 3.1 Introduction
  • 3.2 Computer vision
  • 3.2.1 Optical Flow
  • Methods based on the brightness gradient
  • Feature extractor algorithm
  • 3.3 Optical flow and remote sensing
  • 3.3.1 Aerial Triangulation
  • 3.4 Optical flow and situational awareness
  • 3.4.1 Detect and avoidance system
  • Perception
  • Comprehension
  • Projection
  • 3.5 Optical flow and navigation by images
  • 3.5.1 Egomotion
  • 3.6 Case study: INS using FPGA
  • 3.6.1 Architectural proposals
  • Control unit (CU)
  • Generation of time
  • Feature points detector
  • OF calculation
  • Input and output component
  • 3.6.2 Integration INS/GPS/OF using a Kalman filter
  • 3.7 Future trends and discussion
  • 3.7.1 3D optical flow
  • 3.7.2 Multispectral and hyperspectral images
  • 3.8 Conclusion
  • References

Inspec keywords: collision avoidance; object detection; embedded systems; visual servoing; image texture; inertial navigation; field programmable gate arrays; image sequences; mobile robots; robot vision; autonomous aerial vehicles

Other keywords: computation time; computer vision algorithms; obstacle avoidance systems; sensors; pixel texture movement; INS data; cyberphysical systems; consecutive image point matching; CV hardware system; field programmable gate array; inertial navigation systems; UAV systems; FPGA; actuators; integrated optical flow; unmanned aerial vehicles; visual servoing; characteristic point location; visual situation awareness; embedded systems

Subjects: Aerospace control; Optical, image and video signal processing; Computer vision and image processing techniques; Spatial variables control; Telerobotics; Mobile robots

Preview this chapter:
Zoom in

Integrated optical flow for situation awareness, detection and avoidance systems in UAV systems, Page 1 of 2

| /docserver/preview/fulltext/books/ce/pbce120f/PBCE120F_ch3-1.gif /docserver/preview/fulltext/books/ce/pbce120f/PBCE120F_ch3-2.gif

Related content

This is a required field
Please enter a valid email address