Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

Wide-angle camera technology for automotive applications: a review

Wide-angle camera technology for automotive applications: a review

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Add to cart
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)
Add to cart

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Intelligent Transport Systems — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

  • Author(s): C. Hughes 1 ; M. Glavin 1 ; E. Jones 1 ; P. Denny 2
    • View affiliations
    • Affiliations: 1: Connaught Automotive Research Group, Department of Electronic Engineering, National University of Ireland, Galway, Ireland
      2: Connaught Automotive Research Group, Department of Electronic Engineering, Valeo Vision Systems, Tuam, Ireland
  • Source: Volume 3, Issue 1, March 2009, p. 19 – 31
    DOI:  10.1049/iet-its:20080017 , Print ISSN 1751-956X, Online ISSN 1751-9578
© The Institution of Engineering and Technology
Published

The development of electronic vision systems for the automotive market is a strongly growing field, driven in particular by customer demand to increase the safety of vehicles both for drivers and for other road users, including vulnerable road users (VRUs), such as pedestrians. Customer demand is matched by legislative developments in a number of key automotive markets; for example Europe, Japan and the US are in the process of introducing legislation to aid in the prevention of fatalities to VRUs, with emphasis on the use of vision systems.The authors discuss some of the factors that motivate the use of wide-angle and fish-eye camera technologies in vehicles. The authors describe the benefits of using wide-angle lens camera systems to display areas of a vehicle's surroundings that the driver would, otherwise, be unaware of (i.e. a vehicle's blind-zones). However, although wide-angle optics provide greater fields of view, they also introduce undesirable effects, such as radial distortion, tangential distortion and uneven illumination.These distortions have the potential to make objects difficult for the vehicle driver to recognise and, thus, potentially have a greater risk of accident. The authors describe some of the methods that can be employed to remove these unwanted effects, and digitally convert the distorted image to the ideal and intuitive rectilinear pin-hole model.

Inspec keywords: driver information systems; image sensors; computer vision

Other keywords: tangential distortion; vulnerable road users; automotive market; electronic vision systems; uneven illumination; fish-eye camera technologies; rectilinear pin-hole model; radial distortion; wide-angle camera technology

Subjects: Traffic engineering computing; Image sensors; Optical, image and video signal processing; Computer vision and image processing techniques

References

    1. 1)
      • UNECE Working Party on General Safety Provisions (GRSG): ‘GRSG-83-Inf15e: Outline of Draft Amendment to ECE Regulation No.46 (Draft Requirements for Driver's Field of Vision of Immediate Frontward and Sideward)’, 2002.
    2. 2)
      • F.J.W.M. Leong , M. Brady , J.O. McGee . Correction of uneven illumination (vignetting) in digital microscopy images. BMJ J. Clinical Pathology , 619 - 621
    3. 3)
      • Barreto, J.P., Daniilidis, K.: `Fundamental matrix for cameras with radial distortion', Proc. IEEE Int. Conf. Computer Vision, October 2005, Beijing, China, 1, p. 625–632.
    4. 4)
      • Consumers Union: ‘Consumer reports – blind-zone measurements’. http://www.consumerreports.org/, accessed March 2008.
    5. 5)
      • Fitzgibbon, A.W.: `Simultaneous linear estimation of multiple view geometry and lens distortion', Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, December 2001, Kauai, Hawaii, US, 1, p. 125–132.
    6. 6)
      • Ehlgen, T., Paidla, T.: `Maneuvering aid for large vehicle using omnidirectional cameras', Proc. IEEE Workshop on Applications of Computer Vision, February 2007, Austin, Texas, US, p. 17–17.
    7. 7)
      • Yu, W., Chung, Y., Soh, J.: `Vignetting distortion correction method for high quality digital imaging', Proc. IEEE Int. Conf. Pattern Recognition, August 2004, Surrey, UK, 3, p. 666–669.
    8. 8)
      • Bakstein, H., Pajdla, T.: `Panoramic mosaicing with a 180degree field of view lens', Proc. IEEE Workshop on Omnidirectional Vision, June 2002, Hilton Head Island, South Carolina, US, p. 60–67.
    9. 9)
      • Devernay, F., Faugeras, O.D.: `Automatic calibration and removal of distortion from scenes of structured environments', Proc. SPIE Investigative and Trial Image Processing Conf., 1995, San Diego, California, US, 2567, p. 62–72.
    10. 10)
      • F. Devernay , O. Faugeras . Straight lines have to be straight: automatic calibration and removal of distortion from scenes of structured enviroments. Int. J. Mach. Vis. Appl. , 1 , 14 - 24
    11. 11)
      • Japanese National Agency for Automotive Safety and Victims Aid: ‘New Car Assessment (JNCAP)’. http://www.nasva.go.jp/mamoru/indexe.html, accessed March 2008.
    12. 12)
      • US National Highway Traffic Safety Administration: ‘USNCAP’. http://www.safercar.gov/, accessed March 2008.
    13. 13)
      • Hobbs, A.: `Euro NCAP/MORI survey on consumer buying interests (speech and presentation)', Proc. Euro NCAP conf.: creating a market for safety – 10 years of Euro NCAP, November 2005, Brussels, Belgium.
    14. 14)
      • S. Shah , J.K. Aggarwal . Intrinsic parameter calibration procedure for a (high-distortion) fish-eye lens camera with distortion model and accuracy estimation. J. Pattern Recognit. , 11 , 1775 - 1788
    15. 15)
      • European Parliament and Council: ‘Directive 2007/38/EC of 11 July 2007 on the retrofitting of mirrors to heavy goods vehicles registered in the Community’. July 2007.
    16. 16)
      • Shah, S., Aggarwal, J.K.: `A simple calibration procedure for fish-eye (high distortion) lens camera', Proc. IEEE Int. Conf. Robotics and Automation, April 1994, New Orleans, Louisiana, US, 4, p. 3422–3427.
    17. 17)
    18. 18)
      • Zhang, Z.: `Flexible camera calibration by viewing a plane from unknown orientations', Proc. IEEE Int. Conf. Computer Vision, September 1999, Kerkyra, Greece, 1, p. 666–673.
    19. 19)
      • Strand, R., Hayman, E.: `Correcting radial distortion by circle fitting', Proc. BMVA British Machine Vision Conf., September 2005, Oxford, UK.
    20. 20)
      • Fernandes, J.C.A., Ferreira, M.J.O., Neves, J.A.B.C., Couto, C.A.C.: `Fast correction of lens distortion for image applications', Proc. IEEE Int. Symp. Industrial Electronics, July 1997, Guimar̃aes, Portugal, 2, p. 708–712.
    21. 21)
      • J. Weng , P. Cohen , M. Herniou . Camera calibration with distortion models and accuracy evaluation. IEEE Trans. Pattern Anal. Mach. Intelli. , 10 , 965 - 980
    22. 22)
      • European Parliament and Council: ‘Directive 2003/97/EC of 10 November 2003 on the approximation of the laws of the Member States relating to the typeapproval of devices for indirect vision and of vehicles equipped with these devices, amending Directive 70/156/EEC and repealing Directive 71/127/EEC’. November 2003.
    23. 23)
      • Stein, G.P.: `Lens distortion calibration using point correspondences', Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, June 1997, San Juan, Puerto Rico, p. 602–608.
    24. 24)
      • Ishii, C., Sudo, Y., Hashimoto, H.: `An image conversion algorithm from fish eye image to perspective image for human eyes', Proc. IEEE/ASME Int. Conf. Advanced Intelligent Mechatronics, July 2003, Port Island, Kobe, Japan, 2, p. 1009–1014.
    25. 25)
      • R.Y. Tsai . A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robot. Autom. , 4 , 323 - 344
    26. 26)
      • C. McGlone , E. Mikhail , J. Bethel . (2004) Manual of photogrammetry.
    27. 27)
      • Department for Transport Research Database: ‘Primary and e-safety’. http://www.dft.gov.uk/rmd/subprogramme.asp?intProgrammeID=74&intSubProgrammeID=134, accessed June 2008.
    28. 28)
      • European Commission: ‘Community database on accidents on the roads in Europe (CARE)’. http://ec.europa.eu/, accessed November 2007.
    29. 29)
    30. 30)
      • UNECE Working Party on General Safety Provisions (GRSG): ‘GRSG-89-26: Proposal for Step-2 revision of Regulation No. 46’. 2005.
    31. 31)
    32. 32)
      • R. Patel , A. Dellinger , J. Annest . Nonfatal motor-vehicle–related backover injuries among children – United States, 2001–2003. Morb. Mortal. Wkly. Rep. , 6 , 144 - 146
    33. 33)
      • Kids and Cars Organisation: http://kidsandcars.org/, accessed March 2008.
    34. 34)
      • Thirthala, S., Pollefeys, M.: `The radial trifocal tensor: a tool for calibrating the radial distortion of wide-angle cameras', Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, June 2005, San Diego, California, US, 1, p. 321–328.
    35. 35)
      • Mallon, J., Whelan, P.F.: `Precise radial un-distortion of images', Proc. IEEE Int. Conf. Pattern Recognition, August 2004, Surrey, UK, 1, p. 18–21.
    36. 36)
      • Department for Transport Research Database: ‘Secondary safety’. http://www.dft.gov.uk/rmd/subprogramme.asp?intProgrammeID=74&intSubProgrammeID=132, accessed June 2008.
    37. 37)
      • Brauer-Burchardt, C., Voss, K.: `A new algorithm to correct fish-eye- and strong wide-angle-lens-distortion from single images', Proc. IEEE Int. Conf. Image Processing, October 2001, Thessaloniki, Greece, 1, p. 225–228.
    38. 38)
      • Bogner, S.L.: `An introduction to panospheric imaging', Proc. IEEE Int. Conf. Systems, Man and Cybernetics Intelligent Systems for the 21st Century, October 1995, Vancouver, British Columbia, Canada, 4, p. 3099–3106.
    39. 39)
      • K.V. Asari . Design of an efficient VLSI architecture for non-linear spatial warping of wide-angle camera images. J. Sys. Architec. , 12 , 743 - 755
    40. 40)
      • W.T. Welford . (1991) Useful optics (Chicago lectures in physics).
    41. 41)
      • European Commission Directorate-General for Energy and Transport: ‘Halving the number of road accident victims in the EU by 2010: a shared responsibility’ (European Road Safety Action Programme), 2004.
    42. 42)
      • Commission of the European Communities: ‘Commission staff working document: accompanying document to the proposal for a directive of the European Parliament and of the Council on the retrofitting of mirrors to heavy goods vehicles 19 registered in the Community Full Impact Assessment COM(2006)570’, October 2006.
    43. 43)
    44. 44)
      • UK Health and Safety Executive: ‘Statistics: number of workplace transport injuries’. http://www.hse.gov.uk/, accessed March 2008.
    45. 45)
      • E. McLoughlin , J. Middlebrooks , J. Annest , P. Holmgreen , A. Dellinger . Injuries and deaths among children left unattended in or around motor vehicles – US, July 2000–June 2001. Morb. Mortal. Wkly. Rep. , 26 , 570 - 572
    46. 46)
      • American Library of Congress: ‘S.694: Cameron Gulbransen Kids and Cars Safety Act of 2007 (Reported in Senate)’. http://thomas.loc.gov/cgibin/query/D?c110:2:./temp/c110G9XilI::, accessed June 2008.
    47. 47)
      • Asada, N., Amano, A., Baba, M.: `Photometric Calibration of Zoom Lens Systems', Proc. IEEE Int. Conf. Pattern Recognition, August 1996, Vienna, Austria, 1, p. 186–190.
    48. 48)
      • Ruiz, A., Lopez-de Teruel, P.E., Garcia-Mateos, G.: `A note on principal point estimability', Proc. IEEE Int. Conf. Pattern Recognition, August 2002, Quebec, Canada, 2, p. 304–307.
    49. 49)
      • Stein, G.P.: `Internal camera calibration using rotation and geometric shapes', 1993, M.Sc, Massachusetts Institute of Technology.
    50. 50)
      • Wang, J., Knipling, R.: `Lane change/merge crashes: problem size assessment and statistical description', Report No. DOT HS 808-075, Technical report, 1994, United States Department of Transportation Publication.
    51. 51)
      • European New Car Assessment Program (Euro NCAP): http://www.euroncap.com/, accessed March 2008.
    52. 52)
      • Yu, W., Chung, Y.: `An embedded camera lens distortion correction method for mobile computing applications', Proc. IEEE Int. Conf. Consumer Electronics, June 2003, Los Angeles, California, US, p. 400–401.
    53. 53)
      • Brauer-Burchardt, C., Voss, K.: `Automatic lens distortion calibration using single views', Mustererkennung, DAGM-Symposium, September 2000, Kiel, Germany, p. 187–194.
    54. 54)
      • G. Wyszecki , W.S. Stiles . (1982) Color science: concepts and methods, quantitative data and formulae.
    55. 55)
      • Basu, A., Licardie, S.: `Modeling fish-eye lenses', Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, July 1993, Yokohama, Japan, 3, p. 1822–1828.
    56. 56)
      • Aggarwal, M., Hua, H., Ahuja, N.: `On cosine-fourth and vignetting effects in real lenses', Proc. IEEE Int. Conf. Computer Vision, July 2001, Vancouver, British Columbia, Canada, 1, p. 472–479.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-its_20080017
Loading

Related content

content/journals/10.1049/iet-its_20080017
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
Print this page
This is a required field
Please enter a valid email address