© The Institution of Engineering and Technology
A technique for calibrating a lens in the automotive environment to compensate for radial distortion introduced by wide-angle or fish-eye lenses, without the need for a dedicated calibration environment, is proposed. At present, car manufacturers are endeavouring to introduce systems that provide the driver with views of the car's surroundings that are not directly visible (blind zones). To achieve this, wide-angle/fish-eye lens cameras are fitted to many modern vehicles to maximise the field of view. However, fish-eye lenses introduce undesirable radial distortion to the resulting images that can be compensated for by post-processing the images. Calibration of the camera is important for fish-eye compensation, because each camera has different intrinsic properties. However, in some situations, calibration via specific calibration set-up can be undesirable. For example, in automotive mass production, where time and space on a production line have a direct impact on cost, even minutes spent on calibration is costly. In these situations, automatic calibration can reduce production time and alleviate the associated costs. It is proposed that the radial distortion introduced by fish-eye lenses can be calibrated using video normally captured by the camera on a vehicle. Here, it is proposed to heuristically extract real-world straight lines from image frames captured in an automotive environment and use these to calibrate the fish-eye camera for radial distortion.
References
-
-
1)
-
BMW: ‘Original BMW accessories catalogue 2007: rearview camera’, available at http://www.bmw.com.au/com/en/owners/accessories/, accessed November 2009.
-
2)
-
Sunex: ‘Tailored distortion lenses’, available at http://www.optics-online.com/Profile/technology.asp#Tailored, accessed November 2009.
-
3)
-
Volvo: ‘Geneva 2005 - Volvo cars focuses on preventive safety’, Press Release, March 2005. Available at https://www.media.volvocars.com/us/enhanced/en-us/Media/ Preview.aspx?mediaid=2519, accessed November 2009.
-
4)
-
R.C. Gonzales ,
R.E. Woods
.
(1993)
Digital image processing.
-
5)
-
C. McGlone ,
E. Mikhail ,
J. Bethel
.
(2004)
Manual of photogrammetry.
-
6)
-
A. Basu ,
S. Licardie
.
Alternative models for fish-eye lenses.
Pattern Recognit. Lett.
,
4 ,
433 -
441
-
7)
-
Devernay, F., Faugeras, O.: `Automatic calibration and removal of distortion from scenes of structured environments', Proc. SPIE Investigative and Trial Image Processing Conf., September 1995, San Diego, CA, USA, 2567, p. 62–72.
-
8)
-
D. Umbach ,
K. Jones
.
A few methods for fitting circles to data.
IEEE Trans. Instrum. Meas.
,
6 ,
1881 -
1885
-
9)
-
Honda: ‘Honda develops new multi-view camera system to provide view of surrounding areas to support comfortable and safe driving’, Press Release, September 2008. Available at http://world.honda.com/news/2008/ 4080918Multi-View-Camera-System/, accessed November 2009.
-
10)
-
Strand, R., Hayman, E.: `Correcting radial distortion by circle fitting', Proc. BMVA British Machine Vision Conference, September 2005, Oxford, UK.
-
11)
-
Bräuer-Burchardt, C., Voss, K.: `A new algorithm to correct fish-eye- and strong wide-angle-lens-distortion from single images', Proc. IEEE Int. Conf. on Image Processing, October 2001, Thessaloniki, Greece, 1, p. 225–228.
-
12)
-
Wang, J., Shi, F., Zhang, J., Liu, Y.: `A new calibration model and method of camera lens distortion', Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, October 2006, Beijing, China, p. 5713–5718.
-
13)
-
Stevenson, D.E., Fleck, M.M.: `Nonparametric correction of distortion', Proc. IEEE Workshop on Applications of Computer Vision, December 1996, Sarasota, FL, p. 214–219.
-
14)
-
C. Hughes ,
R. McFeely ,
P. Denny ,
M. Glavin ,
E. Jones
.
Equidistant (fthetas) fish-eye perspective with application in distortion centre estimation.
Image Vis. Comput.
,
3 ,
538 -
551
-
15)
-
W. Yu
.
An embedded camera lens distortion correction method for mobile computing applications.
IEEE Trans. Consum. Electron.
,
4 ,
894 -
901
-
16)
-
F. Devernay ,
O. Faugeras
.
Straight lines have to be straight: automatic calibration and removal of distortion from scenes of structured environments.
Int. J. Mach. Vis. Appl.
,
1 ,
14 -
24
-
17)
-
D. Schneider ,
E. Schwalbe ,
H.-G. Maas
.
Validation of geometric models for fisheye lenses.
ISPRS J. Photogramm. Remote Sens.
,
3 ,
259 -
266
-
18)
-
S.-W. Park ,
K.-S. Hong
.
Practical ways to calculate camera lens distortion for real-time camera calibration.
Pattern Recognit.
,
6 ,
1199 -
1206
-
19)
-
C. Hughes ,
M. Glavin ,
E. Jones ,
P. Denny
.
Wide-angle camera technology for automotive applications: a review.
IEEE Trans. Intell. Transp. Syst.
,
1 ,
19 -
31
-
20)
-
R. Hartley
.
(2003)
Multiple view geometry in computer vision.
-
21)
-
Y.T. Chan ,
B.H. Lee ,
S.M. Thomas
.
Approximate maximum likelihood estimation of circle parameters.
J. Optim. Theory Appl.
,
3 ,
723 -
734
-
22)
-
J. Salvi ,
X. Armangue ,
J. Batlle
.
A comparative review of camera calibrating methods with accuracy evaluation.
Pattern Recognit.
,
7 ,
1617 -
1635
-
23)
-
Consumers Union: ‘Consumer reports: blind-zone measurements’, available at http://www.consumerreports.org/cro/cars/car-safety/car-safety-reviews/mind-that-blind-spot-1005/overview/index.htm, accessed November 2009.
-
24)
-
D. Marquardt
.
An algorithm for least-squares estimation of nonlinear parameters.
SIAM J. Appl. Math.
,
2 ,
431 -
441
-
25)
-
R. Tsai
.
A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf TV cameras and lenses.
IEEE J. Robot. Autom.
,
4 ,
323 -
344
-
26)
-
W. Yu
.
Image-based lens geometric distortion correction using minimization of average bicoherence index.
Pattern Recognit.
,
6 ,
1175 -
1187
-
27)
-
E. Zelniker ,
I. Clarkson
.
Maximum-likelihood estimation of circle parameters via convolution.
IEEE Trans. Image Process.
,
4 ,
865 -
876
-
28)
-
K. Miyamoto
.
Fish eye lens.
J. Opt. Soc. Am.
,
8 ,
1060 -
1061
-
29)
-
Mallon, J., Whelan, P.: `Precise radial un-distortion of images', Proc. IEEE Int. Conf. on Pattern Recognition, August 2004, Surrey, UK, 1, p. 18–21.
-
30)
-
Xu, G., Terai, J., Shum, H.-Y.: `A linear algorithm for camera self-calibration, motion and structure recovery for multi-planar scenes from two perspective images', Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2000, Hilton Head Island, SC, 2, p. 474–479.
-
31)
-
T. Ehlgen ,
T. Pajdla ,
D. Ammon
.
Eliminating blind spots for assisted driving.
IEEE Trans. Intell. Trans. Syst.
,
4 ,
657 -
665
-
32)
-
Barreto, J.P., Daniilidis, K.: `Fundamental matrix for cameras with radial distortion', Proc. IEEE Int. Conf. on Computer Vision, October 2005, San Diego, CA, USA, 1, p. 625–632.
-
33)
-
I.D. Coope
.
Circle fitting by linear and nonlinear least squares.
J. Optim. Theory Appl.
,
2 ,
381 -
388
-
34)
-
R.I. Hartley ,
S.B. Kang
.
Parameter-free radial distortion correction with center of distortion estimation.
IEEE Trans. Pattern Anal. Mach. Intell.
,
8 ,
1309 -
1321
-
35)
-
Fitzgibbon, A.W.: `Simultaneous linear estimation of multiple view geometry and lens distortion', Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 2001, Kauai, Hawaii, USA, 1, p. 125–132.
-
36)
-
M. Ahmed ,
A. Farag
.
Nonmetric calibration of camera lens distortion: differential methods and robust estimation.
IEEE Trans. Image Process.
,
8 ,
1215 -
1230
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-its.2009.0052
Related content
content/journals/10.1049/iet-its.2009.0052
pub_keyword,iet_inspecKeyword,pub_concept
6
6