A novel corrected unwrapping method is proposed for panoramic annular images based on the catadioptric panoramic imaging system. The method is comprised of four key steps. Firstly, the distortion centre parameters on the panoramic annular image are determined, including the tangential distortion centre by using the least-square fitting (LSF) method and the radial distortion centre by extracting feature points. Secondly, the affine transformation relation between panoramic annular image and cylindrical panoramic image is constructed based on the centre parameters and the geometric properties of panoramic image. Then the annular image pixels are replicated into the cylindrical panoramic image by means of the bilinear interpolation. Finally, the frame aspect ratio for the final image unwrapping is corrected. The motivation for developing this technique is to solve the distortion problem from the centre deviation, and ultimately to promotes its adoption in pipe non-destructive testing systems. Experimental results have proved the feasibility, validity and higher accuracy of the unwrapping method.

References

1. 1)
  - 7. Yagi, Y., Kawato, S.: ‘Panorama scene analysis with conic projection’. IEEE Int. Workshop on Intelligent Robots and Systems'90. ‘Towards a New Frontier of Applications, Proc. IROS ‘90’, Japan, July 1990, vol. 1, pp. 181–187.
2. 2)
  - 23. Zhu, J., Li, X.F., Tan, W.B.: ‘Measurement of short are based on centre constraint least-square circle fitting’, Opl. Precis. Eng., 2009, 17, (10), pp. 2486–2492.
3. 3)
  - 20. Bu, X.Z., Li, G.J., Yang, B., Wang, X.Z.: ‘Fast unwrapping of panoramic annular image with center deviation’, Opt. Precis. Eng., 2012, 20, (9), pp. 2103–2109 (doi: 10.3788/OPE.20122009.2103).
4. 4)
  - 6. Yamazawa, K., Yachida, M.: ‘Omnidirectional imaging with hyperboloidal projection’. Proc. 1993 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems ‘93, IROS ‘93, Japan, July 1993, pp. 1029–1034.
5. 5)
  - 11. Chong, N.S., Kho, Y.H., Wong, M.L.D.: ‘Custom aspect ratio correction for unwrapped omnidirectional view images’, Comput. Electr. Eng., 2014, 40, (3), pp. 974–981 (doi: 10.1016/j.compeleceng.2013.04.005).
6. 6)
  - 2. Do, H.H., Myung, S.C., Deok, H.L., Seon, J.K., Jung, H.H.: ‘A case study on detection and sizing of defects in steam generator tubes using eddy current testing’, Nucl. Eng. Des., 2010, 240, (1), pp. 204–208 (doi: 10.1016/j.nucengdes.2009.10.006).
7. 7)
  - 25. Ma, Z.L., Wang, J.Z.: ‘Unwrapping and distortion correction of catadioptric panoramic reconnaissance image’, J. Projectiles Rockets Missiles Guid., 2010, 30, (5), pp. 173–176.
8. 8)
  - 2. Chen, L., Zhang, M., Xiong, Z.: ‘Series-parallel pipeline architecture for high-resolution catadioptric panoramic unwrapping’, IET Image Process., 2010, 4, (5), pp. 403–412 (doi: 10.1049/iet-ipr.2009.0286).
9. 9)
  - 5. Rees, D.W.: ‘Panoramic television viewing system’. US Patent 3505465, April 1970.
10. 10)
  - 4. Nayar, S.K.: ‘Catadioptric omnidirectional camera’. Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 1997, pp. 482–488.
11. 11)
  - 8. Hong, J., Tan, X., Pinette, B., Weiss, R., Riseman, E.: ‘Image-based homing’, IEEE Control Syst., 1992, 12, pp. 38–45 (doi: 10.1109/37.120451).
12. 12)
  - 22. Chiu, S.H., Liaw, J.J.: ‘A proposed circle/circular arc detection method using the modified randomized Hough transform’, J. Chin. Inst. Eng., 2006, 29, (3), Series A, pp. 533–538 (doi: 10.1080/02533839.2006.9671148).
13. 13)
  - 19. Hou, H.J., Bai, J., Yang, G.G.: ‘Research on image processing of the three-dimensional image of panoramic annular lens’, Opt. Instrum., 2005, 27, (6), pp. 43–47.
14. 14)
  - 18. Hong, E., Katz, R., Hufnagel, B., Agapiou, J.: ‘Optical method for inspecting surface defects inside a small bore’, Meas. Sci. Technol., 2010, 21, (1), pp. 1–8 (doi: 10.1088/0957-0233/21/1/015704).
15. 15)
  - 24. Zhang, Z.H., Li, K.J., Wu, X.B.: ‘Research and implementation of the algorithm for unwrapped and distortion correction basing on CORDIC for panoramic image’, SPIE, 2008, pp. 6623C-1–6623C-9.
16. 16)
  - 10. Chong, N.S., Wong, M.L.D., Kho, Y.H.: ‘Closed form spherical omnidirectional image unwrapping’. IET Conf. on Image Processing (IPR 2012), 2012, pp. 1–5.
17. 17)
  - 3. Ritter, M., Frey, C.W.: ‘Rotating optical geometry sensor for inner pipe-surface reconstruction’, Proc. SPIE 7538, 2010, pp. 7538.
18. 18)
  - 15. Kostrzewski, A.A., Ro, S., Agurok, I., Bennahmias, M.: ‘Panoramic video system with real-time distortion-free imaging’. US patent 021585, 2004.
19. 19)
  - 12. Svoboda, T., Pajdla, T.: ‘Epipolar geometry for central catadioptric cameras’, Int. J. Comput. Vis., 2002, 49, (1), pp. 23–37 (doi: 10.1023/A:1019869530073).
20. 20)
  - 17. Potucek, I.: ‘Omni-directional image processing for human detection and tracking’. PhD thesis, Brno University, 2004.
21. 21)
  - 16. Ives, R.W., Ngo, H., Winchell, S.: ‘Evaluating the information content of near-infrared iris imagery’. ISABEL'11 Proc. Fourth Int. Symp. on Applied Sciences in Biomedical and Communication Technologies, USA, 2011, p. 148.
22. 22)
  - 13. Jeng, S.W., Tsai, W.H.: ‘Using pano-mapping tables for unwrapping of omni-images into panoramic and perspective-view images’, IET Image Process., 2007, 1, (2), pp. 149–155 (doi: 10.1049/iet-ipr:20060201).
23. 23)
  - 1. Ahmad, R., Banerjee, S., Kundu, T.: ‘Cylindrical guide waves for damage in underground pipes using wavelet transforms’, SPIE, 2006, 6174, pp. 767–776.
24. 24)
  - 21. Pei, S.G., Horng, J.H.: ‘Circle are detection based on Hough transform’, Pattern Recognit. Lett., 1995, 16, pp. 615–625 (doi: 10.1016/0167-8655(95)80007-G).
25. 25)
  - 9. Swaminathan, R., Grossberg, M.D., Nayar, S.K.: ‘Non-single viewpoint catadioptric cameras: Geometry and analysis’, Int. J. Comput. Vis., 2001, 66, pp. 211–229 (doi: 10.1007/s11263-005-3220-1).

Corrected unwrapping method based on the tangential and radial distortion centre for the panoramic annular image

References

Related content