access icon free NSCT-based fusion method for forward-looking sonar image mosaic

To generate a seamless mosaic of a forward-looking sonar (FLS) video sequence, this study proposes a novel fusion method for FLS image mosaic, which includes two main steps from coarse to fine. In the coarse fusion step, the source images are first decomposed into multi-scale sub-bands using the non-subsampled contourlet transform (NSCT), then the sub-bands of the source images are merged, based on the Gabor energy and the local contrast for low and high frequency sub-bands, respectively, to generate the fused sub-bands which are used to produce the fused image by inverse NSCT. In the fine fusion step, a decision map is used to choose the pixels of the fine fused image from the coarsely fused image or one of the source images. This decision map is first constructed by measuring the similarity of the coarsely fused image to the source images, and then processed by a morphological post-processing technique to ensure its continuity and smoothness. Extensive experiments on FLS image fusion and mosaic have been conducted to demonstrate the effectiveness and the superiority of the proposed technique using both a subjective evaluation and objective metrics.

Inspec keywords: sonar imaging; image sequences; image fusion; image segmentation; inverse transforms

Other keywords: decision map; image processing technique; source image decomposition; Gabor energy; fine fused image pixels; fusion method; coarse fusion step; inverse NSCT; multiscale sub-bands; nonsubsampled contourlet transform; forward-looking sonar image mosaic; morphological post-processing technique; FLS video sequence

Subjects: Optical, image and video signal processing; Sonar and acoustic radar; Integral transforms

References

    1. 1)
      • 11. Chai, Y., Li, H.F., Zhang, X.Y.: ‘Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain’, Optik - Int. J. Light Electron Opt., 2012, 123, (7), pp. 569581.
    2. 2)
      • 32. He, C., Zheng, Y.F., Ahalt, S.C.: ‘Object tracking using the Gabor wavelet transform and the golden section algorithm’, IEEE Trans. Multimed., 2002, 4, (4), pp. 528538.
    3. 3)
      • 33. Chen, J.B., Gong, Z.B., Li, H.Y., et al: ‘A detection method based on sonar image for underwater pipeline tracker’. 2011 IEEE Second Int. Conf. Mechanic Automation and Control Engineering, 2011, pp. 37663769.
    4. 4)
      • 42. Negahdaripour, S., Sekkati, H.: ‘3-D Motion estimation for positioning from 2-D acoustic video imagery’. Proc. 3rd Iberian Conf. Pattern Recognition and Image Analysis, 2007, pp. 8088.
    5. 5)
      • 39. Yang, B., Li, S.: ‘Pixel-level image fusion with simultaneous orthogonal matching pursuit’, Inf. Fusion, 2012, 13, (1), pp. 1019.
    6. 6)
      • 4. Hurtos, N., Ribas, D., Cufi, X., et al: ‘Fourier-based registration for robust forward-looking sonar mosaicing in low-visibility underwater environments’, J. Field Robot., 2014, 32, (1), pp. 123151.
    7. 7)
      • 10. Hurtos, N., Cufi, X., Salvi, J.: ‘A novel blending technique for two-dimensional forward-looking sonar mosaicing’. 2013 OCEANS, San Diego, 2013, pp. 17.
    8. 8)
      • 9. Li, H.Y., Dong, Y., He, X.D., et al: ‘A sonar image mosaicing algorithm based on improved SIFT for USV’. 2014 IEEE Int. Conf. Mechatronics and Automation, 2014, pp. 18391843.
    9. 9)
      • 28. Reed, S., Ruiz, I.T., Capus, C., et al: ‘The fusion of large scale classified side-scan sonar image mosaics’, IEEE Trans. Image Process., 2006, 15, (7), pp. 20492060.
    10. 10)
      • 31. Huang, W., Jing, Z.: ‘Evaluation of focus measures in multi-focus image fusion’, Pattern Recognit. Lett., 2007, 28, (4), pp. 493500.
    11. 11)
      • 38. Chai, Y., Li, H., Li, Z.F.: ‘Multifocus image fusion scheme using focused region detection and multiresolution’, Opt. Commun., 2011, 284, (19), pp. 43764389.
    12. 12)
      • 24. Zhang, Q., Guo, B.L.: ‘Multifocus image fusion using the nonsubsampled contourlet transform’, Signal Process., 2009, 89, (7), pp. 13341346.
    13. 13)
      • 27. Sound Metrics Corporation: http://www.soundmetrics.com/products/aris-sonars/Accessories/X2-Rotator, accessed 16 June 2016.
    14. 14)
      • 35. Gao, G.R., Xu, L.P., Feng, D.Z.: ‘Multi-focus image fusion based on non-subsampled Shearlet transform’, IET Image Process., 2013, 7, (6), pp. 633639.
    15. 15)
      • 37. De Valois, R.L., Yund, E.W., Hepler, N.: ‘The orientation and direction selectivity of cells in macaque visual cortex’, Vis. Res., 1982, 22, (5), pp. 531544.
    16. 16)
      • 5. Hurtos, N., Cufi, X., Petillot, Y., et al: ‘Fourier-based registrations for two-dimensional forward-looking sonar image mosaicing’. 2012 IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2012, pp. 52985305.
    17. 17)
      • 16. Zhou, Z.Q., Li, S., Wang, B.: ‘Multi-scale weighted gradient-based fusion for multi-focus images’, Inf. Fusion, 2014, 20, pp. 6072.
    18. 18)
      • 23. Ayin, M.D., Negahdaripour, S.: ‘On feature extraction and region matching for forward scan sonar imaging’. 2012 Oceans, 2012, pp. 19.
    19. 19)
      • 6. Hurtos, N., Nagappa, S., Palomeras, N., et al: ‘Real-time mosaicing with two-dimensional forward-looking sonar’. IEEE Int. Conf. Robotics and Automation, 2014, pp. 601606.
    20. 20)
      • 40. Xydeas, C.S., Petrovic, V.: ‘Objective image fusion performance measure’, Electron. Lett., 2000, 36, (4), pp. 308309.
    21. 21)
      • 43. Negahdaripour, S.: ‘Visual motion ambiguities of a plane in 2-D FS sonar motion sequences’, Comput. Vis. Image Underst., 2012, 116, (6), pp. 754764.
    22. 22)
      • 41. Miao, Q.G., Shi, C., Xu, P.F., et al: ‘A novel algorithm of image fusion using shearlets’, Opt. Commun., 2011, 284, (6), pp. 15401547.
    23. 23)
      • 1. Sound Metrics Corporation: Available at http://www.soundmetrics.com/, accessed 16 June 2016.
    24. 24)
      • 30. El-Baz, A., Farag, A., Gimelfarb, G.: ‘Experiments on robust image registration using a Markov-Gibbs appearance model’. Structural, Syntactic, and Statistical Pattern Recognition (LNCS, 4019), 2006, pp. 6573.
    25. 25)
      • 19. Yang, Y., Tong, S., Huang, S.Y., et al: ‘Multifocus image fusion based on NSCT and focused area detection’, IEEE Sens. J., 2015, 15, (5), pp. 28242838.
    26. 26)
      • 12. Burt, P.J., Adelson, E.H.: ‘The Laplacian pyramid as a compact image code’, IEEE Trans. Commun., 1983, 31, (4), pp. 532540.
    27. 27)
      • 25. Kim, K., Intrator, N., Neretti, N.: ‘Image registration and mosaicing of noisy acoustic camera’. 2004 11th IEEE Int. Conf. Electronics, Circuit and Systems, 2004, pp. 527530.
    28. 28)
      • 34. Gabor, D.: ‘Theory of communication. Part 1: the analysis of information’, J. Inst. Electr. Eng. III, Radio Commun. Eng., 1946, 93, (26), pp. 429441.
    29. 29)
      • 20. Li, S., Yang, B.: ‘Hybrid multiresolution method for multisensor multimodal image fusion’, IEEE Sens. J., 2010, 10, (9), pp. 15191526.
    30. 30)
      • 14. Yang, Y., Huang, S.Y.: ‘Multi-focus image fusion using an effective discrete wavelet transform based algorithm’, Meas. Sci. Rev., 2014, 14, (2), pp. 102108.
    31. 31)
      • 8. Kim, K., Neretti, N., Intrator, N.: ‘Mosaicing of acoustic camera images’, IEE Proc., Radar Sonar Navig., 2005, 152, (4), pp. 263270.
    32. 32)
      • 26. Wang, Q., Ward, R.K.: ‘Fast image/video contrast enhancement based on weighted threshold histogram equalization’, IEEE Trans. Consum. Electron., 2007, 53, (2), pp. 757764.
    33. 33)
      • 21. Aslantas, V., Kurban, R.: ‘Fusion of multi-focus images using differential evolution algorithm’, Expert Syst. Appl., 2010, 37, (12), pp. 88618870.
    34. 34)
      • 18. Cunha, A.L., Zhou, J., Do, M.N.: ‘The nonsubsampled contourlet transform: theory, design, and applications’, IEEE Trans. Image Process., 2006, 15, (10), pp. 30893101.
    35. 35)
      • 15. Kanan, K., Perumal, S.A., Arulmozhi, K.: ‘Area level fusion of multi-focused images using multi-stationary wavelet packet transform’, Int. J. Comput. Appl., 2010, 2, (1), pp. 8895.
    36. 36)
      • 29. Zhang, J., Sohel, F., Bian, H.Y., et al: ‘Forward-looking sonar image registration using polar transform’. MTS/IEEE Oceans 2016, Monterey, 2016, pp. 16.
    37. 37)
      • 22. De, I., Chanda, B.: ‘Multi-focus image fusion using a morphology-based focus measure in a quad-tress structure’, Inf. Fusion, 2013, 14, (2), pp. 136146.
    38. 38)
      • 2. Blueview Corporation: Available at http://www.blueview.com/, accessed 16 June 2016.
    39. 39)
      • 36. Toet, A., Ruyven van, J.J., Valeton, J.M.: ‘Merging thermal and visual images by a contrast pyramid’, Opt. Eng., 1989, 28, (7), pp. 789792.
    40. 40)
      • 3. Burt, P.J., Adelson, E.H.: ‘A multiresolution spline with application to image mosaics’, ACM Trans. Graph., 1983, 2, (4), pp. 217236.
    41. 41)
      • 17. Do, M.N., Vetterli, M.: ‘The contourlet transform: an efficient directional multiresolution image representation’, IEEE Trans. Image Process., 2005, 14, (12), pp. 20912106.
    42. 42)
      • 7. Negahdaripour, S., Aykin, M.D., Sinnarajah, S.: ‘Dynamic scene analysis and mosaicing of benthic habitats by FS sonar imaging – Issues and complexities’. MTS/IEEE OCEANS 2011, KONA, 2011, pp. 17.
    43. 43)
      • 13. Petrovic, V.S., Xydeas, C.S.: ‘Gradient-based multiresolution image fusion’, IEEE Trans. Image Process., 2004, 13, (2), pp. 228237.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-rsn.2017.0053
Loading

Related content

content/journals/10.1049/iet-rsn.2017.0053
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading