In this study, a novel adaptive sparse representation (ASR) model is presented for simultaneous image fusion and denoising. As a powerful signal modelling technique, sparse representation (SR) has been successfully employed in many image processing applications such as denoising and fusion. In traditional SR-based applications, a highly redundant dictionary is always needed to satisfy signal reconstruction requirement since the structures vary significantly across different image patches. However, it may result in potential visual artefacts as well as high computational cost. In the proposed ASR model, instead of learning a single redundant dictionary, a set of more compact sub-dictionaries are learned from numerous high-quality image patches which have been pre-classified into several corresponding categories based on their gradient information. At the fusion and denoising processes, one of the sub-dictionaries is adaptively selected for a given set of source image patches. Experimental results on multi-focus and multi-modal image sets demonstrate that the ASR-based fusion method can outperform the conventional SR-based method in terms of both visual quality and objective assessment.

References

1. 1)
  - B. Yang , S. Li . Multifocus image fusion and restoration with sparse representation. IEEE Tans. Instrum. Meas. , 884 - 892
2. 2)
  - 40. Dong, W., Zhang, L., Shi, G., Wu, X.: ‘Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization’, IEEE Trans. Image Process., 2011, 20, (7), pp. 1838–1857 (doi: 10.1109/TIP.2011.2108306).
3. 3)
  - J. Yang , J. Wright , T. Huang , Y. Ma . Image super-resolution via sparse representation. IEEE Trans. Image Process. , 11 , 2861 - 2873
4. 4)
  - J.J. Lewis , R.J. Ocallaghan , S.G. Nikolov , D.R. Bull , N. Canagarajah . Pixel- and region-based image fusion with complex wavelets. Inf. Fusion , 119 - 130
5. 5)
  - D.G. Lowe . Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis , 2 , 91 - 110
6. 6)
  - 20. Huang, W., Jing, Z.: ‘Evaluation of focus measures in multi-focus image fusion’, Pattern Recognit. Lett., 2007, 28, (4), pp. 493–500 (doi: 10.1016/j.patrec.2006.09.005).
7. 7)
  - 33. Guorong, G., Luping, X., Dongzhu, F.: ‘Multi-focus image fusion based on non-subsampled shearlet transform’, IET Image Process., 2013, 7, (6), pp. 633–639 (doi: 10.1049/iet-ipr.2012.0558).
8. 8)
  - 5. Li, S., Yang, B.: ‘Multifocus image fusion using region segmentation and spatial frequency’, Image vis. Comput., 2008, 26, (7), pp. 971–979 (doi: 10.1016/j.imavis.2007.10.012).
9. 9)
  - 8. Toet, A.: ‘A morphological pyramidal image decomposition’, Pattern Recognit. Lett., 1989, 9, (4), pp. 255–261 (doi: 10.1016/0167-8655(89)90004-4).
10. 10)
  - J. Mairal , M. Elad , G. Sapiro . Sparse representation for color image restoration. IEEE Trans. Image Process. , 1 , 53 - 69
11. 11)
  - 16. Zhao, H., Shang, Z., Tang, Y., et al: ‘Multi-focus image fusion based on the neighbor distance’, Pattern Recognit., 2013, 46, (3), pp. 1002–1011 (doi: 10.1016/j.patcog.2012.09.012).
12. 12)
  - 3. Li, S., Kwok, J., Wang, Y.: ‘Combination of images with diverse focuses using the spatial frequency’, Inf. Fusion, 2001, 2, (3), pp. 169–176 (doi: 10.1016/S1566-2535(01)00038-0).
13. 13)
  - B. Olshausen , D. Field . Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature , 6583 , 607 - 609
14. 14)
  - 4. Elad, M., Yavneh, I.: ‘A plurality of sparse representations is better that the sparsest one alone’, IEEE Trans. Inf. Theory, 2009, 55, (10), pp. 4701–4714 (doi: 10.1109/TIT.2009.2027565).
15. 15)
  - V.S. Petrović , C.S. Xydeas . Gradient-based multiresolution image fusion. IEEE Trans. Image Process. , 2 , 228 - 237
16. 16)
  - 1. Goshtasby, A.A., Nikolov, S.: ‘Image fusion: advances in the state of the art’, Inf. Fusion, 2007, 8, (2), pp. 114–118 (doi: 10.1016/j.inffus.2006.04.001).
17. 17)
  - 35. Liu, Z., Blasch, E., Xue, Z., et al: ‘Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: a comparative study’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 34, (1), pp. 94–109 (doi: 10.1109/TPAMI.2011.109).
18. 18)
  - C. Xydeas , V. Petrovic . Objective image fusion performance measure. Electron. Lett. , 308 - 309
19. 19)
  - M. Aharon , M. Elad , A. Bruckstein . K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Image Process. , 11 , 4311 - 4322
20. 20)
  - G. Qu , D. Zhang , P. Yan . Information measure for performance of image fusion. Electron. Lett. , 313 - 315
21. 21)
  - 21. Yang, B., Li, S.: ‘Pixel-level image fusion with simultaneous orthogonal matching pursuit’, Inf. Fusion, 2012, 13, (1), pp. 10–19 (doi: 10.1016/j.inffus.2010.04.001).
22. 22)
  - M. Elad , M. Aharon . Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process. , 12 , 3736 - 3745
23. 23)
  - H. Yin , S. Li , L. Fang . Simultaneous image fusion and super-resolution using sparse representation. Inf. Fusion
24. 24)
  - 15. Yu, N., Qiu, T., Bi, F., Wang, A.: ‘Image features extraction and fusion based on joint sparse representation’, IEEE J. Sel. Top. Signal Process., 2011, 5, (5), pp. 1074–1082 (doi: 10.1109/JSTSP.2011.2112332).
25. 25)
  - 15. Jiang, Y., Wang, M.: ‘Image fusion using multiscale edge-preserving decomposition based on weighted least squares filter’, IET Image Process., 2014, 8, (3), pp. 183–190 (doi: 10.1049/iet-ipr.2013.0429).
26. 26)
  - 26. Hossny, M., Nahavandi, S., Creighton, D.: ‘Comments on information measure for performance of image fusion’, Electron. Lett., 2008, 44, (18), pp. 1066–1067 (doi: 10.1049/el:20081754).
27. 27)
  - 13. Zhang, Q., Guo, B.: ‘Multifocus image fusion using the nonsubsampled contourlet transform’, Signal Process., 2009, 89, (7), pp. 1334–1346 (doi: 10.1016/j.sigpro.2009.01.012).
28. 28)
  - H. Li , B.S. Manjunath , S.K. Mitra . Multisensor image fusion using the wavelet transform. Graph. Models Image Process. , 235 - 245
29. 29)
  - S.G. Mallat , Z. Zhang . Matching pursuits with time-frequency dictionaries. IEEE Trans. Signal Process. , 12 , 3397 - 3415
30. 30)
  - 10. Aslantas, V., Kurban, R.: ‘Fusion of multi-focus images using differential evolution algorithm’, Expert Syst. Appl., 2010, 37, (12), pp. 8861–8870 (doi: 10.1016/j.eswa.2010.06.011).
31. 31)
  - G. Piella . A general framework for multiresolution image fusion: from pixels to regions. Inf. Fusion , 4 , 259 - 280
32. 32)
  - N. Filippo , G. Andrea , B. Stefano , A. Luciano . Remote sensing image fusion using the curvelet transform. Inf. Fusion , 2 , 143 - 156
33. 33)
  - 19. Iqbal, M., Chen, J.: ‘Unification of image fusion and super-resolution using jointly trained dictionaries and local information contents’, IET Image Process., 2012, 6, (9), pp. 1299–1310 (doi: 10.1049/iet-ipr.2012.0122).
34. 34)
  - 2. Stathaki, T.: ‘Image fusion: algorithms and applications’ (Academic Press, London, UK, 2008).
35. 35)
  - 25. Liu, Y., Wang, Z.: ‘Multi-focus image fusion based on sparse representation with adaptive sparse domain selection’. Proc. Int. Conf. Image Graphics, Qingdao, China, July 2013, pp. 591–596.
36. 36)
  - 41. Chen, Y., Blum, R.: ‘A new automated quality assessment algorithm for image fusion’, Image Vis. Comput., 2009, 27, (10), pp. 1421–1432 (doi: 10.1016/j.imavis.2007.12.002).
37. 37)
  - 15. Li, S., Yang, B., Hu, J.: ‘Performance comparison of different multi-resolution transforms for image fusion’, Inf. Fusion, 2011, 12, (2), pp. 74–84 (doi: 10.1016/j.inffus.2010.03.002).
38. 38)
  - A.L. Cunha , J. Zhou , M.N. Do . “The nonsubsampled contourlet transform: theory, design and applications”. IEEE Trans. Image Process , 10 , 3089 - 3101
39. 39)
  - J.L. Starck , E.J. Candès , D.L. Donoho . The curvelet transform for imaging denoising. IEEE Trans. Image Process. , 6 , 670 - 684
40. 40)
  - Z. Wang , A.C. Bovik , H.R. Sheikh , E.P. Simoncelli . Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. , 4 , 600 - 613
41. 41)
  - C. Yang , J. Zhang , X. Wang , X. Liu . A novel similarity-based quality metric for image fusion. Inf. Fusion , 156 - 160

Simultaneous image fusion and denoising with adaptive sparse representation

References

Related content