© The Institution of Engineering and Technology
Image self-similarity property is important to super-resolution reconstruction. However, how to effectively exploit the self-similarity information to reconstruct an underlying high-resolution image is still a challenging problem. The authors propose a novel model for solving the single image upsampling problem with the self-similarity property. First, the authors construct a statistical prior that requires maximising the similarity between the low- and high-resolution image pairs. Then, the authors develop an alternative Gaussian approximation solver based on the Gaussian mixture model to find the optimal high-resolution output. To obtain a better performance, the authors summarise some refined implementation skills to raise the reconstruction quality. For demonstration, a series of objective and subjective measurements are used to evaluate the performance of the model.
References
-
-
1)
-
26. Lu, X., Yuan, Y., Yan, P.: ‘Image super-resolution via double sparsity regularized manifold learning’, IEEE Trans. Circuits Syst. Video Technol., 2013, 23, (12), pp. 2022–2033.
-
2)
-
23. Chang, H., Yeung, D., Xiong, Y.: ‘Super-resolution through neighbor embedding’. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2004), Washington, DC, United States, 2004, vol. 1, pp. 275–282.
-
3)
-
48. HaCohen, Y., Fattal, R., Lischinski, D.: ‘Image upsampling via texture hallucination’. IEEE Int. Conf. Computational Photography (ICCP 2010), Cambridge, United States, 2010, pp. 1–8.
-
4)
-
51. Yang, J., Lin, Z., Cohen, S.: ‘Fast image super-resolution based on in-place example regression’. IEEE Conf. Computer Vision and Pattern Recognition, 2013, pp. 1059–1066.
-
5)
-
46. Zhu, Z., Guo, F., Yu, H., et al: ‘Fast single image super-resolution via self-example learning and sparse representation’, IEEE Trans. Multimed., 2014, 16, (8), pp. 2178–2190.
-
6)
-
27. Liang, M., Du, J., Cao, S., et al: ‘Super-resolution reconstruction based on multisource bidirectional similarity and non-local similarity matching’, IET Image Process., 2015, 9, (11), pp. 931–942.
-
7)
-
14. Zhang, X., Liu, Q., Li, X., et al: ‘Non-local feature back-projection for image super-resolution’, IET Image Process., 2016, 10, (5), pp. 398–408.
-
8)
-
36. Zeyde, R., Elad, M., Protter, M.: ‘On single image scale-up using sparse-representations’. 7th Int. Conf. Curves and Surfaces, Avignon, France, 2010, vol. 6920, pp. 711–730.
-
9)
-
18. He, H., Siu, W.: ‘Single image super-resolution using Gaussian process regression’. IEEE Conf. Computer Vision and Pattern Recognition, 2011, pp. 449–456.
-
10)
-
3. Yang, J., Wright, J., Huang, T., et al: ‘Image super-resolution via sparse representation’, IEEE Trans. Image Process., 2010, 19, (11), pp. 2861–2873.
-
11)
-
9. Tai, Y., Tong, W., Tang, C.: ‘Perceptually-inspired and edge-directed color image super-resolution’. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2006), 2006, vol. 2, pp. 1948–1955.
-
12)
-
40. Yang, S., Wang, M., Chen, Y., et al: ‘Single-image super-resolution reconstruction via learned geometric dictionaries and clustered sparse coding’, IEEE Trans. Image Process., 2012, 21, (9), pp. 4016–4028.
-
13)
-
44. Dong, W., Zhang, L., Lukac, R., et al: ‘Sparse representation based image interpolation with nonlocal autoregressive modeling’, IEEE Trans. Image Process., 2013, 22, (4), pp. 1382–1394.
-
14)
-
10. Li, M., Nguyen, T.: ‘Markov random field model-based edge-directed image interpolation’, IEEE Trans. Image Process., 2008, 17, (7), pp. 1121–1128.
-
15)
-
50. Dong, W., Zhang, L., Shi, G., et al: ‘Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization’, IEEE Trans. Image Process., 2011, 20, (7), pp. 1838–1857.
-
16)
-
29. Fattal, R.: ‘Image upsampling via imposed edge statistics’. ACM SIGGRAPH, California, 2007, 26, (3), pp. 95.
-
17)
-
32. Sun, J., Sun, J., Xu, Z., et al: ‘Image super-resolution using gradient profile prior’. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2008), Anchorage, AK, 2008, pp. 1–8.
-
18)
-
31. Shan, Q., Li, Z., Jia, J., et al: ‘Fast image/video upsampling’. ACM SIGGRAPH Asia, 2008, pp. 1–7.
-
19)
-
12. Xu, H., Zhai, G., Yang, X.: ‘Single image super-resolution with detail enhancement based on local fractal analysis of gradient’, IEEE Trans. Circuits Syst. Video Technol., 2013, 23, (10), pp. 1740–1754.
-
20)
-
2. Freedman, G., Fattal, R.: ‘Image and video upscaling from local self-examples’, ACM Trans. Graph., 2011, 30, (2), pp. 1–10.
-
21)
-
53. Yu, J., Gao, X., Tao, D., et al: ‘A unified learning framework for single image super-resolution’, IEEE Trans. Neural Netw. Learn. Syst., 2014, 25, (4), pp. 780–792.
-
22)
-
43. Ren, J., Liu, J., Guo, Z.: ‘Context-aware sparse decomposition for image denoising and super-resolution’, IEEE Trans. Image Process., 2013, 22, (4), pp. 1456–1469.
-
23)
-
52. Zhang, K., Gao, X., Tao, D., et al: ‘Single image super-resolution with multiscale similarity learning’, IEEE Trans. Neural Netw. Learn. Syst., 2013, 24, (10), pp. 1648–1659.
-
24)
-
5. Li, X., Orchard, M.: ‘New edge-directed interpolation’, IEEE Trans. Image Process., 2001, 10, (10), pp. 1521–1527.
-
25)
-
4. Hou, H., Andrews, H.: ‘Cubic splines for image interpolation and digital filtering’, IEEE Trans. Acoust. Speech Signal Process., 1978, 26, (6), pp. 508–517.
-
26)
-
45. Peleg, T., Elad, M.: ‘A statistical prediction model based on sparse representations for single image super-resolution’, IEEE Trans. Image Process., 2014, 23, (6), pp. 2569–2582.
-
27)
-
39. Zhang, H., Zhang, Y., Huang, T.: ‘Efficient sparse representation based image super resolution via dual dictionary learning’. IEEE Int. Conf. Multimedia and Expo, 2011, pp. 1–6.
-
28)
-
1. Glasner, D., Bagon, S., Irani, M.: ‘Super-resolution from a single image’. 12th Int. Conf. Computer Vision, 2009, pp. 349–356.
-
29)
-
8. Zhang, L., Wu, X.: ‘An edge-guided image interpolation algorithm via directional filtering and data fusion’, IEEE Trans. Image Process., 2006, 15, (8), pp. 2226–2238.
-
30)
-
15. Freeman, W., Jones, T., Pasztor, E.: ‘Example-based super-resolution’, IEEE Comput. Graph. Appl., 2002, 22, (2), pp. 56–65.
-
31)
-
30. Dai, S., Han, M., Xu, W., et al: ‘Soft edge smoothness prior for alpha channel super resolution’. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2007), Minneapolis, MN, United States, 2007, pp. 1–8.
-
32)
-
13. Li, M., Liu, J., Ren, J., et al: ‘Adaptive general scale interpolation based on weighted autoregressive models’, IEEE Trans. Circuits Syst. Video Technol., 2015, 25, (2), pp. 200–211.
-
33)
-
38. Mallat, S., Yu, G.: ‘Super-resolution with sparse mixing estimators’, IEEE Trans. Image Process., 2010, 19, (11), pp. 2889–2900.
-
34)
-
28. Baker, S., Kanade, T.: ‘Limits on super-resolution and how to break them’, IEEE Trans. Pattern Anal. Mach. Intell., 2002, 24, (9), pp. 1167–1183.
-
35)
-
41. Yang, J., Wang, Z., Lin, Z., et al: ‘Coupled dictionary training for image super-resolution’, IEEE Trans. Image Process., 2012, 21, (8), pp. 3467–3478.
-
36)
-
6. Asuni, N., Giachetti, A.: ‘Accuracy improvements and artifacts removal in edge based image interpolation’. VISAPP 2008, 2008, pp. 1–8.
-
37)
-
42. Wang, S., Zhang, L., Liang, Y., et al: ‘Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis’. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2012), 2012, pp. 2216–2223.
-
38)
-
37. Kim, K., Kwon, Y.: ‘Single-image super-resolution using sparse regression and natural image prior’, IEEE Trans. Pattern Anal. Mach. Intell., 2010, 32, (6), pp. 1127–1133.
-
39)
-
7. Giachetti, A., Asuni, N.: ‘Real-time artifact-free image upscaling’, IEEE Trans. Image Process., 2011, 20, (10), pp. 2760–2768.
-
40)
-
16. Lin, Z., He, J., Tang, X., et al: ‘Limits of learning-based superresolution algorithms’. 11th IEEE Int. Conf. Computer Vision (ICCV 2007), Rio de Janeiro, Brazil, 2007, pp. 1–8.
-
41)
-
24. Gao, X., Zhang, K., Tao, D., et al: ‘Joint learning for single-image super-resolution via a coupled constraint’, IEEE Trans. Image Process., 2012, 21, (2), pp. 469–480.
-
42)
-
33. Tai, Y., Liu, S., Brown, M., et al: ‘Super resolution using edge prior and single image detail synthesis’. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2010), San Francisco, United States, 2010, pp. 2400–2407.
-
43)
-
17. Kim, K., Kwon, Y.: ‘Example-based learning for single-image super-resolution’. DAGM, 2008, pp. 456–465.
-
44)
-
22. Yang, M., Wang, Y.: ‘A self-learning approach to single image super-resolution’, IEEE Trans. Multimed., 2013, 15, (3), pp. 498–508.
-
45)
-
11. Wang, L., Xiang, S., Meng, G., et al: ‘Edge-directed single-image super-resolution via adaptive gradient magnitude self-interpolation’, IEEE Trans. Circuits Syst. Video Technol., 2013, 23, (8), pp. 1289–1299.
-
46)
-
25. Jiang, J., Hu, R., Han, Z., et al: ‘Efficient single image super-resolution via graph embedding’. IEEE Int. Conf. Multimedia and Expo (ICME 2012), Melbourne, VIC, 2012, pp. 610–615.
-
47)
-
49. Zontak, M., Irani, M.: ‘Internal statistics of a single natural image’. IEEE Conf. Computer Vision and Pattern Recognition, 2011, pp. 977–984.
-
48)
-
19. Zhang, K., Gao, X., Tao, D., et al: ‘Single image super-resolution with non-local means and steering kernel regression’, IEEE Trans. Image Process., 2012, 21, (11), pp. 4544–4556.
-
49)
-
21. Dong, C., Loy, C., He, K., et al: ‘Learning a deep convolutional network for image super-resolution’. European Conf. Computer Vision (ECCV 2014), 2014, pp. 184–199.
-
50)
-
35. Zhang, H., Zhang, Y., Li, H., et al: ‘Generative Bayesian image super resolution with natural image prior’, IEEE Trans. Image Process., 2012, 21, (9), pp. 4054–4067.
-
51)
-
20. Xiong, Z., Xu, D., Sun, X., et al: ‘Example-based super-resolution with soft information and decision’, IEEE Trans. Multimed., 2013, 15, (6), pp. 1458–1465.
-
52)
-
47. Cheng, M., Wang, C., Li, J.: ‘Single-image super-resolution in RGB space via group sparse representation’, IET Image Process., 2015, 9, (6), pp. 461–467.
-
53)
-
34. Babacan, S., Molina, R., Katsaggelos, A.: ‘Variational Bayesian super resolution’, IEEE Trans. Image Process., 2011, 20, (4), pp. 984–999.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2017.0274
Related content
content/journals/10.1049/iet-ipr.2017.0274
pub_keyword,iet_inspecKeyword,pub_concept
6
6