© The Institution of Engineering and Technology
Super-resolution (SR) image reconstruction refers to methods where a higher resolution image is reconstructed using a set of overlapping aliased low-resolution observations of the same scene. Although edge preservation has been a widely explored topic in SR literature, texture-specific regularisation has recently gained interest. In this study, texture-specific regularisation is handled as a post-processing step. A two stage method is proposed, comprising multiple SR reconstructions with different regularisation parameters followed by a restoration step for preserving edges and textures. In the first stage, two maximum-a-posteriori estimators with two different amounts of regularisation are employed. In the second stage, pixel-to-pixel difference between these two estimates is post-processed to restore edges and textures. Frequency selective characteristics of discrete cosine transform and Gabor filters are utilised in the post-processing step. Experiments on synthetically generated images and real experiments demonstrate that the proposed methods give better results compared with the state-of-the-art SR methods especially on textures and edges.
References
-
-
1)
-
25. Tipping, M.E., Bishop, C.M.: ‘Bayesian image super-resolution’. In (Ed.): ‘Advances in neural information processing systems’ (MIT Press, 2003), pp. 1303–1310.
-
2)
-
14. Turgay, E., Akar, G.B.: ‘Directionally adaptive super-resolution’. Proc. IEEE Int. Conf. Image Processing, November 2009, pp. 1201–04.
-
3)
-
M. Elad ,
A. Feuer
.
Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images.
IEEE Trans. Image Process.
,
1646 -
1658
-
4)
-
16. Choi, B., Kim, S.D., Ra, J.B.: ‘Region-based super-resolution using adaptive diffusion regularization’, Opt. Eng., 2008, 47, (2), pp. 027006 (doi: 10.1117/1.2857419).
-
5)
-
N.A. Woods ,
N.P. Galatsanos ,
A.K. Katsaggelos
.
Stochastic methods for joint registration, restoration, and interpolation of multiple under-sampled images.
IEEE Trans. Image Process.
,
1 ,
201 -
213
-
6)
-
30. Katsuki, T., Torii, A., Inoue, M.: ‘Posterior-mean super-resolution with a causal Gaussian Markov random field prior’, IEEE Trans. Image Process., 2012, 21, (7), pp. 3182–3193 (doi: 10.1109/TIP.2012.2189578).
-
7)
-
17. Turgay, E., Akar, G.B.: ‘Context based super resolution image reconstruction’. Proc. IEEE Local and Non-Local Approximation in Image Processing, August 2009, pp. 54–61.
-
8)
-
Z. Wang ,
A.C. Bovik ,
H.R. Sheikh ,
E.P. Simoncelli
.
Image quality assessment: from error visibility to structural similarity.
IEEE Trans. Image Process.
,
4 ,
600 -
613
-
9)
-
3. Tekalp, A.M., Ozkan, M.K., Sezan, M.I.: ‘High-resolution image reconstruction from lower-resolution image sequences and space varying image restoration’. Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), IEEE San Francisco, CA, March 1992, vol. 3, pp. 169–172.
-
10)
-
S. Farsiu ,
D. Robinson ,
M. Elad ,
P. Milanfar
.
Fast and robust multi-frame super-resolution.
IEEE Trans. Image Process.
,
10 ,
1327 -
1344
-
11)
-
12. Pickup, L.C., Capel, D.P., Roberts, S.J., Zisserman, A.: ‘Bayesian image super-resolution, continued’, in Schölkopf, B., Roberts, S.J., Zisserman, A. (Ed.): ‘Advances in neural information processing systems’ (MIT Press, 2006), pp. 1089–1096.
-
12)
-
35. Grigorescu, S.E., Petkov, N., Kruizinga, P.: ‘Comparison of texture features based on Gabor filters’, IEEE Trans. Image Process., 2002, 11, (10), pp. 1160–1167 (doi: 10.1109/TIP.2002.804262).
-
13)
-
28. Kanemura, A., Maeda, S., Ishii, S.: ‘Super-resolution with compound Markov random fields via the variational EM algorithm’, Neural Netw., 2009, 22, (7), pp. 1025–1034 (doi: 10.1016/j.neunet.2008.12.005).
-
14)
-
18. Elad, M., Datsenko, D.: ‘Example-based regularization deployed to super-resolution reconstruction of a single image’, Comput. J., 2007, 52, pp. 15–30 (doi: 10.1093/comjnl/bxm008).
-
15)
-
7. Protter, M., Elad, M., Takeda, H., Milanfar, P.: ‘Generalizing the nonlocal-means to super-resolution reconstruction’, IEEE Trans. Image Process., 2009, 18, (1), pp. 36–51 (doi: 10.1109/TIP.2008.2008067).
-
16)
-
8. Babacan, S.D., Molina, D., Katseggelos, A.K.: ‘Variational Bayesian super resolution’, IEEE Trans. Image Process., 2011, 20, (4), pp. 984–999 (doi: 10.1109/TIP.2010.2080278).
-
17)
-
19. Pickup, L.C., Roberts, S.J., Zisserman, A.: ‘A sampled texture prior for image super-resolution’. Proc. Advances in Neural Information Processing Systems 16 (NIPS ‘03), December 2004, pp. 1587–1594.
-
18)
-
32. Trandon, T.: ‘Brodatz textures’, .
-
19)
-
R.C. Hardie ,
K.J. Barnard ,
E.E. Armstrong
.
Joint MAP registration and high-resolution image estimation using a sequence of undersampled images.
IEEE Trans. Image Process.
,
12 ,
1621 -
1633
-
20)
-
K. Guo ,
X. Yang ,
W. Lin ,
R. Zhang ,
S. Yu
.
Learning-based super-resolution method with a combining of both global and local constraints.
IET Image Process.
,
4 ,
337 -
344
-
21)
-
13. Chantas, G., Galatsanos, N.P., Molina, R., Katsaggelos, A.K.: ‘Variational Bayesian image restoration with a product of spatially weighted total variation image priors’, IEEE Trans. Image Process., 2010, 19, (2), pp. 351–362 (doi: 10.1109/TIP.2009.2033398).
-
22)
-
S. Geman ,
D. Geman
.
Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images.
IEEE Trans. Pattern Anal. Mach. Intell.
,
6 ,
721 -
741
-
23)
-
W.T. Freeman ,
T.R. Jones ,
E.C. Pasztor
.
Example-based super-resolution.
IEEE Comput. Graph. Appl.
,
2 ,
56 -
65
-
24)
-
20. Datsenko, D., Elad, M.: ‘Example-based single document image super-resolution: a global map approach with outlier rejection’, Multidimens. Syst. Signal Process., 2007, 18, pp. 103–121 (doi: 10.1007/s11045-007-0018-z).
-
25)
-
S. Baker ,
T. Kanade
.
Limits on super-resolution and how to break them.
IEEE Trans. Pattern Anal. Mach. Intell.
,
1167 -
1183
-
26)
-
1. Tsai, R.Y., Huang, T.S.: ‘Multiframe image restoration and registration’. Advances in Computer Vision and Image Processing, 1984, vol. 1, no 2, pp. 317–339.
-
27)
-
9. Bose, N.K., Kim, S.P., Valenzuela, H.M.: ‘Recursive implementation of total least squares algorithm for image reconstruction from noisy, undersampled multiframes’. Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, 1993, vol. 5, pp. 269–272.
-
28)
-
33. Mehrotra, R., Namuduri, K.R., Ranganathan, N.: ‘Gabor filter-based edge detection’, Pattern Recognit., 1992, 25, (12), pp. 1479–1494 (doi: 10.1016/0031-3203(92)90121-X).
-
29)
-
39. Keren, D., Peleg, S., Brada, R.: ‘Image sequence enhancement using sub-pixel displacement’. IEEE Conf. Computer Vision and Pattern Recognition, June 1988, pp. 742–746.
-
30)
-
W.T. Freeman ,
E.C. Pasztor ,
O.T. Carmichael
.
Learning low level vision.
Int. J. Comput. Vis.
,
1 ,
25 -
47
-
31)
-
R.R. Schultz ,
R.L. Stevenson
.
Extraction of high-resolution frames from video sequences.
IEEE Trans. Image Process.
,
6 ,
996 -
1011
-
32)
-
36. Sorwar, G., Abraham, A.: ‘DCT based texture classification using a soft computing approach’, Malays. J. Comput. Sci., 2004, 17, (1), pp. 12–23.
-
33)
-
37. Shewchuk, J.R.: ‘An introduction to the conjugate gradient method without the agonizing pain’. , Pittsburgh, PA, USA, 1994.
-
34)
-
S.P. Kim ,
N.K. Bose ,
H.M. Valenzuela
.
Recursive reconstruction of high resolution image from noisy undersampled multiframes.
IEEE Trans. Acoust. Speech Signal Process.
,
6 ,
1013 -
1027
-
35)
-
C. Bouman ,
K. Sauer
.
A generalized Gaussian image model for edge-preserving MAP estimation.
IEEE Trans. Image Process.
,
3 ,
296 -
310
-
36)
-
2. Milanfar, P.: ‘Super-resolution imaging’ (CRC Press, 2010), vol. 1, pp. 5–20.
-
37)
-
15. Su, H., Tang, L., Tretter, D., Zhou, J.: ‘A practical and adaptive framework for super-resolution’. Proc. IEEE Int. Conf. Image Processing, November 2008, pp. 1236–39.
-
38)
-
26. Kumar, L., Kumar, C.N.R.: ‘Novel super resolution reconstruction of low resolution images progressively using DCT and zonal filter based denoising’, Int. J. Comput. Sci. Inf. Technol., 2011, 3, (1), pp. 54–72.
-
39)
-
A.K. Jain ,
F. Farrokhnia
.
Unsupervised texture segmentation using Gabor filters.
Pattern Recognit.
,
12 ,
1167 -
1186
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2013.0342
Related content
content/journals/10.1049/iet-ipr.2013.0342
pub_keyword,iet_inspecKeyword,pub_concept
6
6