http://iet.metastore.ingenta.com
1887

Speedy and accurate image super-resolution via deeply recursive CNN with skip connection and network in network

Speedy and accurate image super-resolution via deeply recursive CNN with skip connection and network in network

For access to this article, please select a purchase option:

Buy article PDF
$19.95
(plus tax if applicable)
Buy Knowledge Pack
10 articles for $120.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Image Processing — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

The single image super-resolution (SISR) methods based on the deep convolutional neural network (CNN) have recently achieved significant improvements in accuracy, advancing the state of the art. However, these deeper models are computationally expensive and require a large number of parameters. Accordingly, they demand more memory and are unsuitable for on-chip devices. In this study, a novel SISR method using a deeply recursive CNN with skip connections and a network in network structure is proposed. The deeply recursive CNN with skip connections is adopted for the image feature extraction at both local and global levels. Parallelised 1 × 1 CNNs, usually called a network in network structure, are adopted for image reconstruction. Specifically, recursive learning is utilised to control the number of model parameters needed and residual learning is used to ease the difficulty of training. The proposed method performs favourably against the state-of-the-art methods in terms of computational speed and accuracy. It significantly outperforms the previous methods by a large margin, while demanding far fewer parameters. This model requires less memory and is friendly to on-chip devices.

References

    1. 1)
      • 1. Duchon, C.E.: ‘Lanczos filtering in one and two dimensions’, J. Appl. Meteorol., 1979, 18, (8), pp. 10161022.
    2. 2)
      • 2. Chang, H., Yeung, D.Y., Xiong, Y.: ‘Super-Resolution through neighbor embedding’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Washington, DC, June/July 2004, pp. 275282.
    3. 3)
      • 3. Bevilacqua, M., Roumy, A., Guillemot, C., et al: ‘Low-Complexity single image super-resolution based on nonnegative neighbor embedding’. Proc. British Machine Vision Conf., Surrey, Guildford, England, September 2012, pp. 135.1135.10.
    4. 4)
      • 4. Yang, J., Wright, J., Huang, T.S., et al: ‘Image super-resolution via sparse representation’, IEEE Trans. Image Process., 2010, 19, (11), pp. 28612873.
    5. 5)
      • 5. Roman, Z., Michael, E., Matan, P.: ‘On single image scale-up using sparse-representations’. Proc. Int. Conf. Curves and Surfaces, Avignon, France, June 2010, pp. 711730.
    6. 6)
      • 6. Timofte, R., Smet, V.D., Gool, L.V.: ‘Anchored neighborhood regression for fast example-based super-resolution’. Proc. IEEE Int. Conf. on Computer Vision, Sydney, Australia, December 2013, pp. 19201927.
    7. 7)
      • 7. Timofte, R., Smet, V.D., Gool, L.V.: ‘A + : adjusted anchored neighborhood regression for fast super-resolution’. Proc. Asian Conf. on Computer Vision, Singapore, Singapore, November 2014, pp. 111126.
    8. 8)
      • 8. Schulter, S., Leistner, C., Bischof, H.: ‘Fast and accurate image upscaling with super-resolution forests’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Boston, MA, June 2015, pp. 37913799.
    9. 9)
      • 9. Dong, C., Loy, C.C., He, K., et al: ‘Image super-resolution using deep convolutional networks’, IEEE Trans. Pattern Anal. Mach. Intell., 2016, 38, (2), pp. 295307.
    10. 10)
      • 10. Dong, C., Chen, C.L., He, K., et al: ‘Learning a deep convolutional network for image super-resolution’. Proc. European Conf. on Computer Vision, Zurich, Switzerland, September 2014, pp. 184199.
    11. 11)
      • 11. Dong, C., Chen, C.L., Tang, X.: ‘Accelerating the super-resolution convolutional neural network’. Proc. European Conf. on Computer Vision, Amsterdam, Netherlands, October 2016, pp. 391407.
    12. 12)
      • 12. Kim, J., Lee, J.K., Lee, K.M.: ‘Accurate image super-resolution using very deep convolutional networks’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Seattle, WA, June 2016, pp. 16461654.
    13. 13)
      • 13. Kim, J., Lee, J.K., Lee, K.M.: ‘Deeply-Recursive convolutional network for image super-resolution’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Seattle, WA, June 2016, pp. 16371645.
    14. 14)
      • 14. He, K., Zhang, X., Ren, S., et al: ‘Deep residual learning for image recognition’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Seattle, WA, June 2016, pp. 770778.
    15. 15)
      • 15. Tai, Y., Yang, J., Liu, X.: ‘Image super-resolution via deep recursive residual network’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Honolulu, Hawaii, US, July 2017, pp. 27902798.
    16. 16)
      • 16. Ledig, C., Theis, L., Huszar, F., et al: ‘Photo-Realistic single image super-resolution using a generative adversarial network’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Honolulu, Hawaii, July 2017, pp. 105114.
    17. 17)
      • 17. Chen, Z., Tong, Y.: ‘Face super-resolution through Wasserstein GANs’. arXiv: 1705.02438, May 2017.
    18. 18)
      • 18. Mao, X.J., Shen, C., Yang, Y.B.: ‘Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections’. Proc. Adv. Neural Information Processing Systems, Barcelona, Spain, December 2016, pp. 28022810.
    19. 19)
      • 19. Lin, M., Chen, Q., Yan, S.: ‘Network in network’. arXiv: 1312.4400, March 2014.
    20. 20)
      • 20. Szegedy, C., Liu, W., Jia, Y., et al: ‘Going deeper with convolutions’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Boston, MA, June 2015, pp. 19.
    21. 21)
      • 21. Shi, W., Caballero, J., Huszár, F., et al: ‘Real-Time single image and video super-resolution using an efficient sub-pixel convolutional neural network’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Seattle, WA, June 2016, pp. 18741883.
    22. 22)
      • 22. Martin, D., Fowlkes, C., Tal, D., et al: ‘A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics’. Proc. IEEE Int. Conf. on Computer Vision, Vancouver, Canada, July 2001, pp. 416423.
    23. 23)
      • 23. Timofte, R., Rothe, R., Gool, L.V.: ‘Seven ways to improve example-based single image super resolution’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Seattle, WA, June 2016, pp. 18651873.
    24. 24)
      • 24. Arbeláez, P., Maire, M., Fowlkes, C., et al: ‘Contour detection and hierarchical image segmentation’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, (5), pp. 898916.
    25. 25)
      • 25. He, K., Zhang, X., Ren, S., et al: ‘Delving deep into rectifiers: surpassing human-level performance on ImageNet classification’. Proc. IEEE Int. Conf. on Computer Vision, Santiago, Chile, December 2015, pp. 10261034.
    26. 26)
      • 26. Hinton, G.E., Srivastava, N., Krizhevsky, A., et al: ‘Improving neural networks by preventing co-adaptation of feature detectors’, Comput. Sci., 2012, 3, (4), pp. 212223.
    27. 27)
      • 27. Kingma, D., Ba, J.: ‘Adam: A method for stochastic optimization’. arXiv: 1412.6980, January 2017.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2018.5907
Loading

Related content

content/journals/10.1049/iet-ipr.2018.5907
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address