access icon free Saliency detection using adaptive background template

© The Institution of Engineering and Technology
Received 04/06/2016, Accepted 21/02/2017, Revised 05/02/2017, Published 03/03/2017

Since most existing saliency detection models are not suitable for the condition that the salient objects are near at the image border, the authors propose a saliency detection approach based on adaptive background template (SCB) despite of the position of the salient objects. First, a selection strategy is presented to establish the adaptive background template by removing the potential saliency superpixels from the image border regions, and the initial saliency map is obtained. Second, a propagation mechanism based on K-means algorithm is designed for maintaining the neighbourhood coherence of the above saliency map. Finally, a new spatial prior is presented to integrate the saliency detection results by aggregating two complementary measures such as image centre preference and the background template exclusion. Comprehensive evaluations on six benchmark datasets indicate that the authors’ method outperforms other state-of-the-art approaches. In addition, a new dataset containing 300 challenging images is constructed for evaluating the performance of various salient object detection methods.

References

    1. 1)
      • 6. Duan, L., Wu, C., Miao, J., et al: ‘Visual saliency detection by spatially weighted dissimilarity’. IEEE Conf. on Computer Vision and Pattern Recognition, Providence, USA, 20–25 June 2011, pp. 473–480.
    2. 2)
      • 30. Zhai, Y., Shah, M.: ‘Visual attention detection in video sequences using spatiotemporal cues’. Proc. of the 14th Annual ACM Int. Conf. on Multimedia, New York, USA, 23–27 October 2006, pp. 815–824.
    3. 3)
      • 35. Li, G., Yu, Y.: ‘Visual saliency based on multiscale deep features’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Boston, USA, 7–12 June 2015, pp. 5455–5463.
    4. 4)
      • 3. Chen, T., Cheng, M.M., Tan, P., et al: ‘Sketch2Photo: internet image montage’, ACM Trans. Graph., 2009, 28, pp. 124–124.
    5. 5)
      • 8. Li, X., Lu, H., Zhang, L., et al: ‘Saliency detection via dense and sparse reconstruction’. Proc. of the IEEE Int. Conf. on Computer Vision, Sydney, Australia, 1–8 December 2013, pp. 2976–2983.
    6. 6)
      • 24. Qin, Y., Lu, H., Xu, Y., et al: ‘Saliency detection via cellular automata’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Boston, USA, 7–12 June 2015, pp. 110–119.
    7. 7)
      • 39. Zhang, J., Sclaroff, S., Lin, Z., et al: ‘Minimum barrier salient object detection at 80 fps’. Proc. of the IEEE Int. Conf. on Computer Vision, 2015, pp. 1404–1412.
    8. 8)
      • 29. Judd, T., Ehinger, K., Durand, F., et al: ‘Learning to predict where humans look’. IEEE Int. Conf. on Computer Vision, Kyoto, Japan, 29 September–2 October 2009, pp. 2106–2113.
    9. 9)
      • 32. Yan, Q., Xu, L., Shi, J., et al: ‘Hierarchical saliency detection’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Portland, USA, 23–28 June 2013, pp. 1155–1162.
    10. 10)
      • 33. Alpert, S., Galun, M., Brandt, A., et al: ‘Image segmentation by probabilistic bottom-up aggregation and cue integration’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 34, pp. 315–327.
    11. 11)
      • 36. Hou, X., Zhang, L.: ‘Saliency detection: a spectral residual approach’. IEEE Conf. on Computer Vision and Pattern Recognition, Minneapolis, USA, 17–22 June 2007, pp. 1–8.
    12. 12)
      • 5. Hu, W., Hu, R., Xie, N., et al: ‘Image classification using multiscale information fusion based on saliency driven nonlinear diffusion filtering’, IEEE Trans. Image Process., 2014, 23, pp. 1513–1526.
    13. 13)
      • 9. Cheng, M.M., Zhang, G.X., Mitra, N.J., et al: ‘Global contrast based salient region detection’, IEEE Trans. Pattern Anal. Mach. Intell., 2015, 37, pp. 569–582.
    14. 14)
      • 20. Valenti, R., Sebe, N., Gevers, T.: ‘Image saliency by isocentric curvedness and color’. IEEE 12th Int. Conf. on Computer Vision, Kyoto, Japan, 29 September–2 October 2009, pp. 2185–2192.
    15. 15)
      • 28. Borji, A.: ‘What is a salient object? a dataset and a baseline model for salient object detection’, IEEE Trans. Image Process., 2015, 24, (2), pp. 742–756.
    16. 16)
      • 12. Jiang, H., Wang, J., Yuan, Z., et al: ‘Salient object detection: a discriminative regional feature integration approach’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Portland, USA, 23–28 June 2013, pp. 2083–2090.
    17. 17)
      • 14. Jiang, H., Wu, Y., Yuan, Z.: ‘Probabilistic salient object contour detection based on superpixels’. IEEE Int. Conf. on Image Processing, Melbourne, Australia, 15–18 September 2013, pp. 3069–3072.
    18. 18)
      • 7. Wei, Y., Wen, F., Zhu, W., et al: ‘Geodesic saliency using background priors’. Computer Vision – ECCV 2012, Berlin, Germany, 2012, pp. 29–42.
    19. 19)
      • 10. Yang, C., Zhang, L., Lu, H., et al: ‘Saliency detection via graph-based manifold ranking’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Portland, USA, 23–28 June 2013, pp. 3166–3173.
    20. 20)
      • 26. Tu, W.C., He, S., Yang, Q., et al: ‘Real-time salient object detection with a minimum spanning tree’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, 2016, pp. 2334–2342.
    21. 21)
      • 23. Ma, Y.F., Zhang, H.J.: ‘Contrast-based image attention analysis by using fuzzy growing’. Proc. of the Eleventh ACM Int. Conf. on Multimedia, New York, USA, 2–8 November 2003, pp. 374–381.
    22. 22)
      • 2. Ren, Z., Gao, S., Chia, L.T., et al: ‘Region-based saliency detection and its application in object recognition’, IEEE Trans. Circuits Syst. Video Technol., 2014, 24, pp. 769–779.
    23. 23)
      • 37. Tong, N., Lu, H., Zhang, Y., et al: ‘Salient object detection via global and local cues’, Pattern Recognit., 2015, 48, pp. 3258–3267.
    24. 24)
      • 38. Li, H., Lu, H., Lin, Z., et al: ‘Inner and inter label propagation: salient object detection in the wild’, IEEE Trans. Image Process., 2015, 4, pp. 3176–3186.
    25. 25)
      • 11. Jiang, B., Zhang, L., Lu, H., et al: ‘Saliency detection via absorbing Markov chain’. Proc. of the IEEE Int. Conf. on Computer Vision, Sydney, Australia, 1–8 December 2013, pp. 1665–1672.
    26. 26)
      • 1. Donoser, M., Urschler, M., Hirzer, M., et al: ‘Saliency driven total variation segmentation’. IEEE 2009 Int. Conf. on Computer Vision, Sakyo, Kyoto, Japan, 29 September–2 October 2009, pp. 817–824.
    27. 27)
      • 19. Goferman, S., Zelnik-Manor, L., Tal, A.: ‘Context-aware saliency detection’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 34, pp. 1915–1926.
    28. 28)
      • 16. Borji, A., Cheng, M.M., Jiang, H., et al: ‘Salient object detection: a benchmark’, IEEE Trans. Image Process., 2015, 24, pp. 5706–5722.
    29. 29)
      • 31. Movahedi, V., Elder, J.H.: ‘Design and perceptual validation of performance measures for salient object segmentation’. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition Workshops, San Francisco, USA, 13–18 June 2010, pp. 49–56.
    30. 30)
      • 27. Achanta, R., Shaji, A., Smith, K., et al: ‘SLIC superpixels compared to state-of-the-art superpixel methods’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 34, pp. 2274–2282.
    31. 31)
      • 34. Zou, W., Kpalma, K., Liu, Z., et al: ‘Segmentation driven low-rank matrix recovery for saliency detection’. Proc. of the British Machine Vision Conf., Bristol, UK, 9–13 September 2013, pp. 1–13.
    32. 32)
      • 17. Achanta, R., Hemami, S., Estrada, F., et al: ‘Frequency-tuned salient region detection’. IEEE Conf. on Computer Vision and Pattern Recognition, Miami, USA, 20–25 June 2009, pp. 1597–1604.
    33. 33)
      • 21. Cheng, M.M., Warrell, J., Lin, W.Y., et al: ‘Efficient salient region detection with soft image abstraction’. Proc. of the IEEE Int. Conf. on Computer Vision, Sydney, Australia, 1–8 December 2013, pp. 1529–1536.
    34. 34)
      • 22. Shen, X., Wu, Y.: ‘A unified approach to salient object detection via low rank matrix recovery’. IEEE Conf. on Computer Vision and Pattern Recognition, Providence, USA, 16–21 June 2012, pp. 853–860.
    35. 35)
      • 25. Sun, J., Lu, H., Liu, X.: ‘Saliency region detection based on Markov absorption probabilities’, IEEE Trans. Image Process., 2015, 24, (5), pp. 1639–1649.
    36. 36)
      • 15. Itti, L., Koch, C., Niebur, E.: ‘A model of saliency-based visual attention for rapid scene analysis’, IEEE Trans. Pattern Anal. Mach. Intell., 1998, 11, pp. 1254–1259.
    37. 37)
      • 13. Zhu, W., Liang, S., Wei, Y., et al: ‘Saliency optimization from robust background detection’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Columbus, USA, 23–28 June 2014, pp. 2814–2821.
    38. 38)
      • 18. Rahtu, E., Kannala, J., Salo, M., et al: ‘Segmenting salient objects from images and videos’. Computer Vision – ECCV 2010, Berlin, Germany, 2010, pp. 366–379.
    39. 39)
      • 4. Battiato, S., Farinella, G.M., Puglisi, G., et al: ‘Saliency based selection of gradient vector flow paths for content aware image resizing’, IEEE Trans. Image Process., 2014, 23, (5), pp. 2081–2095.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2016.0169
Loading

Related content

content/journals/10.1049/iet-cvi.2016.0169
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading