© The Institution of Engineering and Technology
Saliency detection has shown a great role in many image processing applications. This study introduces a new Bayesian framework for saliency detection. In this framework, image saliency is computed as product of three saliencies: location-based, feature-based and centre-surround saliencies. Each of these saliencies is estimated using statistical approaches. The centre-surround saliency is estimated using Dirichlet process mixture model. The authors evaluate their method using five different databases and it is shown that it outperform state-of-the-art methods. Also, they show that the proposed method has a low computational cost.
References
-
-
1)
-
18. Szegedy, C., Liu, W., Jia, Y., et al: ‘Going deeper with convolutions’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2015, pp. 1–9.
-
2)
-
10. Bruce, N., Tsotsos, J.: ‘Attention based on information maximization’, J. Vis., 2007, 7, (9), pp. 950–950.
-
3)
-
27. Ferguson, T.S.: ‘A Bayesian analysis of some nonparametric problems’, Ann. Stat., 1973, 1, (2), pp. 209–230.
-
4)
-
32. Bylinskii, Z., Judd, T., Borji, A., et al: ‘MIT saliency benchmark’ .
-
5)
-
13. Judd, T., Ehinger, K., Durand, F., et al: ‘Learning to predict where humans look’. Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2009, pp. 2106–2113.
-
6)
-
23. Borji, A., Itti, L.: ‘Cat2000: a large scale fixation dataset for boosting saliency research’, .
-
7)
-
15. Felzenszwalb, P.F., Girshick, R.B., McAllester, D., et al: ‘Object detection with discriminatively trained part-based models’, IEEE Trans. Pattern Anal. Mach. Intell., 2010, 32, (9), pp. 1627–1645.
-
8)
-
24. Gonzalez, R.C., Woods, R.E.: ‘Digital image processing’ (Prentice-Hall, 1992, 2007, 2nd edn.).
-
9)
-
9. Harel, J., Koch, C., Perona, P.: ‘Graph-based visual saliency’. Proc. Conf. Advances in Neural Information Processing Systems, 2007, vol. 19, pp. 545–552.
-
10)
-
1. Koch, K., McLean, J., Segev, R., et al: ‘How much the eye tells the brain’, Curr. Biol., 2006, 16, (14), pp. 1428–1434.
-
11)
-
29. Bylinskii, Z., Judd, T., Oliva, A., et al: ‘What do different evaluation metrics tell us about saliency models?’, .
-
12)
-
30. Li, J., Levine, M.D., An, X., et al: ‘Visual saliency based on scale-space analysis in the frequency domain’, IEEE Trans. Pattern Anal. Mach. Intell., 2013, 35, (4), pp. 996–1010.
-
13)
-
28. Neal, R.M.: ‘Markov chain sampling methods for Dirichlet process mixture models’, J. Computat. Graph. Stat., 2000, 9, (2), pp. 249–265.
-
14)
-
40. Achanta, R., Hemami, S., Estrada, F., et al: ‘Frequency-tuned salient region detection’. Proc. of Computer Vision and Pattern Recognition, 2009, pp. 1597–1604.
-
15)
-
38. Murray, N., Vanrell, M., Otazu, X., et al: ‘Saliency estimation using a non-parametric low-level vision model’. Proc. of Computer Vision and Pattern Recognition, 2011, pp. 433–440.
-
16)
-
26. Kivinen, J.J., Sudderth, E.B., Jordan, M.I.: ‘Image denoising with nonparametric hidden Markov trees’. Proc. IEEE Int. Conf. Image Processing, 2007, vol. 3.
-
17)
-
25. Orbanz, P., Buhmann, J.M.: ‘Nonparametric Bayesian image segmentation’, Int. J. Comput. Vis., 2008, 77, (1-3), pp. 25–45.
-
18)
-
19. Simonyan, K., Zisserman, A.: ‘Very deep convolutional networks for large-scale image recognition’, .
-
19)
-
22. Kruthiventi, S.S.S., Ayush, K., Babu, R.V.: ‘Deepfix: a fully convolutional neural network for predicting human eye fixations’, .
-
20)
-
4. Liu, Z., Xue, Y., Yan, H., et al: ‘Efficient saliency detection based on Gaussian models’, IET Image Process., 2011, 5, (2), pp. 122–131.
-
21)
-
2. Hsin, H.: ‘Saliency histogram equalization and its application to image resizing’, IET Image Process., 2016, 10, (10), pp. 787–798.
-
22)
-
36. Garcia-Diaz, A., Leboran, V., Fdez-Vidal, X.R., et al: ‘On the relationship between optical variability, visual saliency, and eye fixations: a computational approach’, J. Vis., 2012, 12, (6), p. 17.
-
23)
-
20. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ‘Imagenet classification with deep convolutional neural networks’. Proc. Advances in Neural Information Processing Systems, 2012, pp. 1097–1105.
-
24)
-
8. Zhang, L., Tong, M.H., Marks, T.K., et al: ‘SUN: A Bayesian framework for saliency using natural statistics’, J. Vis., 2008, 8, (7), pp. 32–32.
-
25)
-
34. Goferman, S., Zelnik-Manor, L., Tal, A.: ‘Context-aware saliency detection’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 34, (10), pp. 1915–1926.
-
26)
-
21. Vig, E., Dorr, M., Cox, D.: ‘Large-scale optimization of hierarchical features for saliency prediction in natural images’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2014, pp. 2798–2805.
-
27)
-
12. Hou, X., Zhang, L.: ‘Saliency detection: a spectral residual approach’. Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2007, pp. 1–8.
-
28)
-
39. López-García, F., Dosil, R., Pardo, X.M., et al: ‘Scene recognition through visual attention and image features: a comparison between sift and surf approaches’ (INTECH Open Access Publisher, Rijeka, 2011).
-
29)
-
16. Wang, Q., Yuan, Y., Yan, P., et al: ‘Saliency detection by multiple-instance learning’, IEEE Trans. Cybern., 2013, 43, (2), pp. 660–672.
-
30)
-
7. Oliva, A., Torralba, A., Castelhano, M.S., et al: ‘Top-down control of visual attention in object detection’. Proc. Int. Conf. Image Processing, 2003, pp. 253–256.
-
31)
-
35. Tavakoli, H.R., Rahtu, E., Heikkilä, J.: ‘Fast and efficient saliency detection using sparse sampling and kernel density estimation’. Proc. of Scandinavian Conf. Image Analysis, 23 May 2011, pp. 666–675.
-
32)
-
37. Torralba, A., Oliva, A., Castelhano, M., et al: ‘Contextual guidance of attention in natural scenes: the role of global features on object search’, Psychol. Rev., 2006, 113, (4), pp. 766–786.
-
33)
-
31. Cerf, M., Harel, J., Einhäuser, W., et al: ‘Predicting human gaze using low-level saliency combined with face detection’, Adv. Neural Inf. Process. Syst., 2008, pp. 241–248.
-
34)
-
14. Viola, P., Jones, M.J.: ‘Robust real-time face detection’, Int. J. Comput. Vis., 2004, 57, (2), pp. 137–154.
-
35)
-
33. Zhang, J., Sclaroff, S.: ‘Exploiting surroundedness for saliency detection: a Boolean map approach’, IEEE Trans. Pattern Anal. Mach. Intell., 2016, 38, (5), pp. 889–902.
-
36)
-
6. Wang, Q., Yuan, Y., Yan, P.: ‘Visual saliency by selective contrast’, IEEE Trans. Circuits Syst. Video Technol., 2013, 23, (7), pp. 1150–1155.
-
37)
-
11. Riche, N., Mancas, M., Duvinage, M., et al: ‘Rare2012: a multi-scale rarity-based saliency detection with its comparative statistical analysis’, Signal Process., Image Commun., 2013, 28, (6), pp. 642–658.
-
38)
-
17. Wang, Q., Zhu, G., Yuan, Y.: ‘Multi-spectral dataset and its application in saliency detection’, Comput. Vis. Image Underst., 2013, 117, (12), pp. 1748–1754.
-
39)
-
41. Xie, Y., Lu, H.: ‘Visual saliency detection based on Bayesian model’. Proc. of Int. Conf. Image Processing, 2011, pp. 645–648.
-
40)
-
3. Lee, J., Park, R.: ‘Segmentation with saliency map using colour and depth images’, IET Image Process., 2015, 9, (1), pp. 62–70.
-
41)
-
5. Itti, L., Koch, C., Niebur, E.: ‘A model of saliency-based visual attention for rapid scene analysis’, IEEE Trans. Pattern Anal. Mach. Intell., 1998, 20.11, pp. 1254–1259.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2017.0267
Related content
content/journals/10.1049/iet-ipr.2017.0267
pub_keyword,iet_inspecKeyword,pub_concept
6
6