access icon free Combining firefly algorithm and Bayesian classifier: new direction for automatic multilabel image annotation

© The Institution of Engineering and Technology
Received 18/08/2015, Accepted 16/05/2016, Revised 29/04/2016, Published 18/05/2016

As digital images are increasing exponentially; it is very attractive to develop more effective machine learning frameworks for automatic image annotation. In order to address the most prominent issues (huge inter-concept visual similarity and huge intra-concept visual diversity) more effectively, an inter-related non-parametric Bayesian classifier training framework to support multi-label image annotation is developed. For this purpose, an image is viewed as a bag, and its instances are the over-segmented regions within it found automatically with an adopted Otsu's method segmentation algorithm. Here firefly algorithm (FA) is utilised to enhance Otsu's method in the direction of finding optimal multilevel thresholds using the maximum variance intra-clusters. FA has high convergence speed and less computation rate as compared with some evolutionary algorithms. By generating blobs, the extracted features for segmented regions, the concepts which are learned by the classifier tend to relate textually to the words which occur most often in the data and visually to the easiest to recognise segments. This allowing the opportunity to assign a word to each object (localised labelling). Extensive experiments on Corel benchmark image datasets will validate the effectiveness of the proposed solution to multi-label image annotation and label ranking problem.

Inspec keywords: learning (artificial intelligence); image segmentation; pattern classification; feature extraction; Bayes methods; image recognition

Other keywords: Otsu method segmentation algorithm; machine learning framework; maximum variance intracluster; FA; interrelated nonparametric Bayesian classifier training framework; huge intraconcept visual similarity issue; Corel benchmark image dataset; segment recognition; label ranking problem; digital images; over-segmented region; huge intraconcept visual diversity issue; automatic multilabel image annotation; feature extraction; firefly algorithm

Subjects: Other topics in statistics; Other topics in statistics; Knowledge engineering techniques; Computer vision and image processing techniques; Image recognition

References

    1. 1)
      • 23. Yavlinsky, A., Schofield, E., Rüger, S.: ‘Automated image annotation using global features and robust nonparametric density estimation’, in Leow, W. -K., et al (Eds.): ‘Image and video retrieval’ (Springer-Verlag, Berlin, Heidelberg, 2005), pp. 507–517.
    2. 2)
      • 18. Chang, E., Goh, K., Sychay, G., et al: ‘CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines’, IEEE Trans. Circuits Syst. Video Technol., 2003, 13, (1), pp. 26–38.
    3. 3)
      • 15. Xue, X., Luo, H., Fan, J.: ‘Structured max-margin learning for multi-label image annotation’. Proc. of the 9th ACM Int. Conf. on Image and Video Retrieval, 2010, pp. 82–88.
    4. 4)
      • 9. Huang, D.-Y., Chia-Hung, W.: ‘Optimal multi-level thresholding using a two-stage Otsu optimization approach’, Pattern Recognit. Lett., 2009, 30, (3), pp. 275–284.
    5. 5)
      • 22. Yang, X., He, X.: ‘Firefly Algorithm: recent advances and applications’, Int. J. Swam Intell., 2013, 1, pp. 36–50.
    6. 6)
      • 7. Nguyen, C.-T., De-Chuan, Z., Zhi-Hua, Z.: ‘Multi-modal image annotation with multi-instance multi-label LDA’. Proc. of the 23th Int. Joint Conf. on Artificial Intelligence, 2013, pp. 1558–1564.
    7. 7)
      • 13. Wu, L., Hoi, S., Yu, N.: ‘Semantics-preserving bag-of-words models for efficient image annotation’. Proc. of the First ACM Workshop on Large-Scale Multimedia Retrieval and Mining, 2009, pp. 19–26.
    8. 8)
      • 4. Kharkate, K., Janwe, N.J.: ‘Automatic image annotation: a review’, Int. J. Comput. Sci. Appl., 2013, 1, (12), pp. 46–53.
    9. 9)
      • 1. Tousch, A.-M., Herbin, S., Audibert, J.-Y.: ‘Semantic hierarchies for image annotation: A survey’, Pattern Recognit., 2012, 45, (1), pp. 333–345.
    10. 10)
      • 27. Rui, S., Jin, W., Chua, T.-S.: ‘A novel approach to auto image annotation based on pairwise constrained clustering and semi-naive Bayesian model’. Proc. of the 11th Int. Conf. on Multimedia Modeling, Australia, 2005, pp. 322–327.
    11. 11)
      • 21. Raja, N., Rajinikanth, V., Latha, K.: ‘Otsu based optimal multilevel image thresholding using firefly algorithm’, J. Model. Simul. Eng., 2014, 2014, pp. 1–17.
    12. 12)
      • 19. Barrat, S., Tabbone, S.: ‘Modeling, classifying and annotating weakly annotated images using Bayesian network’, J. Vis. Commun. Image Retr., 2010, 21, (2), pp. 355–363.
    13. 13)
      • 28. Yang, C., Dong, M., Fotouhi, F.: ‘Region based image annotation through multiple-instance learning’. Proc. of the 13th Annual ACM Int. Conf. on Multimedia, 2005, pp. 435–438.
    14. 14)
      • 25. Rawat, G., Bhattacharjee, J., Soni, R.: ‘Improved technique for object detection using Similarity Based Region Merging’, Am. Int. J. Res. Sci. Technol. Eng. Math., 2013, 2, (2), pp. 165–172.
    15. 15)
      • 12. Yang, C., Dong, M., Hua, J.: ‘Region-based image annotation using asymmetrical support vector machine-based multiple-instance learning’. Proc. of the IEEE Int. Conf. in Computer Vision and Pattern Recognition, 2006, vol. 2, pp. 2057–2063.
    16. 16)
      • 3. Zhang, D., Islam, M., Lu, G.: ‘A review on automatic image annotation techniques’, Pattern Recognit., 2012, 45, (1), pp. 346–362.
    17. 17)
      • 5. Tang, J., Zha, Z.J., Tao, D., et al: ‘Semantic-gap-oriented active learning for multilabel image annotation’, IEEE Trans. Image Process., 2012, 21, (4), pp. 2354–2360.
    18. 18)
      • 20. Moghaddam, R., Cheriet, M.: ‘AdOtsu: An adaptive and parameterless generalization of Otsu's method for document image binarization’, Pattern Recognit., 2012, 45, (6), pp. 2419–2431.
    19. 19)
      • 6. Sumathi, T., Devasena, C., Revathi, R., et al: ‘Automatic image annotation and retrieval using multi-Instance multi-label learning’, Bonfring Int. J. Adv. Image Process., 2011, 1, (1), pp. 1–5.
    20. 20)
      • 14. Kang, F., Jin, R., Sukthankar, R.: ‘Correlated label propagation with application to multi-label learning’. Proc. of the IEEE Int. Conf. in Computer Vision and Pattern Recognition, 2006, vol. 2, pp. 1719–1726.
    21. 21)
      • 17. Carnerio, G., Vasconelos, N.: ‘Formulating semantic image annotation as a supervised learning problem’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, San Diego, 2005, pp. 163–168.
    22. 22)
      • 26. Duygulu, P., Barnard, K., de Freitas, J., et al: ‘Object recognition as machine translation: learning a lexicon for a fixed image vocabulary’. Proc. of the 7th European Conf. on Computer Vision, Denmark, 28–31 May 2002, vol. 4, pp. 97–112.
    23. 23)
      • 2. Sumathi, T., Devasena, C.L., Hemalatha, M.: ‘An overview of automated image annotation approaches’, Int. J. Res. Rev. Inf. Sci., 2011, 1, (1), pp. 1–6.
    24. 24)
      • 10. Cuevas, E., Humberto, S.: ‘A comparison of nature inspired algorithms for multi-threshold image segmentation’, Expert Syst. Appl., 2013, 40, (4), pp. 1213–1219.
    25. 25)
      • 11. Hassanzadeh, T., Akimeh, V., Moghadam, A.: ‘An image segmentation approach based on maximum variance intra-cluster method and firefly algorithm’. Proc. of the IEEE Seventh Int. Conf. on Natural Computation, 2011, vol. 3, pp. 1817–1821.
    26. 26)
      • 8. Bao, B.-K., Teng, L., Shuicheng, Y.: ‘Hidden-concept driven image decomposition towards semi-supervised multi-label image annotation’. Proc. of the ACM First Int. Conf. on Internet Multimedia Computing and Service, 2009, pp. 17–24.
    27. 27)
      • 16. Wang, M., Zhou, X., Chua, T.S.: ‘Automatic image annotation via local multi-label classification’. Proc. of the 2008 ACM Int. Conf. on Content-based Image and Video Retrieval, 2008, pp. 17–26.
    28. 28)
      • 24. Setia, L., Burkhardt, H.: ‘Feature selection for automatic image annotation’. Proc. of the 28th Symp. of the German Association for Pattern Recognition, Germany, 2006, pp. 294–303.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2015.0492
Loading

Related content

content/journals/10.1049/iet-ipr.2015.0492
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading