Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon openaccess Weakly supervised learning of semantic colour terms

Recognition of visual attributes in images allows an image's information content to be expressed textually. This has benefits for web search and image archiving, especially since visual attributes transcend language barriers. Classifiers are traditionally trained using manually segmented images, which are expensive and time consuming to produce. The authors propose a method which uses raw, noisy and unsegmented results of web image searches, to learn semantic colour terms. They use probabilistic graphical models on continuous domain, both for weakly supervised learning, and for segmentation of novel images. Experiments show that the authors methods give better results than the current state of the art in colour naming using noisy, weakly labelled training data.

*Note: Colour figures are available in the online version of this paper.

References

    1. 1)
    2. 2)
    3. 3)
      • 16. International Organization for Standardization: Geneva, Switzerland. Colorimetry – Part 4: CIE 1976 L*a*b* Colour space. ISO 11664-4:2008, 2008.
    4. 4)
      • 9. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ‘Imagenet: a large-scale hierarchical image database’. CVPR, 2009.
    5. 5)
      • 18. Berg, T.L., Berg, A.C., Shih, J.: ‘Automatic attribute discovery and characterization from noisy web data’. ECCV, 2010.
    6. 6)
      • 17. Larlus, D., Jurie, F.: ‘Latent mixture vocabularies for object categorization’. BMVC, September 2006.
    7. 7)
      • 11. Ferrari, V., Zisserman, A.: ‘Learning visual attributes’, Adv. Neural Inf. Process. Syst., 2008, 20, pp. 433440.
    8. 8)
      • 3. Lampert, C.H., Nickisch, H., Harmeling, S.: ‘Learning to detect unseen object classes by between-class attribute transfer’. CVPR, June 2009.
    9. 9)
      • 10. van de Weijer, J., Schmid, C., Verbeek, J., Larlus, D.: ‘Learning color names for real world applications’, IEEE Trans. Image Process., 2009, 18, (7), pp. 15121523 (doi: 10.1109/TIP.2009.2019809).
    10. 10)
      • 5. Farhadi, A., Endres, I., Hoiem, D., Forsyth, D.: ‘Describing objects by their attributes’. CVPR, June 2009.
    11. 11)
      • 15. Wang, G., Forsyth, D.: ‘Joint learning of visual attributes, object classes and visual saliency’. ICCV, 2009.
    12. 12)
      • 8. Russakovsky, O., Fei-fei, L.: ‘Attribute learning in large-scale datasets’. ECCV – Int. Workshop on Parts and Attributes, 2010.
    13. 13)
      • 4. Yu, X., Aloimonos, Y.: ‘Attribute-based transfer learning for object categorization with zero/one training example’. ECCV, 2010.
    14. 14)
      • 1. Farhadi, A., Endres, I., Hoiem, D.: ‘Attribute-centric recognition for cross-category generalization’. CVPR, 2010.
    15. 15)
      • 19. Yanai, K., Barnard, K.: ‘Image region entropy: a measure of ‘visualness’ of web images associated with one concept’. ACM Multimedia, 2005.
    16. 16)
      • 13. Hofmann, T.: ‘Unsupervised learning by probabilistic latent semantic analysis’, Mach. Lear., 2001, 42, (1–2), pp. 177196 (doi: 10.1023/A:1007617005950).
    17. 17)
      • 12. van de Weijer, J., Schmid, C., Verbeek, J.: ‘Learning color names from real-world images’. CVPR, 2007.
    18. 18)
      • 7. van DeWeijer, J., Schmid, C.: ‘Applying color names to image description’. Proc. 2007 IEEE Int. Conf. Image Processing, 2007, pp. 493496.
    19. 19)
      • 2. Wang, Y., Mori, G.: ‘A discriminative latent model of object classes and attributes’. ECCV, 2010.
    20. 20)
      • 6. Guo, Z., Wang, Z.: ‘One-shot recognition using unsupervised attribute-learning’. Proc. 2010 Fourth Pacific-Rim Symp. on Image and Video Technology, 2010.
    21. 21)
      • 14. Berlin, B., Kay, P.: ‘Basic color terms: their universality and evolution’, Anthropology, linguistics, psychology, (University of California Press, 1991).
    22. 22)
      • 20. Li, L., Ma, J.: ‘A BYY split-and-merge EM algorithm for Gaussian mixture learning’. Adv. Neural Netw. (ISNN), 2008.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2012.0210
Loading

Related content

content/journals/10.1049/iet-cvi.2012.0210
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address