http://iet.metastore.ingenta.com
1887

Joint attribute chain prediction for zero-shot learning

Joint attribute chain prediction for zero-shot learning

For access to this article, please select a purchase option:

Buy eFirst article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
— Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Zero-shot learning (ZSL) aims to classify the objects without any training samples. Attributes are used to transfer knowledge from the training set to testing one in ZSL. Most ZSL methods based on Direct Attribute Prediction (DAP) assume that attributes are independent of each other. In this study, the authors explore the relationship between attributes and propose Joint Attribute Chain Prediction (JACP). Attribute chains are introduced to represent the relations. Conditional probabilities of attributes are estimated orderly along the chain to calculate the joint posteriors of the testing classes without independence assumptions. To reduce the estimation error, attribute relation clustering algorithm is presented to group the long chain into some unrelated small chains. When the max length of chains is one, JACP is essentially identical with DAP. Experiments on three data sets for zero-shot problem demonstrate the classification accuracy and efficiency of the authors’ algorithm. The results show that mining attribute relations can greatly improve the performance of ZSL effectively.

References

    1. 1)
      • D.G. Lowe .
        1. Lowe, D.G.: ‘Distinctive image features from scale-invariant keypoints’, Int. J. Comput. Vision, 2004, 60, (2), pp. 91110.
        . Int. J. Comput. Vision , 2 , 91 - 110
    2. 2)
      • N. Dalal , B. Triggs .
        2. Dalal, N., Triggs, B.: ‘Histograms of oriented gradients for human detection’. Proc. Computer Vision and Pattern Recognition, San Diego, USA, June 2005, pp. 886893.
        . Proc. Computer Vision and Pattern Recognition , 886 - 893
    3. 3)
      • Z. Jing , L. Qiao , H. Pan .
        3. Jing, Z., Qiao, L., Pan, H., et al: ‘An overview of the configuration and manipulation of soft robotics for on-orbit servicing’, SCIENCE CHINA Inf. Sci., 2017, 60, (5), 050201.
        . SCIENCE CHINA Inf. Sci. , 5
    4. 4)
      • W. Zhang , F. Sun , H. Wu .
        4. Zhang, W., Sun, F., Wu, H., et al: ‘A framework for the fusion of visual and tactile modalities for improving robot perception’, SCIENCE CHINA Inf. Sci., 2017, 60, (1), 012201.
        . SCIENCE CHINA Inf. Sci. , 1
    5. 5)
      • C.H. Lampert , H. Nickisch , S. Harmeling .
        5. Lampert, C.H., Nickisch, H., Harmeling, S.: ‘Attribute-based classification for zero-shot visual object categorization’, IEEE Trans. Pattern Anal. Mach. Intell., 2014, 36, (3), pp. 453465.
        . IEEE Trans. Pattern Anal. Mach. Intell. , 3 , 453 - 465
    6. 6)
      • Y. Wang , G. Mori .
        6. Wang, Y., Mori, G.: ‘A discriminative latent model of object classes and attributes’. Proc. European Conf. on Computer Vision, Hersonissos, Greece, September 2010, pp. 155168.
        . Proc. European Conf. on Computer Vision , 155 - 168
    7. 7)
      • M. Liu , D. Zhang , S. Chen .
        7. Liu, M., Zhang, D., Chen, S.: ‘Attribute relation learning for zero-shot classification’, Neurocomputing, 2014, 139, pp. 3446.
        . Neurocomputing , 34 - 46
    8. 8)
      • X. Wang , Q. Ji .
        8. Wang, X., Ji, Q.: ‘A unified probabilistic approach modeling relationships between attributes and objects’. Proc. the IEEE Int. Conf. on Computer Vision, Sydney, Australia, December 2013, pp. 21202127.
        . Proc. the IEEE Int. Conf. on Computer Vision , 2120 - 2127
    9. 9)
      • W. Cheng , E. Hüllermeier , K.J. Dembczynski .
        9. Cheng, W., Hüllermeier, E., Dembczynski, K.J.: ‘Bayes optimal multilabel classification via probabilistic classifier chains’. Proc. the 27th int. Conf. on Machine Learning, Haifa, Israel, June 2010, pp. 279286.
        . Proc. the 27th int. Conf. on Machine Learning , 279 - 286
    10. 10)
      • C.H. Lampert , H. Nickisch , S. Harmeling .
        10. Lampert, C.H., Nickisch, H., Harmeling, S.: ‘Learning to detect unseen object classes by between-class attribute transfer’. Proc. Computer Vision and Pattern Recognition, Miami, USA, June 2009, pp. 951958.
        . Proc. Computer Vision and Pattern Recognition , 951 - 958
    11. 11)
      • S. Huang , M. Elhoseiny , A. Elgammal .
        11. Huang, S., Elhoseiny, M., Elgammal, A., et al: ‘Learning hypergraph-regularized attribute predictors’. Proc. Computer Vision and Pattern Recognition, Boston, USA, June 2015, pp. 409417.
        . Proc. Computer Vision and Pattern Recognition , 409 - 417
    12. 12)
      • P. Kankuekul , A. Kawewong , S. Tangruamsub .
        12. Kankuekul, P., Kawewong, A., Tangruamsub, S., et al: ‘Online incremental attribute-based zero-shot learning’. Proc. Computer Vision and Pattern Recognition, Providence, USA, June 2012, pp. 36573664.
        . Proc. Computer Vision and Pattern Recognition, Providence , 3657 - 3664
    13. 13)
      • M. Suzuki , H. Sato , S. Oyama .
        13. Suzuki, M., Sato, H., Oyama, S., et al: ‘Image classification by transfer learning based on the predictive ability of each attribute’. Proc. the Int. MultiConf. of Engineers and Computer Scientists, Hong Kong, China, March 2014, vol. 1.
        . Proc. the Int. MultiConf. of Engineers and Computer Scientists
    14. 14)
      • D. Jayaraman , K. Grauman .
        14. Jayaraman, D., Grauman, K.: ‘Zero-shot recognition with unreliable attributes’. Proc. NIPS, Montreal, Canada, December 2014, pp. 34643472.
        . Proc. NIPS , 3464 - 3472
    15. 15)
      • H. Li , D. Li , X. Luo .
        15. Li, H., Li, D., Luo, X.: ‘Bap: bimodal attribute prediction for zero-shot image categorization’. Proc. the 22nd ACM Int. Conf. on Multimedia, Orlando, USA, November 2014, pp. 10131016.
        . Proc. the 22nd ACM Int. Conf. on Multimedia , 1013 - 1016
    16. 16)
      • Z. Akata , F. Perronnin , Z. Harchaoui .
        16. Akata, Z., Perronnin, F., Harchaoui, Z., et al: ‘Label-embedding for attribute-based classification’. Proc. Computer Vision and Pattern Recognition, Portland, USA, June 2013, pp. 819826.
        . Proc. Computer Vision and Pattern Recognition , 819 - 826
    17. 17)
      • Y. Fu , T.M. Hospedales , T. Xiang .
        17. Fu, Y., Hospedales, T.M., Xiang, T., et al: ‘Transductive multi-view embedding for zero-shot recognition and annotation’. Proc. European Conf. on Computer Vision, ZÃijrich, Switzerland, September 2014, pp. 584599.
        . Proc. European Conf. on Computer Vision , 584 - 599
    18. 18)
      • Z. Fu , T. Xiang , E. Kodirov .
        18. Fu, Z., Xiang, T., Kodirov, E., et al: ‘Zero-shot object recognition by semantic manifold distance’. Proc. Computer Vision and Pattern Recognition, Boston, USA, June 2015, pp. 26352644.
        . Proc. Computer Vision and Pattern Recognition , 2635 - 2644
    19. 19)
      • Z. Zhang , V. Saligrama .
        19. Zhang, Z., Saligrama, V.: ‘Zero-shot learning via semantic similarity embedding’. Proc. Int. Conf. on Computer Vision, Santiago, Chile, December 2015, pp. 41664174.
        . Proc. Int. Conf. on Computer Vision , 4166 - 4174
    20. 20)
      • A. Frome , G.S. Corrado , J. Shlens .
        20. Frome, A., Corrado, G.S., Shlens, J., et al: ‘Devise: A deep visual-semantic embedding model’. Proc. NIPS, Lake Tahoe, USA, December 2013, pp. 21212129.
        . Proc. NIPS , 2121 - 2129
    21. 21)
      • R. Socher , M. Ganjoo , C.D. Manning .
        21. Socher, R., Ganjoo, M., Manning, C.D., et al: ‘Zero-shot learning through cross-modal transfer’. Proc. NIPS, Lake Tahoe, USA, December 2013, pp. 935943.
        . Proc. NIPS , 935 - 943
    22. 22)
      • Z. Zhang , V. Saligrama .
        22. Zhang, Z., Saligrama, V.: ‘Zero-shot learning via joint latent similarity embedding’. Proc. Computer Vision and Pattern Recognition, Las Vegas, USA, June 2016, pp. 60346042.
        . Proc. Computer Vision and Pattern Recognition , 6034 - 6042
    23. 23)
      • E. Kodirov , T. Xiang , Z. Fu .
        23. Kodirov, E., Xiang, T., Fu, Z., et al: ‘Unsupervised domain adaptation for zero-shot learning’. Proc. Int. Conf. on Computer Vision, Santiago, Chile, December 2015, pp. 24522460.
        . Proc. Int. Conf. on Computer Vision , 2452 - 2460
    24. 24)
      • Y. Fu , T.M. Hospedales , T. Xiang .
        24. Fu, Y., Hospedales, T.M., Xiang, T., et al: ‘Transudative multi-view zero-shot learning’, IEEE Trans. Pattern Anal. Mach. Intell., 2015, 37, (11), pp. 23322345.
        . IEEE Trans. Pattern Anal. Mach. Intell. , 11 , 2332 - 2345
    25. 25)
      • Z. Zhang , V. Saligrama .
        25. Zhang, Z., Saligrama, V.: ‘Zero-shot recognition via structured prediction’. Proc. European Conf. on Computer Vision, Amsterdam, The Netherlands, October 2016, pp. 533548.
        . Proc. European Conf. on Computer Vision , 533 - 548
    26. 26)
      • S. Godbole , S. Sarawagi .
        26. Godbole, S., Sarawagi, S.: ‘Discriminative methods for multi-labeled classification’, Pacific-Asia Conf. on Knowledge Discovery and Data Mining, May 2004, pp. 2230.
        . Pacific-Asia Conf. on Knowledge Discovery and Data Mining , 22 - 30
    27. 27)
      • R.E. Schapire , Y. Singer .
        27. Schapire, R.E., Singer, Y.: ‘Boostexter: a boosting-based system for text categorization’, Mach. Learn., 2000, 39, (2-3), pp. 135168.
        . Mach. Learn. , 135 - 168
    28. 28)
      • A. Elisseeff , J. Weston .
        28. Elisseeff, A., Weston, J.: ‘A kernel method for multi-labelled classification’. Proc. NIPS, Vancouver, Canada, December 2002, pp. 681687.
        . Proc. NIPS , 681 - 687
    29. 29)
      • M.L. Zhang , Z.H. Zhou .
        29. Zhang, M.L., Zhou, Z.H.: ‘ML-KNN: A lazy learning approach to multi-label learning’, Pattern Recognit., 2007, 40, (7), pp. 20382048.
        . Pattern Recognit. , 7 , 2038 - 2048
    30. 30)
      • G. Tsoumakas , I. Katakis , I. Vlahavas .
        30. Tsoumakas, G., Katakis, I., Vlahavas, I.: ‘Random k-label sets for multilabel classification’, IEEE Trans. Knowl. Data Eng., 2011, 23, (7), pp. 10791089.
        . IEEE Trans. Knowl. Data Eng. , 7 , 1079 - 1089
    31. 31)
      • J.H. Zaragoza , L.E. Sucar , E.F. Morales .
        31. Zaragoza, J.H., Sucar, L.E., Morales, E.F., et al: ‘Bayesian chain classifiers for multidimensional classification’. Proc. IJCAI, Barcelona, Spain, July 2011, vol. 11, pp. 21922197.
        . Proc. IJCAI , 2192 - 2197
    32. 32)
      • C. Bielza , G. Li , P. Larranaga .
        32. Bielza, C., Li, G., Larranaga, P.: ‘Multi-dimensional classification with Bayesian networks’, Int. J. Approx. Reason., 2011, 52, (6), pp. 705727.
        . Int. J. Approx. Reason. , 6 , 705 - 727
    33. 33)
      • K. Dembszynski , W. Waegeman , W. Cheng .
        33. Dembszynski, K., Waegeman, W., Cheng, W., et al: ‘On label dependence in multilabel classification’. ICML Workshop, Haifa, Israel, June 2010.
        . ICML Workshop
    34. 34)
      • J. Platt .
        34. Platt, J.: ‘Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods’, Advances Large Margin Classifiers, 1999, 10, (3), pp. 6174.
        . Advances Large Margin Classifiers , 3 , 61 - 74
    35. 35)
      • A. Farhadi , I. Endres , D. Hoiem .
        35. Farhadi, A., Endres, I., Hoiem, D., et al: ‘Describing objects by their attributes’. Proc. Computer Vision and Pattern Recognition, Miami, USA, June 2009, pp. 17781785.
        . Proc. Computer Vision and Pattern Recognition , 1778 - 1785
    36. 36)
      • G. Patterson , C. Xu , H. Su .
        36. Patterson, G., Xu, C., Su, H., et al: ‘The sun attribute database: beyond categories for deeper scene understanding’, Int. J. Comput. Vis., 2014, 108, (1-2), pp. 5981.
        . Int. J. Comput. Vis. , 59 - 81
    37. 37)
      • L. Qiao , H. Tuo , Z. Fang .
        37. Qiao, L., Tuo, H., Fang, Z., et al: ‘Joint probability estimation of attribute chain for zero-shot learning’. Proc. ICIP, Phoenix, USA, September 2016, pp. 18631867.
        . Proc. ICIP , 1863 - 1867
    38. 38)
      • Z. Lai , Y. Xu , Q. Chen .
        38. Lai, Z., Xu, Y., Chen, Q., et al: ‘Multilinear sparse principal component analysis’, IEEE Trans. Neural Netw. Learn. Syst., 2014, 25, (10), pp. 19421950.
        . IEEE Trans. Neural Netw. Learn. Syst. , 10 , 1942 - 1950
    39. 39)
      • Z. Lai , D. Mo , W.K. Wong .
        39. Lai, Z., Mo, D., Wong, W.K., et al: ‘Robust discriminant regression for feature extraction’, IEEE Trans. Cybern., 2017, in press.
        . IEEE Trans. Cybern.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2017.0438
Loading

Related content

content/journals/10.1049/iet-cvi.2017.0438
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address