access icon free Orthogonality-based label correction in multi-class classification

Orthogonality-based label coding is an often-used technique in multi-class classification. Through coding the labels into some multi-dimensional orthogonal codewords, many binary classifiers can be naturally extended to multi-class cases. For an unseen sample, the classifiers firstly estimate its codeword and then compute the corresponding distances from the labels. Finally, the nearest one is assigned as its class label. However, these classifiers actually hardly guarantee that the estimated codewords still maintain the inter-orthogonality with the other classes, which more likely causes the codewords in different classes overlapping each other to some extent and thus affects the classification performance. Proposed is a novel label correction strategy which aims to keep as much as possible orthogonality between the estimated sample codewords and the other classes’ labels in order to preserve further as much as possible the inter-orthogonality of the codewords. The strategy is combined with two state-of-the-art classifiers: regularised least square classifier and the least square support vector machine. Experiments on UCI datasets demonstrate the effectiveness of the method.

Inspec keywords: support vector machines; pattern classification; orthogonal codes

Other keywords: multiclass classification; UCI datasets; regularised least square classifier; least square support vector machine; multiclass cases; multidimensional orthogonal codewords; inter-orthogonality; label correction strategy; classification performance; orthogonality-based label correction; multi-class classification; orthogonality-based label coding; binary classifiers

Subjects: Data handling techniques; Knowledge engineering techniques

References

    1. 1)
      • 4. Haykin, S.: ‘Neural networks: A comprehensive foundation.’ (Tsinghua University Press, 2001).
    2. 2)
      • 3. Quinlan, J.R.: ‘C4.5: Programs for machine learning’ (Morgan Kaufmann, 1993).
    3. 3)
      • 5. Suykens, J.A.K., Vandewalle, J.: ‘Least squares support vector machine classifiers’. Neural Process. Lett., 1999, 9, pp. 293300 (doi: 10.1023/A:1018628609742).
    4. 4)
      • 2. Aly, M.: ‘Survey on multiclass classification methods, Tech. Rep.’, California Institute of Technology, 2005.
    5. 5)
      • 1. Wang, Y., Chen, S., Xue, H.: ‘Can under-exploited structure of original-classes help ECOC-based multi-class classification?Neurocomputing, 2012, 89, pp. 158167 (doi: 10.1016/j.neucom.2012.02.035).
    6. 6)
      • 6. Suykens, J.A.K., Vandewalle, J.: ‘Multiclass least squares support vector machines’. Proc. of Int. Joint Conf. on Neural Networks, Washington, OC, USA, July 1999.
http://iet.metastore.ingenta.com/content/journals/10.1049/el.2012.4408
Loading

Related content

content/journals/10.1049/el.2012.4408
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading