access icon free Supervised locally linear embedding algorithm based on orthogonal matching pursuit

Supervised locally linear embedding (SLLE) has been proposed for classification tasks. SLLE can take full use of the label information and select neighbours only in the same class. However, SLLE uses the least squares (LSs) method for solving a set of linear equations to obtain linear representation coefficients, which relates to the inverse of a matrix. If the matrix is singular, the solution to the set of linear equations does not exist. Additionally, if the size of neighbourhood is not appropriate, some further neighbours along the manifold would be selected. To remedy those, this study deals with SLLE based on orthogonal matching pursuit (SLLE-OMP) by introducing OMP into SLLE. In SLLE-OMP, LS is replaced by OMP and OMP can reselect new neighbours from old ones. Experimental results on some real-world datasets show that SLLE-OMP can achieve better classification performance compared with SLLE.

Inspec keywords: image reconstruction; learning (artificial intelligence); image classification; matrix algebra

Other keywords: supervised locally linear embedding algorithm; orthogonal matching pursuit; SLLE based on orthogonal matching pursuit; linear equations; classification tasks; linear representation coefficients; SLLE-OMP

Subjects: Image recognition; Algebra; Computer vision and image processing techniques; Knowledge engineering techniques; Algebra

References

    1. 1)
    2. 2)
      • 22. Bache, K., Lichman, M.: ‘UCI machine learning repository’. Available at http://www.archive.ics.uci.edu/ml, accessed January 2013.
    3. 3)
    4. 4)
    5. 5)
    6. 6)
      • 25. Samaria, F.S., Harter, A.: ‘Parameterisation of a stochastic model for human face identification’. Proc. of the Second IEEE Workshop on Applications of Computer Vision, 1994, pp. 138142. Available at http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html, accessed April 2012.
    7. 7)
      • 21. de Ridder, D., Duin, R.: ‘Locally linear embedding for classification’. Available at http://www.researchgate.net/publication/2924034, accessed July 2013.
    8. 8)
    9. 9)
      • 26. Lee, K.C., Ho, J., Kriegman, D.: ‘Nine points of lights: acquiring subspaces for face recognition under variable lighting’. Proc. of IEEE Conf. on Computer Vision and Pattern Recognition Machine Learning (CVPR'07). Available at http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html, accessed April 2012.
    10. 10)
    11. 11)
    12. 12)
    13. 13)
      • 10. Kong, D., Ding, C., Huang, H., Nie, F.: ‘An iterative locally linear embedding algorithm’. Proc. of the 29th Int. Conf. on Machine Learning (ICML 2012), 2012.
    14. 14)
      • 20. Kouropteva, O., Okun, O., Hadid, A., Soriano, M., Pietikäinen, M.: ‘Beyond locally linear embedding algorithm’. Technical Report, MVG-01-2002, Machine Vision Group, University of Oulu, Finland, 2002.
    15. 15)
    16. 16)
      • 6. de Ridder, D., Kouropteva, O., Okun, O., Pietikäinen, M., Duin, R.: ‘Supervised locally linear embedding’, Artif. Neural Netw. Neural Inf. Process., 2003, 2714, pp. 333341.
    17. 17)
    18. 18)
      • 23. Yann, L.: ‘The MNIST database of handwritten digits’. [Online]. Available at http://www.yann.lecun.com/exdb/mnist/, accessed June 2002.
    19. 19)
    20. 20)
      • 8. Saul, L., Roweis, S.: ‘Think globally, fit locally: unsupervised learning of nonlinear manifolds’, J. Mach. Learn. Res., 2003, 4, pp. 119155.
    21. 21)
    22. 22)
    23. 23)
      • 27. Weber, M.: The Caltech-Leaves database. Available at http://www.vision.caltech.edu/html-files/archive.html, accessed October 2012..
    24. 24)
    25. 25)
      • 9. de Ridder, D., Loog, M., Reinders, M.: ‘Local fisher embedding’. Proc. of the 17th Int. Conf. on Pattern Recognition, August 2004, vol. 2, pp. 295298.
    26. 26)
    27. 27)
      • 15. Pati, Y.C., Rezaiifar, R., Krishnaprasad, P.S.: ‘Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition’. Proc. on Record of the 27th Asilomar Conf.: Signal, Systems and Computers, 1993, vol. 1, pp. 4044.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2014.0841
Loading

Related content

content/journals/10.1049/iet-ipr.2014.0841
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading