Robust kernel-based learning for image-related problems
Robust kernel-based learning for image-related problems
- Author(s): C.-T. Liao and S.-H. Lai
- DOI: 10.1049/iet-ipr.2010.0301
For access to this article, please select a purchase option:
Buy article PDF
Buy Knowledge Pack
IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.
Thank you
Your recommendation has been sent to your librarian.
- Author(s): C.-T. Liao 1 and S.-H. Lai 1
-
-
View affiliations
-
Affiliations:
1: Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan
-
Affiliations:
1: Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan
- Source:
Volume 6, Issue 6,
August 2012,
p.
795 – 803
DOI: 10.1049/iet-ipr.2010.0301 , Print ISSN 1751-9659, Online ISSN 1751-9667
Robustness is one of the most critical issues in the appearance-based learning techniques. This study develops a novel robust kernel for kernel machines, and consequently improves their robustness in resisting noise for solving the image-related learning problems. By incorporating a robust ρ-function to reduce the influence of outlier components, this kernel gives more reasonable kernel values when images are seriously corrupted. The authors incorporate the proposed kernel into different kernel-based approaches, such as support vector machine (SVM) and kernel Fisher discriminant (KFD) analysis, to validate its performance on various visual learning problems of face recognition and data visualisation. Experimental results indicate that the proposed kernel can provide the superior robustness to the classical approaches.
Inspec keywords: support vector machines; data visualisation; face recognition; learning (artificial intelligence)
Other keywords:
Subjects: Image recognition; Knowledge engineering techniques; Computer vision and image processing techniques; Graphics techniques
References
-
-
1)
- M. Debruyne , T. Verdonck . Robust kernel principal component analysis and classification. Adv. Data Anal. Classif. , 151 - 167
-
2)
- Y. LeCun , B. Boser , J.S. Denker , R.E. Howard , W. Habbard , L.D. Jackel , D. Henderson . (1992) United States postal service database.
-
3)
- Mika, S., Rätsch, G., Weston, J., Schölkopf, B., Müller, K.: `Fisher discriminant analysis with kernels', Proc. IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing, 1999, Madison, USA, p. 41–48.
-
4)
- F.R. Hampel , E.M. Ronchetti , P.J. Rousseeuw , W.A. Stahel . (1986) Robust statistics: the approach based on influence functions.
-
5)
- D.P. Huttenlocher , G.A. Klanderman , W.J. Rucklidge . Comparing images using the Hausdorff distance. IEEE Trans. Pattern Anal. Mach. Intell. , 9 , 850 - 863
-
6)
- M. Debruyne , M. Hubert , J. Van Horebeek . Detecting influential observations in kernel PCA. Comput. Stat. Data Anal. , 3007 - 3019
-
7)
- V. Barnett , T. Lewis . (1994) Outliers in statistical data.
-
8)
- Ridder, D., Kouropteva, O., Okun, O., Pietikainen, M., Duin, R.P.W.: `Supervised locally linear embedding', Proc. Int. Conf. Artificial Neural Networks and Neural Information Processing, 2003, Istanbul, Turkey, p. 333–341.
-
9)
- A.S. Georghiades , P.N. Belhumeur , D.J. Kriegman . From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. , 6 , 643 - 660
-
10)
- A. Christmann , I. Steinwart . On robust properties of convex risk minimization methods for pattern recognition. J. Mach. Learn. Res. , 1007 - 1034
-
11)
- Liao, C.T., Lai, S.-H.: `A robust kernel based on robust ρ-function', Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2007, Hawaii, USA, p. 421–424.
-
12)
- P. Anandan . A computational framework and an algorithm for the measurement of visual motion. Int. J. Comput. Vis. , 283 - 310
-
13)
- Minka, T.: ‘The lightspeed Matlab toolbox’ (Microsoft Corporation, 2011). http://research.microsoft.com/en-us/um/people/minka/software/lightspeed/.
-
14)
- Lanckriet, G., Cristianini, N., Bartlett, P., Ghaoui, L., Jordan, M.: `Learning the kernel matrix with semi-definite programming', Proc. Int. Conf. Machine Learning, 2002, Sydney, Australia, p. 323–330.
-
15)
- I. Borg , P. Groenen . (1997) Modern multidimensional scaling.
-
16)
- S. Geman , D.E. McClure . Statistical methods for tomographic image reconstruction. Bull. Int. Stat. Inst. , 5 - 21
-
17)
- J.A.K. Suykens , J. De Brabanter , L. Lukas , J. Vandewalle . Weighted least squares support vector machines: robustness and sparse approximation. Neurocomputing , 85 - 105
-
18)
- B. Scholkopf , A. Smola , K.R. Muller . Nonlinear component analysis as a kernel eigvalue problem. Neural Comput. , 1299 - 1319
-
19)
- Lu, C., Zhang, T., Zhang, R., Zhang, C.: `Adaptive robust kernel PCA algorithm', Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2003, Hong Kong, p. 621–624.
-
20)
- N. Cristianini , J. Shawe-Taylor . (2000) An Introduction to support vector machines and other kernel-based learning algorithms.
-
21)
- S.T. Roweis , L.K. Saul . Nonlinear dimensionality reduction by locally linear embedding. Science. , 5500 , 2323 - 2326
-
22)
- Q. Song , W. Hu , W. Xie . Robust support vector machine with bullet hole image classification. IEEE Trans. Syst. Man Cybern. , 4 , 440 - 448
-
23)
- C. Cortes , V. Vapnik . Support vector networks. Mach. Learn. , 1 , 273 - 297
-
24)
- Barla, A., Odone, F., Verri, A.: `Image kernels', Proc. Int. Conf. Pattern Recognition, 2002, Quebec, Canada, p. 83–96.
-
25)
- P.J. Rousseeuw . (1987) Robust regression and outlier detection.
-
26)
- Wallhof, F.: ‘FGnet – Facial expression and emotion database’ (Technische Universität München, 2004). http://www.mmk.ei.tum.de/~waf/fgnet/feedtum.html.
-
27)
- J. Segman , J. Rubinstein , Y.Y. Zeevi . The canonical coordinates method for pattern deformation: theoretical and computational considerations. IEEE Trans. Pattern Anal. Mach. Intell. , 12 , 1171 - 1183
-
28)
- Chen, J.H.: `M-estimator based robust kernels for support vector machines', Proc. IEEE Int. Conf. Pattern Recognition, 2004, Cambridge, UK, p. 168–171.
-
29)
- B. Chen , H. Liu , B. Zheng . Optimizing the data-dependent kernel under a unified kernel optimization framework. Pattern Recognit. , 6 , 2107 - 2119
-
30)
- M. Debruyne , M. Hubert , J.A.K. Suykens . Model selection in kernel based regression using the influence function. J. Mach. Learn. Res. , 2377 - 2400
-
31)
- A. Christmann , I. Steinwart . Consistency and robustness of kernel based regression. Bernoulli , 799 - 819
-
32)
- B. Schlkopf , A.J. Smola . (2002) Learning with kernels: support vector machines, regularization, optimization, and beyond.
-
33)
- C. Alzate , J.A.K. Suykens . Kernel component analysis using an epsilon insensitive robust loss function. IEEE Trans. Neural Netw. , 9 , 1583 - 1598
-
34)
- N. Cristianini , J. Kandola , A. Elisseeff , J. Shawe-Taylor . On kernel target alignment. Adv. Neural Inf. Process. Syst. , 367 - 373
-
35)
- C.W. Hsu , C.J. Lin . A comparison of methods for multi-class SVMs. IEEE Trans. Neural Netw. , 2 , 415 - 425
-
36)
- M.H. Nguyen , F.D. Frade . Robust kernel principal component analysis. Adv. Neural Inf. Process. Syst. , 1185 - 1192
-
37)
- M. Debruyne , S. Serneels , T. Verdonck . Robustified least squares support vector classification. J. Chemometr. , 9 , 479 - 486
-
38)
- W. Du , K. Inoue , K. Urahama . Robust kernel fuzzy clustering. Fuzzy Syst. Knowl. Discov. , 454 - 461
-
1)