Identification of non-linear systems using radial basis function neural networks with time-varying learning algorithm

Author(s): C.-N. Ko
DOI: 10.1049/iet-spr.2011.0025

For access to this article, please select a purchase option:

Buy article PDF

Buy Knowledge Pack

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership

Recommend Title Publication to library

IET Signal Processing — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Author(s): C.-N. Ko ¹
- Affiliations: 1: Department of Automation Engineering, Nan Kai University of Technology, Tsaotun, Taiwan
Source: Volume 6, Issue 2, April 2012, p. 91 – 98
DOI: 10.1049/iet-spr.2011.0025 , Print ISSN 1751-9675, Online ISSN 1751-9683

In this study, a time-varying learning algorithm (TVLA) using particle swarm optimisation (PSO) method is presented to optimise radial basis function neural networks (RBFNNs) for identification of non-linear systems. First, support vector regression (SVR) method is adopted to determine the number of hidden layer nodes, the initial parameters of the kernel and the initial weights of RBFNNs. After initialisation, an annealing robust TVLA (ARTVLA) is then applied to train the RBFNNs. In the ARTVLA, the determination of the learning rate would be an important issue for the trade-off between stability and speed of convergence. A simple and computationally efficient optimisation method, PSO, is adopted to simultaneously find a set of promising learning rates to overcome the stagnation for searching optimal solutions in training procedure of RBFNNs. The proposed SVR-based RBFNNs with ARTVLA (SVR–ARTVLA–RBFNNs) have good performance for system identification only using few hidden layer nodes. Three examples of a non-linear system, including two benchmarks and a real data set, are illustrated to show the feasibility and superiority of the proposed SVR–ARTVLA–RBFNNs for identification of non-linear systems.

References

1. 1)
  - S.T. Hsieh , T.Y. Sun , C.L. Lin , C.C. Liu . Effective learning rate adjustment of blind source separation based on an improved particle swarm optimizer. IEEE Trans. Evol. Comput. , 2 , 242 - 251
2. 2)
  - V.N. Vapnik . (1998) Statistical learning theory (adaptive and learning systems for signal processing, communications, and control).
3. 3)
  - W.Y. Wang , T.T. Lee , C.L. Liu , C.H. Wang . Function approximation using fuzzy neural networks with robust learning algorithm. IEEE Trans. Syst. Man B Cybern. , 4 , 740 - 747
4. 4)
  - W. Yin , A.S. Mehr . Least square identification of alias components of linear periodically time-varying systems and optimal training signal design. IET Signal Process. , 2 , 149 - 157
5. 5)
  - G.N. Zahra , R.N. Hamid . Comparison of conventional artificial neural network and wavelet neural network in modeling the half-wave potential of aldehydes and ketones. Eletrochim. Acta , 2597 - 2605
6. 6)
  - Lin, C.L., Hsieh, S.T., Sun, T.Y.: `PSO-based learning rate adjustment for blind source separation', Proc. Int. Symp. on Intelligent Signal Processing and Communication System (ISPACS 2005), December 2005, Hong Kong, p. 181–184.
7. 7)
  - K.S. Narendra , K. Parthasarathy . Identification and control of dynamic systems using neural networks. IEEE Trans. Neural Netw. , 1 , 4 - 27
8. 8)
  - V. Vapnik . (1995) The nature of statistical learning theory.
9. 9)
  - Song, G.J., Zhang, J.L., Sun, Z.L.: `The research of dynamic change learning rate strategy in BP neural network and application in network intrusion detection', Proc. Third Int. Conf. on Innovative Computing Information and Control (ICICIC 2008), June 2008, Liaoning, Chian, p. 513–516.
10. 10)
  - N.O. Attoh-Okine . Analysis of learning rate and momentum term in backpropagation neural network algorithm trained to predict pavement performance. Adv. Eng. Softw. , 291 - 302
11. 11)
  - Li, Y., Fu, Y., Li, H., Zhang, S.W.: `The improved training algorithm of back propagation neural network with self-adaptive learning rate', Proc. Int. Conf. on Computational Intelligence and Natural Computing (CINC 2009), June 2009, Wuhan, Chian, p. 73–76.
12. 12)
  - H.J. Liu , Z. Liu , W.L. Jiang , Y.Y. Zhou . Incremental learning approach based on vector neural network for emitter identification. IET Signal Process. , 1 , 45 - 54
13. 13)
  - A. Ratnaweera , S.K. Halgamuge , H.C. Watson . Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans. Evol. Comput. , 3 , 240 - 255
14. 14)
  - G. Apostolikas , S. Tzafestas . On-line RBFNN based identification of rapidly time-varying nonlinear systems with optimal structure-adaptation. Math. Comput. Simul. , 1 - 13
15. 15)
  - Shi, Y., Eberhart, R.C.: `Empirical study of particle swarm optimization', Proc. Congress on Evolutionary Computation (CEC 1999), July 1999, p. 1945–1950.
16. 16)
  - M.R. Manel , R.A. Jose Luis , C.V. Gustavo . Support vector machines for nonlinear kernel ARMA system identification. IEEE Trans. Neural Netw. , 6 , 1617 - 1622
17. 17)
  - Y.Y. Fu , C.J. Wu , J.T. Jeng , C.N. Ko . Identification of MIMO systems using radial basis function networks with hybrid learning algorithm. Appl. Math. Comput. , 184 - 196
18. 18)
  - C.C. Chuang , J.T. Jeng , P.T. Lin . Annealing robust radial basis function networks for function approximation with outliers. Neurocomputing , 123 - 139
19. 19)
  - Z.S. Hua , B. Zhang . A hybrid support vector machines and logistic regression approach for forecasting intermittent demand of spare parts. Appl. Math. Comput. , 1035 - 1048
20. 20)
  - E. Elbeltagi , T. Hegazy , D. Grierson . Comparison among five evolutionary-based optimization algorithms. Adv. Eng. Inf. , 1 , 43 - 53
21. 21)
  - L. Wang , F. Ding , P.X. Liu . Convergence of HLS estimation algorithms for multivariable ARX-like systems. Appl. Math. Comput. , 1081 - 1093
22. 22)
  - Y.F. Peng , C.M. Lin . Adaptive recurrent cerebellar model articulation controller for linear ultrasonic motor with optimal learning rates. Neurocomputing , 2626 - 2637
23. 23)
  - S. Chen , X. Hong , B.L. Luk , C.J. Harris . Non-linear system identification using particle swarm optimization tuned radial basis function models. Int. J. Bio-Inspired Comput. , 4 , 246 - 258
24. 24)
  - W.G. Vieira , V.M.L. Santos , F.R. Carvalho , J.A.F.R. Pereira , A.M.F. Fileti . Identification and predictive control of a FCC unit using a MIMO neural model. Chem. Eng. Process. , 855 - 868
25. 25)
  - A.O. Falcao , T. Langlois , A. Wichert . Flexible kernels for RBF networks. Neurocomputing , 2356 - 2359
26. 26)
  - A. Azadeh , S.F. Ghaderi , M. Anvari , M. Saberi , H. Izadbakhsh . An integrated artificial neural network and fuzzy clustering algorithm for performance assessment of decision making units. Appl. Math. Comput. , 2 , 584 - 599
27. 27)
  - R. Mendes , J. Kennedy , J. Neves . The fully informed particle swarm: simpler, maybe better. IEEE Trans. Evol. Comput. , 3 , 204 - 210
28. 28)
  - H.J. Liu , Z. Liu , W.L. Jiang , Y.Y. Zhou . Approach based on combination of vector neural networks for emitter identification. IET Signal Process. , 2 , 137 - 148
29. 29)
  - G.E.P. Box , G.M. Jenkins . (1970) Time series analysis, forecasting and control.
30. 30)
  - Kennedy, J., Eberhart, R.: `Particle swarm optimization', Proc. IEEE Int. Conf. on Neural Networks (ICNN 1995), 1995, Perth, Australia, p. 1942–1948.
31. 31)
  - C.C. Chuang , S.F. Su , C.C. Hsiao . Robust support vector regression networks for function approximation with outliers. IEEE Trans. Neural Netw. , 6 , 1322 - 1330
32. 32)
  - C.A.M. Lima , A.L.V. Coelho , F.J. Von Zuben . Hybridizing mixtures of experts with support vector machines: investigation into nonlinear dynamic systems identification. Inf. Sci. , 2049 - 2074
33. 33)
  - A. Nied , S.I. Seleme , G.G. Parma , B.R. Menezes . On-line neural training algorithm with sliding mode control and adaptive learning rate. Neurocomputing , 2687 - 2691
34. 34)
  - C.C. Chuang , S.F. Su , C.C. Hsiao . The annealing robust backpropagation (BP) learning algorithm. IEEE Trans. Neural Netw. , 5 , 1067 - 1077
35. 35)
  - K.H. Chan , J. Bao , W.J. Whiten . Identification of MIMO Hammerstein systems using cardinal spline functions. J. Process Control , 7 , 659 - 670

Identification of non-linear systems using radial basis function neural networks with time-varying learning algorithm

Identification of non-linear systems using radial basis function neural networks with time-varying learning algorithm

Buy article PDF

Buy Knowledge Pack

Thank you

References

Related content