© The Institution of Engineering and Technology
In this study, a time-varying learning algorithm (TVLA) using particle swarm optimisation (PSO) method is presented to optimise radial basis function neural networks (RBFNNs) for identification of non-linear systems. First, support vector regression (SVR) method is adopted to determine the number of hidden layer nodes, the initial parameters of the kernel and the initial weights of RBFNNs. After initialisation, an annealing robust TVLA (ARTVLA) is then applied to train the RBFNNs. In the ARTVLA, the determination of the learning rate would be an important issue for the trade-off between stability and speed of convergence. A simple and computationally efficient optimisation method, PSO, is adopted to simultaneously find a set of promising learning rates to overcome the stagnation for searching optimal solutions in training procedure of RBFNNs. The proposed SVR-based RBFNNs with ARTVLA (SVR–ARTVLA–RBFNNs) have good performance for system identification only using few hidden layer nodes. Three examples of a non-linear system, including two benchmarks and a real data set, are illustrated to show the feasibility and superiority of the proposed SVR–ARTVLA–RBFNNs for identification of non-linear systems.
References
-
-
1)
-
S.T. Hsieh ,
T.Y. Sun ,
C.L. Lin ,
C.C. Liu
.
Effective learning rate adjustment of blind source separation based on an improved particle swarm optimizer.
IEEE Trans. Evol. Comput.
,
2 ,
242 -
251
-
2)
-
V.N. Vapnik
.
(1998)
Statistical learning theory (adaptive and learning systems for signal processing, communications, and control).
-
3)
-
W.Y. Wang ,
T.T. Lee ,
C.L. Liu ,
C.H. Wang
.
Function approximation using fuzzy neural networks with robust learning algorithm.
IEEE Trans. Syst. Man B Cybern.
,
4 ,
740 -
747
-
4)
-
W. Yin ,
A.S. Mehr
.
Least square identification of alias components of linear periodically time-varying systems and optimal training signal design.
IET Signal Process.
,
2 ,
149 -
157
-
5)
-
G.N. Zahra ,
R.N. Hamid
.
Comparison of conventional artificial neural network and wavelet neural network in modeling the half-wave potential of aldehydes and ketones.
Eletrochim. Acta
,
2597 -
2605
-
6)
-
Lin, C.L., Hsieh, S.T., Sun, T.Y.: `PSO-based learning rate adjustment for blind source separation', Proc. Int. Symp. on Intelligent Signal Processing and Communication System (ISPACS 2005), December 2005, Hong Kong, p. 181–184.
-
7)
-
K.S. Narendra ,
K. Parthasarathy
.
Identification and control of dynamic systems using neural networks.
IEEE Trans. Neural Netw.
,
1 ,
4 -
27
-
8)
-
V. Vapnik
.
(1995)
The nature of statistical learning theory.
-
9)
-
Song, G.J., Zhang, J.L., Sun, Z.L.: `The research of dynamic change learning rate strategy in BP neural network and application in network intrusion detection', Proc. Third Int. Conf. on Innovative Computing Information and Control (ICICIC 2008), June 2008, Liaoning, Chian, p. 513–516.
-
10)
-
N.O. Attoh-Okine
.
Analysis of learning rate and momentum term in backpropagation neural network algorithm trained to predict pavement performance.
Adv. Eng. Softw.
,
291 -
302
-
11)
-
Li, Y., Fu, Y., Li, H., Zhang, S.W.: `The improved training algorithm of back propagation neural network with self-adaptive learning rate', Proc. Int. Conf. on Computational Intelligence and Natural Computing (CINC 2009), June 2009, Wuhan, Chian, p. 73–76.
-
12)
-
H.J. Liu ,
Z. Liu ,
W.L. Jiang ,
Y.Y. Zhou
.
Incremental learning approach based on vector neural network for emitter identification.
IET Signal Process.
,
1 ,
45 -
54
-
13)
-
A. Ratnaweera ,
S.K. Halgamuge ,
H.C. Watson
.
Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients.
IEEE Trans. Evol. Comput.
,
3 ,
240 -
255
-
14)
-
G. Apostolikas ,
S. Tzafestas
.
On-line RBFNN based identification of rapidly time-varying nonlinear systems with optimal structure-adaptation.
Math. Comput. Simul.
,
1 -
13
-
15)
-
Shi, Y., Eberhart, R.C.: `Empirical study of particle swarm optimization', Proc. Congress on Evolutionary Computation (CEC 1999), July 1999, p. 1945–1950.
-
16)
-
M.R. Manel ,
R.A. Jose Luis ,
C.V. Gustavo
.
Support vector machines for nonlinear kernel ARMA system identification.
IEEE Trans. Neural Netw.
,
6 ,
1617 -
1622
-
17)
-
Y.Y. Fu ,
C.J. Wu ,
J.T. Jeng ,
C.N. Ko
.
Identification of MIMO systems using radial basis function networks with hybrid learning algorithm.
Appl. Math. Comput.
,
184 -
196
-
18)
-
C.C. Chuang ,
J.T. Jeng ,
P.T. Lin
.
Annealing robust radial basis function networks for function approximation with outliers.
Neurocomputing
,
123 -
139
-
19)
-
Z.S. Hua ,
B. Zhang
.
A hybrid support vector machines and logistic regression approach for forecasting intermittent demand of spare parts.
Appl. Math. Comput.
,
1035 -
1048
-
20)
-
E. Elbeltagi ,
T. Hegazy ,
D. Grierson
.
Comparison among five evolutionary-based optimization algorithms.
Adv. Eng. Inf.
,
1 ,
43 -
53
-
21)
-
L. Wang ,
F. Ding ,
P.X. Liu
.
Convergence of HLS estimation algorithms for multivariable ARX-like systems.
Appl. Math. Comput.
,
1081 -
1093
-
22)
-
Y.F. Peng ,
C.M. Lin
.
Adaptive recurrent cerebellar model articulation controller for linear ultrasonic motor with optimal learning rates.
Neurocomputing
,
2626 -
2637
-
23)
-
S. Chen ,
X. Hong ,
B.L. Luk ,
C.J. Harris
.
Non-linear system identification using particle swarm optimization tuned radial basis function models.
Int. J. Bio-Inspired Comput.
,
4 ,
246 -
258
-
24)
-
W.G. Vieira ,
V.M.L. Santos ,
F.R. Carvalho ,
J.A.F.R. Pereira ,
A.M.F. Fileti
.
Identification and predictive control of a FCC unit using a MIMO neural model.
Chem. Eng. Process.
,
855 -
868
-
25)
-
A.O. Falcao ,
T. Langlois ,
A. Wichert
.
Flexible kernels for RBF networks.
Neurocomputing
,
2356 -
2359
-
26)
-
A. Azadeh ,
S.F. Ghaderi ,
M. Anvari ,
M. Saberi ,
H. Izadbakhsh
.
An integrated artificial neural network and fuzzy clustering algorithm for performance assessment of decision making units.
Appl. Math. Comput.
,
2 ,
584 -
599
-
27)
-
R. Mendes ,
J. Kennedy ,
J. Neves
.
The fully informed particle swarm: simpler, maybe better.
IEEE Trans. Evol. Comput.
,
3 ,
204 -
210
-
28)
-
H.J. Liu ,
Z. Liu ,
W.L. Jiang ,
Y.Y. Zhou
.
Approach based on combination of vector neural networks for emitter identification.
IET Signal Process.
,
2 ,
137 -
148
-
29)
-
G.E.P. Box ,
G.M. Jenkins
.
(1970)
Time series analysis, forecasting and control.
-
30)
-
Kennedy, J., Eberhart, R.: `Particle swarm optimization', Proc. IEEE Int. Conf. on Neural Networks (ICNN 1995), 1995, Perth, Australia, p. 1942–1948.
-
31)
-
C.C. Chuang ,
S.F. Su ,
C.C. Hsiao
.
Robust support vector regression networks for function approximation with outliers.
IEEE Trans. Neural Netw.
,
6 ,
1322 -
1330
-
32)
-
C.A.M. Lima ,
A.L.V. Coelho ,
F.J. Von Zuben
.
Hybridizing mixtures of experts with support vector machines: investigation into nonlinear dynamic systems identification.
Inf. Sci.
,
2049 -
2074
-
33)
-
A. Nied ,
S.I. Seleme ,
G.G. Parma ,
B.R. Menezes
.
On-line neural training algorithm with sliding mode control and adaptive learning rate.
Neurocomputing
,
2687 -
2691
-
34)
-
C.C. Chuang ,
S.F. Su ,
C.C. Hsiao
.
The annealing robust backpropagation (BP) learning algorithm.
IEEE Trans. Neural Netw.
,
5 ,
1067 -
1077
-
35)
-
K.H. Chan ,
J. Bao ,
W.J. Whiten
.
Identification of MIMO Hammerstein systems using cardinal spline functions.
J. Process Control
,
7 ,
659 -
670
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-spr.2011.0025
Related content
content/journals/10.1049/iet-spr.2011.0025
pub_keyword,iet_inspecKeyword,pub_concept
6
6