Bias compensation-based recursive least-squares estimation with forgetting factors for output error moving average systems
- Author(s): Ai-Guo Wu 1 ; Yang-Yang Qian 1 ; Wei-Jun Wu 2
-
-
View affiliations
-
Affiliations:
1:
Shenzhen Graduate School, Harbin Institute of Technology, University Town of Shenzhen, Shenzhen 518055, People's Republic of China;
2: Science and Technology on Electromagnetic Compatibility Laboratory, China Ship Development and Design Center, Wuhan 430064, People's Republic of China
-
Affiliations:
1:
Shenzhen Graduate School, Harbin Institute of Technology, University Town of Shenzhen, Shenzhen 518055, People's Republic of China;
- Source:
Volume 8, Issue 5,
July 2014,
p.
483 – 494
DOI: 10.1049/iet-spr.2013.0327 , Print ISSN 1751-9675, Online ISSN 1751-9683
The bias compensation technique combined with the least-squares estimation algorithm with forgetting factors is applied to the parameter estimation of output error models with moving average noise. It is shown that the bias term induced by the noise is determined by the weighted average variance of the white noise and the parameters of the unknown noise model. Therefore, in order to give a recursive estimation of the bias term, an interactive estimation of the weighted average variance and noise parameters is constructed by using the principle of hierarchical identification. In addition, a recursive form is also established to estimate the so-called weighted average variance of the white noise. The estimation algorithm is finally established by combining the interactive estimation and the recursive estimation of weighted average variance. A simulation example is employed to show the effectiveness of the proposed bias compensation based least-squares estimation algorithm with two forgetting factors.
Inspec keywords: white noise; recursive estimation; compensation; least squares approximations; signal processing; autoregressive moving average processes
Other keywords: interactive estimation; parameter estimation; bias compensation-based recursive least-squares estimation algorithm; output error moving average systems; output error models; white noise; weighted average variance; hierarchical identification
Subjects: Other topics in statistics; Signal processing and detection; Other topics in statistics; Signal processing theory; Interpolation and function approximation (numerical analysis); Interpolation and function approximation (numerical analysis)
References
-
-
1)
-
9. Stoica, P., So˝derstro˝m, T.: ‘Bias correction in least-squares identification’, Int. J. Control, 1982, 35, (3), pp. 449–457 (doi: 10.1080/00207178208922631).
-
-
2)
- W.X. Zheng . Fast identification of autoregressive signals from noisy observations. IEEE Trans. Circuits Syst.-II: Express Briefs , 43 - 48
-
3)
-
16. Jia, L.J., Tao, R.: ‘A unified framework for bias compensation based methods in correlated noise case’, IEEE Trans. Autom. Control, 2011, 56, (3), pp. 625–629 (doi: 10.1109/TAC.2010.2093250).
-
-
4)
- F. Ding , T. Chen . Hierarchical gradient-based identification of multivariable discrete-time systems. Automatica , 2 , 315 - 325
-
5)
-
4. Sagara, S., Wada, K.: ‘On-line modified least-squares parameter estimation on linear discrete dynamic systems’, Int. J. Control, 1977, 25, (3), pp. 329–343 (doi: 10.1080/00207177708922235).
-
-
6)
- J. Ding , F. Ding . Bias compensation based parameter estimation for output error moving average systems. Int. J. Adapt. Control Signal Process. , 12 , 1100 - 1111
-
7)
-
3. Wang, D., Ding, F., Chu, Y.: ‘Data filtering based recursive least squares algorithm for Hammerstein systems using the key-term separation principle’, Inf. Sci., 2013, 222, (10), pp. 203–212 (doi: 10.1016/j.ins.2012.07.064).
-
-
8)
-
18. Zheng, W.X.: ‘Parameter estimation of stochastic linear systems with noisy input’, Int. J. Syst. Sci., 2004, 35, (3), pp. 185–190 (doi: 10.1080/00207720410001691109).
-
-
9)
-
13. Feng, C.B., Zheng, W.X.: ‘Robust identification of stochastic linear systems with correlated noise’, IEE Proc., D, 1991, 138, (5), pp. 484–492 (doi: 10.1049/ip-d.1991.0067).
-
-
10)
-
5. Ding, F., Chen, T., Qiu, L.: ‘Bias compensation based recursive least squares identification algorithm for MISO system’, IEEE Trans. Circuits Syst., 2006, 53, (5), pp. 349–353 (doi: 10.1109/TCSII.2005.862281).
-
-
11)
-
1. Wang, D., Chu, Y., Ding, F.: ‘Auxiliary model-based RELS and MIELS algorithm for Hammerstein OEMA systems’, Comput. Math. Appl., 2010, 59, (9), pp. 3092–3098 (doi: 10.1016/j.camwa.2010.02.030).
-
-
12)
- Y. Zhang , G.M. Cui . Bias compensation methods for stochastic systems with colored noise. Appl. Math. Model. , 4 , 1709 - 1716
-
13)
-
12. Zhang, Y.: ‘Unbiased identification of a class of multi-input single-output systems with correlated disturbances using bias compensation methods’, Math. Comput. Model., 2011, 53, pp. 1810–1819 (doi: 10.1016/j.mcm.2010.12.059).
-
-
14)
-
10. Zheng, W.X.: ‘On a least squares based algorithm for identification of stochastic linear systems’, IEEE Trans. Signal Process., 1998, 46, (6), pp. 1631–1638 (doi: 10.1109/78.678479).
-
-
15)
-
2. Wang, D., Chu, Y., Yang, G., Ding, F.: ‘Auxiliary model based recursive generalized least squares parameter estimation for Hammerstein OEAR systems’, Math. Comput. Model., 2010, 52, (1–2), pp. 309–317 (doi: 10.1016/j.mcm.2010.03.002).
-
-
16)
-
8. Wang, D.Q., Ding, F.: ‘Hierarchical least squares estimation algorithm for Hammerstein–Wiener systems’, IEEE Signal Process. Lett., 2012, 19, (12), pp. 825–828 (doi: 10.1109/LSP.2012.2221704).
-
-
17)
-
10. Zheng, W.X.: ‘On a least squares based algorithm for identification of stochastic linear systems’, IEEE Trans. Signal Process., 1998, 46, (6), pp. 1631–1638 (doi: 10.1109/78.678479).
-
-
18)
-
8. Wang, D.Q., Ding, F.: ‘Hierarchical least squares estimation algorithm for Hammerstein–Wiener systems’, IEEE Signal Process. Lett., 2012, 19, (12), pp. 825–828 (doi: 10.1109/LSP.2012.2221704).
-
-
19)
-
7. Ding, F., Chen, T.: ‘Hierarchical gradient-based identification of multivariable discrete-time systems’, Automatica, 2005, 41, pp. 315–325 (doi: 10.1016/j.automatica.2004.10.010).
-
-
20)
-
15. Zhang, Y., Tie, T.T., Soh, C.B.: ‘Consistent parameter estimation of systems disturbed by correlated noise’, IEE Proc., Control Theory Appl., 1997, 144, (1), pp. 40–44.
-
-
21)
-
1. Wang, D., Chu, Y., Ding, F.: ‘Auxiliary model-based RELS and MIELS algorithm for Hammerstein OEMA systems’, Comput. Math. Appl., 2010, 59, (9), pp. 3092–3098 (doi: 10.1016/j.camwa.2010.02.030).
-
-
22)
-
11. Zhang, Y., Yang, H.Z.: ‘Bias compensation recursive least squares identification for output error systems with colored noises (In Chinese)’, Acta Autom. Sin., 2007, 33, (10), pp. 1053–1060.
-
-
23)
-
12. Zhang, Y.: ‘Unbiased identification of a class of multi-input single-output systems with correlated disturbances using bias compensation methods’, Math. Comput. Model., 2011, 53, pp. 1810–1819 (doi: 10.1016/j.mcm.2010.12.059).
-
-
24)
-
13. Feng, C.B., Zheng, W.X.: ‘Robust identification of stochastic linear systems with correlated noise’, IEE Proc., D, 1991, 138, (5), pp. 484–492 (doi: 10.1049/ip-d.1991.0067).
-
-
25)
-
9. Stoica, P., So˝derstro˝m, T.: ‘Bias correction in least-squares identification’, Int. J. Control, 1982, 35, (3), pp. 449–457 (doi: 10.1080/00207178208922631).
-
-
26)
-
5. Ding, F., Chen, T., Qiu, L.: ‘Bias compensation based recursive least squares identification algorithm for MISO system’, IEEE Trans. Circuits Syst., 2006, 53, (5), pp. 349–353 (doi: 10.1109/TCSII.2005.862281).
-
-
27)
-
4. Sagara, S., Wada, K.: ‘On-line modified least-squares parameter estimation on linear discrete dynamic systems’, Int. J. Control, 1977, 25, (3), pp. 329–343 (doi: 10.1080/00207177708922235).
-
-
28)
-
20. Ljung, L.: ‘System identification: theory for the user’ (Prentice-Hall Press, 1998, 2nd edn.).
-
-
29)
-
2. Wang, D., Chu, Y., Yang, G., Ding, F.: ‘Auxiliary model based recursive generalized least squares parameter estimation for Hammerstein OEAR systems’, Math. Comput. Model., 2010, 52, (1–2), pp. 309–317 (doi: 10.1016/j.mcm.2010.03.002).
-
-
30)
-
17. Zhang, Y., Cui, G.: ‘Bias compensation methods for stochastic systems with colored noise’, Appl. Math. Model., 2011, 35, pp. 1709–1716 (doi: 10.1016/j.apm.2010.10.003).
-
-
31)
-
21. Wu, A.G., Chen, S., Jia, D.L.: ‘Bias compensation recursive least squares estimate algorithm with forgetting factor for output error model (in Chinese)’. Chinese Control Conf., Xi'an, China, July 2013, pp. 1717–1722.
-
-
32)
-
14. Yang, H.Z., Zhang, Y.: ‘Comparisons of bias compensation methods and other identification approaches for Box-Jenkins models’, Control Theory Appl., 2007, 24, (2), pp. 215–222.
-
-
33)
-
6. Ding, J., Ding, F.: ‘Bias compensation-biased parameter estimation for output error moving average systems’, Int. J. Adapt. Control Signal Process., 2011, 25, pp. 1100–1111 (doi: 10.1002/acs.1266).
-
-
34)
-
3. Wang, D., Ding, F., Chu, Y.: ‘Data filtering based recursive least squares algorithm for Hammerstein systems using the key-term separation principle’, Inf. Sci., 2013, 222, (10), pp. 203–212 (doi: 10.1016/j.ins.2012.07.064).
-
-
35)
-
18. Zheng, W.X.: ‘Parameter estimation of stochastic linear systems with noisy input’, Int. J. Syst. Sci., 2004, 35, (3), pp. 185–190 (doi: 10.1080/00207720410001691109).
-
-
36)
-
16. Jia, L.J., Tao, R.: ‘A unified framework for bias compensation based methods in correlated noise case’, IEEE Trans. Autom. Control, 2011, 56, (3), pp. 625–629 (doi: 10.1109/TAC.2010.2093250).
-
-
37)
-
19. Zheng, W.X.: ‘Fast identification of autoregressive signals from noisy observations’, IEEE Trans. Circuits Syst., 2005, 52, (1), pp. 43–48 (doi: 10.1109/TCSII.2004.838435).
-
-
1)