Identification of non-linear stochastic spatiotemporal dynamical systems
- Author(s): Hanwen Ning 1, 2 ; Xingjian Jing 1 ; Li Cheng 1
-
-
View affiliations
-
Affiliations:
1:
Department of Mechanical Engineering, Hong Kong Polytechnic University, HungHom, Kowloon, HongKong, People's Republic of China;
2: School of Statistics and Mathematics, Zhongnan University of Economics and Law, Wuhan, People's Republic of China
-
Affiliations:
1:
Department of Mechanical Engineering, Hong Kong Polytechnic University, HungHom, Kowloon, HongKong, People's Republic of China;
- Source:
Volume 7, Issue 17,
21 November 2013,
p.
2069 – 2083
DOI: 10.1049/iet-cta.2013.0150 , Print ISSN 1751-8644, Online ISSN 1751-8652
A systematic identification method for non-linear stochastic spatiotemproal (SST) systems described by non-linear stochastic partial differential equations (SPDEs) is investigated in this study based on pointwise observation data. A theoretical framework for a semi-finite element model approximating to an infinite-dimensional system is established, and several fundamental issues are discussed including the approximation error between the underlying infinite-dimensional dynamics and the model to be identified, and its rationality etc. Based on the proposed theoretical framework, a general identification method with irregular observation data is provided. These results not only provide an effective method for the identification of non-linear SST systems using measurement data (both offline and online), but also demonstrate a potential solution for the analysis, design and control of non-linear SST systems from a numerical point of view.
Inspec keywords: nonlinear dynamical systems; control system synthesis; stochastic systems; partial differential equations; nonlinear differential equations; identification
Other keywords: nonlinear stochastic spatio-temporal dynamical system; semifinite element model; approximation error; irregular observation data; systematic identification method; infinite-dimensional dynamic system; pointwise observation data; SPDE; general identification method; measurement data; nonlinear stochastic partial differential equations; SST systems
Subjects: Control system analysis and synthesis methods; Nonlinear control systems; Differential equations (numerical analysis); Nonlinear and functional equations (numerical analysis); Time-varying control systems; Simulation, modelling and identification
References
-
-
1)
-
40. Ricardo, A., Liliana, B., Josselin, G.: ‘Wave propagation in waveguides with random boundaries’, arXiv:1111.1118v1.
-
-
2)
-
18. Lind, I., Ljung, L.: ‘Regressor selection with the analysis of variance method’, Automatica, 2005, 41, pp. 693–700 (doi: 10.1016/j.automatica.2004.11.017).
-
-
3)
-
11. Yan, Y.: ‘Galerkin finite element methods for stochastic parabolic partial differential equations’, SIAM J. Numer. Anal., 2005, 4, pp. 1363–1384 (doi: 10.1137/040605278).
-
-
4)
-
32. Espinoza, M., Suykens, J.A.K., Moor, B.D.: ‘Kernel based partially linear models and non-linear identification’, IEEE Trans. Autom. Control, 2005, 50, pp. 1602–1606 (doi: 10.1109/TAC.2005.856656).
-
-
5)
-
10. Higham, D.J.: ‘An algorithmic introduction to numerical simulation of stochastic differential equations’, SIAM Rev., 2001, 3, pp. 525–546 (doi: 10.1137/S0036144500378302).
-
-
6)
-
21. Guo, L., Billings, S.A.: ‘State-space reconstruction and spatiotemporal prediction of lattice dynamical systems’, IEEE Trans. Autom. Control, 2007, 52, pp. 622–632 (doi: 10.1109/TAC.2007.894513).
-
-
7)
-
42. Carreras, D.M., Mellou, M., Sarra, M.: ‘On stochastic partial differential equations with spatially correlated noise: smoothness of the law’, Stoch. Process Appl., 2001, 93, pp. 269–284 (doi: 10.1016/S0304-4149(00)00099-5).
-
-
8)
-
9. Yoo, H.: ‘Semi-discretization of stochastic partial differential equations on R1 by a finite-difference method’, Math. Comput., 1999, 69, pp. 653–666 (doi: 10.1090/S0025-5718-99-01150-3).
-
-
9)
-
15. Sjoberg, J., Zhang, Q., Ljung, L., Benveniste, A., Delyon, B., Glorennec, P.-Y., et al: ‘Nonlinear black-box modeling in system identification: a unified overview’, Automatica, 1995, 12, pp. 1691–1724 (doi: 10.1016/0005-1098(95)00120-8).
-
-
10)
-
46. Abdulle, A., Pavliotis, G.A.: ‘Numerical methods for stochastic partial differential equations with multiple scales’, J. Comput. Phys., 2012, 231, pp. 2482–2497 (doi: 10.1016/j.jcp.2011.11.039).
-
-
11)
-
13. Cao, Y., Yang, H., Yin, L.: ‘Finite element methods for semilinear elliptic stochastic partial differential equations’, Numer. Math., 2007, 1, pp. 181–198 (doi: 10.1007/s00211-007-0062-5).
-
-
12)
-
55. Xia, Y., Leung, H.: ‘Nonlinear spatial-temporal prediction based on optimal fusion’, IEEE Trans. Neural Netw., 17, 2006, pp. 975–988 (doi: 10.1109/TNN.2006.875985).
-
-
13)
-
54. Qi Chenkun, C., Li, H., Zhang, X., Zhao, X., Li, S., Gao, F.: ‘Time/space-separation-based SVM modeling for nonlinear distributed parameter processes’, Ind. Eng. Chem. Res., 2011, 50, pp. 332–342 (doi: 10.1021/ie1002075).
-
-
14)
-
45. Barth, A.: ‘Stochastic partial differential equations: approximations and applications’. submitted for PhD dissertation, Center of Mathematics for Applications (CMA) University of Oslo, 2009.
-
-
15)
-
47. Kamrani, M., Blomker, D.: ‘Numerical solution of stochastic partial differential equations with correlated noise’ (Institution fur Mathematik der University Augsburg, Preprints-Herausgeber, 2013).
-
-
16)
-
6. Friedman, A.: ‘Stochastic differential equations and applications’ (Academic Press, New York, 1975).
-
-
17)
-
23. Wei, H., Billings, S.A., Zhao, Y., Guo, L.: ‘Lattice dynamical wavelet neural networks implemented using particle swarm optimization for spatio-temporal system identification’, IEEE Trans. Neural Netw., 2009, 20, pp. 181–185 (doi: 10.1109/TNN.2008.2009639).
-
-
18)
-
44. Peszat, S., Zabczyk, J.: ‘Stochastic partial differential equations with levy noise’ (Cambridge, 2007).
-
-
19)
-
27. Coca, D., Billings, S.A.: ‘Identification of finite dimensional models of infinite dimensional dynamical systems’, Automatica, 2002, 38, pp. 1851–1865 (doi: 10.1016/S0005-1098(02)00099-7).
-
-
20)
-
30. de Boor, C., Hollig, K., Riemenschneider, S.: ‘Box splines’ (Springer-Verlag, Berlin, 1993).
-
-
21)
-
2. Farlow, S.J.: ‘Partial differential equations for scientists and engineers’ (John Wiley and Sons Inc., New York, 1982).
-
-
22)
-
49. Garnier, H., Wang, L.: ‘Identification of continuous-time models from sampled data’ (Springer, 2008).
-
-
23)
-
34. Hong, X., Mitchell, R.J., Chen, S., Harris, C.J., Li, K., Irwin, G.W.: ‘Model selection approaches for non-linear system identification: a review’, Int. J. Syst. Sci., 2008, 39, pp. 925–946 (doi: 10.1080/00207720802083018).
-
-
24)
-
33. Ning, H., Jing, X., Chen, L.: ‘Online identification of nonlinear spatiotemporal systems using kernel learning approach’, IEEE Trans. Neural Netw., 2011, 22, pp. 1381–1394 (doi: 10.1109/TNN.2011.2161331).
-
-
25)
-
39. Atak, A., Linton, O., Xiao, Z.: ‘A semiparametric panel model for unbalanced data with application to climate change in the United Kingdom’, J. Econ., 2011, 164, pp. 92–115.
-
-
26)
-
7. Mahmudov, N.I.: ‘Controllability of linear stochastic systems’, IEEE Trans. Autom. Control, 2001, 41, pp. 724–731 (doi: 10.1109/9.920790).
-
-
27)
-
38. Lucas, J., Fridrich, J., Goljan, M.: ‘Digital camera identification from sensor pattern noise’, IEEE Trans. Inf. Forensics Sec., 2006, 52, pp. 205–214.
-
-
28)
-
3. Da Prato, G., Zabczyk, J.: ‘Stochastic equations in infinite dimensions’ (Cambridge University Press, Cambridge, UK, 1992).
-
-
29)
-
4. Chow, P.: ‘Stochastic partial differential equations’ (Chapman and Hall, Boca Raton, FL, 2007).
-
-
30)
-
24. Billings, S.A., Guo, L., Wei, H.: ‘Identification of coupled map lattice models for spatiotemporal patterns using wavelets’, Int. J. Syst. Sci., 2006, 37, pp. 1021–1038 (doi: 10.1080/00207720600963015).
-
-
31)
-
50. Walsh, J.B.: ‘An introduction to stochastic partial differential equations, lecture notes in mathematics 1180’ (Springer-Verlag, Berlin, 1986).
-
-
32)
-
16. Milanese, M., Novara, C.: ‘Set membership identification of non-linear systems’, Automatica, 2004, 40, pp. 957–975 (doi: 10.1016/j.automatica.2004.02.002).
-
-
33)
-
56. Pazy, A.: ‘Semigroups of linear operators and applications to partial differential equations’ (Springer-Verlag, Berlin, 1983).
-
-
34)
-
48. Doering, C.R., Sargsyan, K.V., Smereka, P.: ‘A numerical method for some stochastic differential equations with multiplicative noise’, Phys. Lett. A, 344, 2005, pp. 149–155 (doi: 10.1016/j.physleta.2005.06.045).
-
-
35)
-
31. Xu, Y., Chen, D.: ‘Partially linear least squares regularized regression for system identification’, IEEE Trans. Autom. Control, 2009, 54, pp. 2637–2641 (doi: 10.1109/TAC.2009.2031566).
-
-
36)
-
36. Vegt, J.J.W.V.D., Bokhove, O.: ‘Finite element method for partial differential equations’. Working paper, 2009.
-
-
37)
-
26. Li, H., Qi, C.: ‘Spatiotemporal modeling of nonlinear distributed parameter systems’ (Springer, 2011).
-
-
38)
-
41. Charles, R., Farrar, R., Keith, W.: ‘An introduction to structural health monitoring’, Phil. Trans. R. Soc. A, 2007, 365, pp. 303–315 (doi: 10.1098/rsta.2006.1928).
-
-
39)
-
35. Girault, V., Raviart, P.A.: ‘Finite element method for Navier–Stokes equation: theory and algorithms’ (Springer-Verlag, Berlin, 1986).
-
-
40)
-
12. Kovacs, M., Larsson, S., Saedpanah, F.: ‘Finite element approximation of the linear stochastic wave equation with additive noise’, SIAM J. Numer. Anal., 2010, 2, pp. 408–427 (doi: 10.1137/090772241).
-
-
41)
-
53. Suykens, J.A.K., Vandewalle, J., Moor, B.D.: ‘Optimal control by least squares support vector machines’, Neural Netw., 2001, 14, pp. 23–35 (doi: 10.1016/S0893-6080(00)00077-0).
-
-
42)
-
5. Peszat, S., Zabczyk, J.: ‘Stochastic partial differential equations with levy noise: an evolution equation approach’ (Cambridge University Press, Cambridge, UK, 2007).
-
-
43)
-
25. Guo, L., Billings, S.A.: ‘Identification of partial differential equation models for continuous spatiotemporal dynamical systems’, IEEE Trans. Circuits Syst. II, Express Briefs, 2008, 53, pp. 657–661.
-
-
44)
-
22. Guo, L., Billings, S.A., Coca, D.: ‘Identification of partial differential equation models for a class of multiscale spaio-temporal dynamical systems’, Int. Control J., 2010, 83, pp. 40–48 (doi: 10.1080/00207170903085597).
-
-
45)
-
19. Vapnik, V.: ‘The Nature of statistical learning theory’ (Springer-Verlag, New York, 1995).
-
-
46)
-
8. Allen, E.J., Novosel, S.J., Zhang, Z.: ‘Finite element and difference approximation of some linear stochastic partial differential equations’, Stoch. Stoch. Rep., 1998, 64, pp. 117–142 (doi: 10.1080/17442509808834159).
-
-
47)
-
29. Jentzen, A., Kloeden, P.E.: ‘Overcoming the order barrier in the numerical approximation of stochastic partial differential equations with additive space-time noise’, Proc. R. Soc. A, 2009, 465, pp. 649–667 (doi: 10.1098/rspa.2008.0325).
-
-
48)
-
17. Chen, S., Billings, S.A., Luo, W.: ‘Orthogonal least squares methods and their application to non-linear system identification’, Int. Control J., 1989, 50, pp. 1873–1896 (doi: 10.1080/00207178908953472).
-
-
49)
-
43. Ferrante, M., Martaa, S.: ‘SPDEs with coloured noise: analytic and stochastic approaches’, ESAIM: Prob. Stat., 2006, 10, pp. 380–405 (doi: 10.1051/ps:2006016).
-
-
50)
-
37. Goljan, M.: ‘Digital camera identification from imagesCestimating false acceptance probability’, Lect. Notes Comput. Sci., 2009, 5450, pp. 454–468 (doi: 10.1007/978-3-642-04438-0_38).
-
-
51)
-
1. Debnath, L.: ‘Nonlinear partial differential equations for scientists and engineers’ (Birkhauser, Boston, 2005).
-
-
52)
-
52. Scholkopf, B., Smola, A.J.: ‘Learning with kernels: support vector machines, regularization, optimization and beyond’ (MIT Press, Cambridge, MA, 2002).
-
-
53)
-
51. Chen, S., Billings, S.A.: ‘Representation of non-linear systems: the NARMAX model’, Int. Control J., 1989, 49, pp. 1013–1032 (doi: 10.1080/00207178908559683).
-
-
54)
-
14. Thomee, V.: ‘Gelerkin finite element methods for parabolic problems’ (Springer-Verlag, Berlin, 2006, 2nd edn.).
-
-
55)
-
20. Suykens, J.A.K., Gestel, V.T., Brabanter, J.D., Moor, B.D., Vandewalle, J.: ‘Least squares support vector machines’ (World Scientific, Singapore, 2002).
-
-
56)
-
28. Barth, A.: ‘A finite element method for martingale-driven stochastic partial differential equations’, Commun. Stoch. Anal., 2010, 3, pp. 355–375.
-
-
1)