Finite horizon H 2/H ∞ control of time-varying stochastic systems with Markov jumps and (x, u, v)-dependent noise
- Author(s): Ming Gao 1 ; Li Sheng 2 ; Weihai Zhang 1
-
-
View affiliations
-
Affiliations:
1:
College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao 266590, People's Republic of China;
2: College of Information and Control Engineering, China University of Petroleum (East China), Qingdao 266580, People's Republic of China
-
Affiliations:
1:
College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao 266590, People's Republic of China;
- Source:
Volume 8, Issue 14,
18 September 2014,
p.
1354 – 1363
DOI: 10.1049/iet-cta.2013.1070 , Print ISSN 1751-8644, Online ISSN 1751-8652
This study investigates the finite horizon H 2/H ∞ control of time-varying stochastic Markov jump systems (SMJSs) with state, control and disturbance-dependent noise. Firstly, the stochastic bounded real lemma of SMJSs is established, which by itself has theoretical importance. Secondly, several necessary and sufficient conditions for H 2/H ∞ control of SMJSs are proposed by means of coupled generalised differential Riccati equations. Finally, two numerical examples are given to show the effectiveness of the obtained results.
Inspec keywords: Riccati equations; H∞ control; stochastic systems; Markov processes; differential equations
Other keywords: time-varying stochastic Markov jump systems; finite horizon H infinity control; disturbance-dependent noise; coupled generalised differential Riccati equations; stochastic bounded real lemma; SMJS
Subjects: Linear algebra (numerical analysis); Differential equations (numerical analysis); Optimal control; Time-varying control systems
References
-
-
1)
- B.S. Chen , W. Zhang . Stochastic H2/H∞ control with state-dependent noise. IEEE Trans. Autom. Control , 1 , 45 - 57
-
2)
- O.L.V. Costa , R.P. Marques . Mixed H2/H∞ control of discrete-time Markovian jump linear systems. IEEE Trans. Autom. Control , 95 - 100
-
3)
-
20. Oksendal, B.: ‘Stochastic differential equations: an introduction with applications’ (Springer-Verlag, New York, 2003).
-
-
4)
-
10. Song, S., Ma, S., Zhang, C.: ‘Stability and robust stabilisation for a class of non-linear uncertain discrete-time descriptor Markov jump systems’, IET Control Theory Appl., 2012, 6, (16), pp. 2518–2527 (doi: 10.1049/iet-cta.2012.0479).
-
-
5)
- V. Dragan , T. Morozan . The linear quadratic optimization problems for a class of linear stochastic systems with multiplicative white noise and Markovian jumping. IEEE Trans. Autom. Control , 665 - 675
-
6)
-
3. Yin, G., Zhou, X.Y.: ‘Markowitz's mean-variance portfolio selection with regime switching: from discrete-time models to their continuous time limits’, IEEE Trans. Autom. Control, 2004, 49, (3), pp. 349–360 (doi: 10.1109/TAC.2004.824479).
-
-
7)
-
16. Hou, T., Zhang, W., Ma, H.: ‘Finite horizon H2/H∞ control for discrete-time stochastic systems with Markovian jumps and multiplicative’, IEEE Trans. Autom. Control, 2010, 55, (5), pp. 1185–1191 (doi: 10.1109/TAC.2010.2041987).
-
-
8)
-
28. Li, X., Zhou, X.Y.: ‘Indefinite stochastic LQ controls with Markovian jumps in a finite horizon’, Commun. Inf. Syst., 2002, 2, (3), pp. 265–282.
-
-
9)
-
18. Hou, T., Zhang, W., Ma, H.: ‘A game-based control design for discrete-time Markov jump systems with multiplicative noise’, IET Control Theory Appl., 2013, 7, (5), pp. 773–783 (doi: 10.1049/iet-cta.2012.1018).
-
-
10)
-
11. Shen, L., Sun, J., Wu, Q.: ‘Observability and detectability of discrete-time stochastic systems with Markovian jump’, Syst. Control Lett., 2013, 62, (1), pp. 37–42 (doi: 10.1016/j.sysconle.2012.10.005).
-
-
11)
-
7. Li, Z., Zhou, B., Wang, Y., Duan, G.: ‘On eigenvalue sets and convergence rate of Itô stochastic systems with Markovian switching’, IEEE Trans. Autom. Control, 2011, 56, (5), pp. 1118–1124 (doi: 10.1109/TAC.2010.2085630).
-
-
12)
-
17. Ma, H., Zhang, W., Hou, T.: ‘Infinite horizon H2/H∞ control for discrete-time time-varying Markov jump systems with multiplicative noise’, Automatica, 2012, 48, (7), pp. 1447–1454 (doi: 10.1016/j.automatica.2012.05.006).
-
-
13)
-
5. Mao, X., Yuan, C.: ‘Stochastic differential equations with Markovian switching’ (Imperial College Press, London, 2006).
-
-
14)
- Z. Wang , Y. Liu , X. Liu . Exponential stabilization of a class of stochastic system with markovian jump parameters and mode-dependent mixed time-delays. IEEE Trans. Autom. Control , 7 , 1656 - 1662
-
15)
-
4. Mariton, M.: ‘Jump linear systems in automatic control’ (Marcel Dekker, New York, 1990).
-
-
16)
- W. Zhang , Y. Huang , L. Xie . Infinite horizon stochastic H2/H∞ control for discrete-time systems with state and disturbance dependent noise. Automatica , 9 , 2306 - 2316
-
17)
-
19. Zhang, W., Feng, G.: ‘Nonlinear stochastic H2/H∞ control with (x, u, v)-dependent noise: infinite horizon case’, IEEE Trans. Autom. Control, 2008, 53, (5), pp. 1323–1328 (doi: 10.1109/TAC.2008.921024).
-
-
18)
- X.J. Xie , N. Duan . Output tracking of high-order stochastic nonlinear systems with application to benchmark mechanical system. IEEE Trans. Autom. Control , 1197 - 1202
-
19)
-
1. Mao, X.: ‘Stochastic differential equations and applications’ (Horwood, London, 1997).
-
-
20)
- D. Hinrichsen , A.J. Pritchard . Stochastic H∞. SIAM J. Control Optim. , 1504 - 1538
-
21)
-
15. Ma, S., Zhang, C.: ‘H∞ control for discrete-time singular Markov jump systems subject to actuator saturation’, J. Franklin Inst., 2012, 349, (3), pp. 1011–1029 (doi: 10.1016/j.jfranklin.2011.12.004).
-
-
22)
- S. Ma , C. Zhang , S. Zhu . Robust stability for discrete-time uncertain singular Markov jump systems with actuator saturation. IET Control Theory Appl. , 2 , 255 - 262
-
23)
-
8. Sheng, L., Gao, M., Zhang, W.: ‘Spectral characterisation for stability and stabilisation of linear stochastic systems with Markovian switching and its applications’, IET Control Theory Appl., 2013, 7, (5), pp. 730–737 (doi: 10.1049/iet-cta.2012.0471).
-
-
24)
-
23. Feng, Y., Anderson, B.D.O.: ‘An iterative algorithm to solve state-perturbed stochastic algebraic Riccati equations in LQ zero-sum games’, Syst. Control Lett., 2010, 59, (1), pp. 50–56 (doi: 10.1016/j.sysconle.2009.11.006).
-
-
25)
- D.J.N. Limebeer , B.D.O. Anderson , B. Hendel . A Nash game approach to mixed H2/H∞ control. IEEE Trans. Autom. Control , 69 - 82
-
26)
-
13. Costa, O.L.V., Oliveira, A.D.: ‘Optimal mean-variance control for discrete-time linear systems with Markovian jumps and multiplicative noises’, Automatica, 2012, 48, (2), pp. 304–315 (doi: 10.1016/j.automatica.2011.11.009).
-
-
27)
- H.J. Gao , J. Lam , L.H. Xie , C.H. Wang . New approach to mixed H2/H∞ filtering for polytopic discrete-time systems. IEEE Trans. Signal Process. , 3183 - 3192
-
28)
- S. Ma , C. Zhang . Robust stability and H∞ control for uncertain discrete Markovian jump singular systems with mode-dependent time-delay. Int. J. Robust Nonlinear Control , 9 , 965 - 985
-
1)