© The Institution of Engineering and Technology
This study is devoted to investigating the inherent relationship among the H 2, H ∞ and H 2/H ∞ control designs for discrete-time Markov jump systems with multiplicative noise. From a new perspective of non-zero-sum Nash game, we show that the Nash equilibrium solution may present a unified treatment approach for these three types of control design problems by taking adequate parameters in the quadratic performance indices. Moreover, a numerical example is supplied to illustrate the proposed results.
References
-
-
1)
-
22. Costa, O.L.V., Wanderlei, L.P.: ‘Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems’, Automatica, 2007, 43, pp. 587–597 (doi: 10.1016/j.automatica.2006.10.022).
-
2)
-
2. Dockner, E., Jorgensen, S., Long, N.V., Sorger, G.: ‘Differential games in economics and management science’ (Cambridge University Press, Cambridge, 2000).
-
3)
-
14. Petersen, I.R., Ugrinovskii, V., Savkin, A.V.: ‘Robust control design using H∞ methods’ (Springer, Berlin, 2000).
-
4)
-
24. Niu, Y., Ho, D.W.C., Wang, X.: ‘Sliding mode control for Itô stochastic systems with Markovian switching’, Automatica, 2007, 43, pp. 1784–1790 (doi: 10.1016/j.automatica.2007.02.023).
-
5)
-
11. Zhang, L., Lam, J.: ‘Necessary and sufficient conditions for analysis and synthesis of Markov jump linear systems with incomplete transition descriptions’, IEEE Trans. Autom. Control, 2010, 55, pp. 1695–1701 (doi: 10.1109/TAC.2010.2046607).
-
6)
-
15. Yin, G., Zhou, X.Y.: ‘Markowitz's mean-variance portfolio selection with regime switching: from discrete-time models to their continuous-time limits’, IEEE Trans. Autom. Control, 2004, 49, pp. 349–360 (doi: 10.1109/TAC.2004.824479).
-
7)
-
4. Freiling, G., Jank, G., Abou-Kandil, H.: ‘On global existence of solutions to coupled Matrix Riccati equations in closed-loop Nash games’, IEEE Trans. Autom. Control, 1996, 41, pp. 264–269 (doi: 10.1109/9.481532).
-
8)
-
27. Hou, T., Zhang, W., Ma, H.: ‘Finite horizon H2/H∞ control for discrete-time stochastic systems with Markovian jumps and multiplicative noise’, IEEE Trans. Autom. Control, 2010, 55, pp. 1185–1191 (doi: 10.1109/TAC.2010.2041987).
-
9)
-
13. Hou, T., Zhang, W., Ma, H.: ‘Essential instability and essential destabilisation of linear stochastic systems’, IET Control Theory Applic., 2011, 5, pp. 334–340 (doi: 10.1049/iet-cta.2009.0655).
-
10)
-
31. Dragan, V., Morozan, T.: ‘Mixed input-output optimization for time varying Itô systems with state dependent noise’, Dyn. Continuous Discret. Impulsive Syst., 1997, 3, pp. 21–34.
-
11)
-
17. Mao, X., Yuan, C.: ‘Stochastic differential equations with Markovian switching’ (Imperial College Press, London, 2006).
-
12)
-
5. Engwerda, J.: ‘LQ dynamic optimization and differential games’ (Wiley, Chichester, 2005).
-
13)
-
1. Isaacs, R.: ‘Differential games’ (Wiley, New York, 1965).
-
14)
-
3. Papavassilopoulos, G.P., Medanic, J., Cruz, J.: ‘On the existence of Nash strategies and solutions to coupled Riccati equations in linear quadratic games’, J. Optim. Theory Appl., 1979, 28, pp. 49–75 (doi: 10.1007/BF00933600).
-
15)
-
12. Feng, J., Lam, J., Xu, S., Shu, Z.: ‘Stabilization of stochastic systems with optimal decay rate’, IET Control Theory Applic., 2008, 2, pp. 1–6 (doi: 10.1049/iet-cta:20070044).
-
16)
-
6. Bensoussan, A., Frehse, J.: ‘Stochastic games for N players’, J. Optim. Theory Appl., 2000, 15, pp. 543–565 (doi: 10.1023/A:1004637022496).
-
17)
-
29. Ait Rami, M., Chen, X., Zhou, X.Y.: ‘Discrete-time indefinite LQ control with state and control dependent noises’, J. Glob. Optim., 2002, 23, pp. 245–265 (doi: 10.1023/A:1016578629272).
-
18)
-
19. Dragan, V., Morozan, T.: ‘Observability and detectability of a class of discrete-time stochastic linear systems’, IMA J. Math. Control Inf., 2006, 23, pp. 371–394 (doi: 10.1093/imamci/dni064).
-
19)
-
10. Boukas, E.K.: ‘Control of singular systems with random abrupt changes’ (Springer, Berlin, 2008).
-
20)
-
20. Hou, T., Zhang, W., Ma, H.: ‘Stability and exact observability of discrete-time Markov jump systems with multiplicative noise’. Proc. 31st Chinese Control Conf., Hefei, An'Hui, China, 2012, pp. 1634–1639.
-
21)
-
9. Costa, O.L.V., Fragoso, M.D., Marques, R.P.: ‘Discrete-time Markovian jump linear systems’ (Springer, London, 2005).
-
22)
-
30. Mukaidani, H., Xu, H., Dragan, V.: ‘Multi-objective decision-making problems for discrete-time stochastic systems with state- and disturbance-dependent noise’. Proc. 50th IEEE Conf. Decision and Control and European Control Conf., Orlando, USA, 2011, pp. 6388–6393.
-
23)
-
7. Hamadene, S.: ‘Nonzero sum linear quadratic stochastic differential games and backward-forward equations’, Stoch. Anal. Appl., 1999, 17, pp. 117–130 (doi: 10.1080/07362999908809591).
-
24)
-
23. Lin, Z., Lin, Y., Zhang, W.: ‘H∞ filtering for nonlinear stochastic Markovian jump systems’, IET Control Theory Applic., 2010, 4, pp. 2743–2756 (doi: 10.1049/iet-cta.2009.0393).
-
25)
-
21. Li, X., Zhou, X.Y., Ait Rami, M.: ‘Indefinite stochastic linear quadratic control with Markovian jumps in infinite time horizon’, J. Glob. Optim., 2003, 27, pp. 149–175 (doi: 10.1023/A:1024887007165).
-
26)
-
8. Wang, Z., Qiao, H., Burnham, K.J.: ‘On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters’, IEEE Trans. Autom. Control, 2002, 47, pp. 640–646 (doi: 10.1109/9.995042).
-
27)
-
18. Ni, Y., Zhang, W., Fang, H.: ‘On the observability and detectability of linear stochastic systems with Markov jumps and multiplicative noise’, J. Syst. Sci. Complex., 2010, 23, pp. 102–115 (doi: 10.1007/s11424-010-9270-7).
-
28)
-
25. Dragan, V., Morozan, T.: ‘H2 optimal control for a wide class of discrete-time linear stochastic systems’, Int. J. Syst. Sci., 2009, 40, pp. 1029–1049 (doi: 10.1080/00207720902974629).
-
29)
-
28. Horn, R.A., Johnson, C.R.: ‘Matrix analysis’ (Cambridge University Press, Cambridge, 1985).
-
30)
-
26. Dragan, V., Morozan, T., Stoica, A.: ‘Mathematical methods in Robust control of discrete-time linear stochastic systems’ (Springer, New York, 2010).
-
31)
-
16. Yao, Y., Liang, J., Cao, J.: ‘Robust stability of Markovian jumping genetic regulatory networks with disturbance attenuation’, Asian J. Control, 2011, 13, pp. 655–666 (doi: 10.1002/asjc.373).
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cta.2012.1018
Related content
content/journals/10.1049/iet-cta.2012.1018
pub_keyword,iet_inspecKeyword,pub_concept
6
6