Output-feedback control for a class of Markovian jump non-linear systems under a risk-sensitive cost criterion with unknown transition probabilities

Chuanrui Wang; Haibo Ji

Output-feedback control for a class of Markovian jump non-linear systems under a risk-sensitive cost criterion with unknown transition probabilities

View Fulltext

Author(s): Chuanrui Wang ¹ and Haibo Ji ¹
- Affiliations: 1: Department of Automation, University of Science and Technology of China, Hefei, Anhui 230027, People's Republic of China
Source: Volume 8, Issue 7, 01 May 2014, p. 503 – 514
DOI: 10.1049/iet-cta.2013.0440 , Print ISSN 1751-8644, Online ISSN 1751-8652

Received 15/05/2013, Accepted 24/11/2013, Revised 15/11/2013, Published 18/03/2014

This study addresses the output-feedback control problem for a class of Markovian jump non-linear systems under a quadratic risk-sensitive cost function criterion. The transition probabilities of the Markov process are assumed to be completely unknown. By employing the high-gain scaling technique, common Lyapunov function method and backstepping technique, a control law is constructed that guarantees any arbitrary small risk-sensitive cost for a given risk-sensitive parameter. Moreover, the resulted closed-loop system solutions are bounded in probability. Compared with some previous results, this study does not require the uniform boundedness of the gain functions of the system noise, and the control law further achieves a zero risk-sensitive cost and asymptotically stable in the large for the closed-loop system solutions when the vector field of the disturbance vanishes at the origin. A numerical example is given to illustrate the proposed protocol.

References

1. 1)
  - I. Kanellakopoulos , P.V. Kokotovic , A.S. Morse . Systematic design of adaptive controllers for feedback linearizable systems. IEEE Trans. Autom. Control , 11 , 1241 - 1253
2. 2)
  - L. Zhang , E. Boukas . Mode-dependent H∞ filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities. Automatica , 6 , 1462 - 1467
3. 3)
  - L. Li , V.A. Ugrinovskii . On necessary and sufficient conditions for H∞ output feedback control of Markov jump linear systems. IEEE Trans. Autom. Control , 7 , 1287 - 1292
4. 4)
  - 25. Runolfsson, T.: ‘Risk-sensitive control of stochastic hybrid systems on infinite time horizon’, Math. Probl. Eng., 2000, 5, (6), pp. 459–478 (doi: 10.1155/S1024123X99001192).
5. 5)
  - L. Praly , Z.P. Jiang . Linear output feedback with dynamic high gain for nonlinear systems. Syst. Control Lett. , 2 , 107 - 116
6. 6)
  - K. Glover , J.C. Doyle . State-space formulae for all stabilizing controllers that satisfy an H norm bound and relations to risk sensitivity. Syst. Control Lett. , 167 - 172
7. 7)
  - 19. Jacobson, D.: ‘Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games’, IEEE Trans. Autom. Control, 1973, 18, (2), pp. 124–131 (doi: 10.1109/TAC.1973.1100265).
8. 8)
  - 17. Zhang, X., Baron, L., Liu, Q., Boukas, E.K.: ‘Deisgn of stabilizing controllers with a dynamic gain for feedforward nonlinear time-delay systems’, IEEE Trans. Autom. Control, 2011, 56, (3), pp. 692–697 (doi: 10.1109/TAC.2010.2097150).
9. 9)
  - 1. Kats, I.Y., Martynyuk, A.A.: ‘Stability and stabilization of nonlinear systems with random structure’ (Taylor and Francis, London, New York, 2002).
10. 10)
  - J.L. Xiong , J. Lam , H.J. Gao . On robust stabilization of Markovian jump systems with uncertain switching probabilities. Automatica , 897 - 903
11. 11)
  - 12. Sepulchre, R., Jankovic, M., Kokotović, P.V.: ‘Constructive nonlinear control’ (Springer, London, 1997).
12. 12)
  - 20. James, M.R., Baras, J.S., Elliott, R.J.: ‘Risk-sensitive control and dynamic games for partially observed discrete-time nonlinear systems’, IEEE Trans. Autom. Control, 1994, 39, (4), pp. 780–792 (doi: 10.1109/9.286253).
13. 13)
  - L. Zhang , E. Boukas , J. Lam . Analysis and synthesis of Markov jump linear systems with time-varying delays and partially known transition probabilities. IEEE Trans. Automat. Control , 10 , 2458 - 2464
14. 14)
  - 2. Boukas, E.K.: ‘Stochastic switching systems: analysis and design’ (Birkhäuser, Berlin, 2005).
15. 15)
  - Y.G. Liu , J.F. Zhang . Practical output-feedback risk-sensitive control for stochastic nonlinear systems with stable zero-dynamics. SIAM J. Control Optim. , 885 - 926
16. 16)
  - 29. Liberzon, D.: ‘Switching in systems and control’ (Birkhäuser, Boston, 2003).
17. 17)
  - 11. Krstić, M., Kanellakopoulos, I., Kokotović, P.V.: ‘Nonlinear and adaptive control design’ (Wiley, New York, 1995).
18. 18)
  - 3. Mao, X., Yuan, C.: ‘Stochastic differential equations with Markovian switching’ (Imperial College Press, London, 2006).
19. 19)
  - 22. Fleming, W.H., McEneaney, W.M.: ‘Risk-sensitive control on an infinite time horizon’, SIAM J. Control Optim., 1995, 33, (6), pp. 1881–1915 (doi: 10.1137/S0363012993258720).
20. 20)
  - 13. Khalil, H.K.: ‘Nonlinear systems’ (Prentice-Hall, New Jersey, 2000, 3rd edn.).
21. 21)
  - P. Krishnamurthy , F. Khorrami , R.S. Chandra . Global high-gain-based observer and backstepping controller for generalized output-feedback canonical form. IEEE Trans. Autom. Control , 2277 - 2284
22. 22)
  - Z. Wu , X. Xie , P. Shi , Y. Xia . Backstepping controller design for a class of stochastic nonlinear systems with Markovian switching. Automatica , 997 - 1004
23. 23)
  - G. Arslan , T. Basar . Risk-sensitive adaptive trackers for strict-feedback systems with output measurements. IEEE Trans. Autom. Control , 10 , 1754 - 1758
24. 24)
  - 4. Yin, G., Zhu, C.: ‘Hybrid switching diffusions: properties and applications, volume 63 of stochastic modelling and applied probability’ (Springer, New York, 2010).
25. 25)
  - 30. Gihman, I.I., Skorohod, A.V.: ‘Stochastic differential equations’ (Springer-Verlag, New York, 1972).
26. 26)
  - P. Krishnamurthy , F. Khorrami . Feedforward systems with ISS appended dynamics: adaptive output-feedback stabilization and disturbance attenuation. IEEE Trans. Autom. Control , 1 , 405 - 412
27. 27)
  - 23. Fleming, W.H., James, M.R.: ‘The risk-sensitive index and the H2 and H∞ norms for nonlinear systems’, Math. Control Signals Syst., 1995, 8, (3), pp. 199–221 (doi: 10.1007/BF01211859).
28. 28)
  - Y. Liu , Z. Pan , S. Shi . Output feedback control design for strict-feedback stochastic nonlinear systems under a risk-sensitive cost. IEEE Trans. Autom. Control , 3 , 509 - 514
29. 29)
  - 21. Runolfsson, T.: ‘The equivalence between infinite-horizon optimal control of stochastic systems with exponential-of-integral performance index and stochastic differential games’, IEEE Trans. Autom. Control, 1994, 39, (8), pp. 1551–1563 (doi: 10.1109/9.310029).
30. 30)
  - Z.G. Pan , T. Basar . Backstepping controller design for nonlinear stochastic systems under a risk-sensitive cost criterion. SIAM J. Control Optim. , 3 , 957 - 995

Login

Not registered yet?

Share

Tools

Login to add to favourites

Key

Output-feedback control for a class of Markovian jump non-linear systems under a risk-sensitive cost criterion with unknown transition probabilities

References

Related content