access icon free Stabilisation of Markov jump linear systems subject to both state and mode detection delays

© The Institution of Engineering and Technology
Received 30/05/2013, Accepted 12/10/2013, Revised 11/09/2013, Published 10/12/2013

This study addresses the stabilisation problem of a class of discrete-time Markov jump linear systems subject to time delays which occur in both the system state and mode detection. The mode detection delay means that there exists a lag between the switching of the system modes and the switching of the corresponding controllers. The state delays are considered to be random but with upper and lower bounds, and the mode detection delay is assumed to be constant. With an extended state space, the underlying system can be remodelled as a Markov jump linear system in which the system complexity and the number of system modes are both increased to a certain extent, but remain unchanged when the mode detection delay becomes larger. A sufficient condition guaranteeing the stochastic stability of the system is obtained via a modified stochastic Lyapunov function. The effectiveness of the proposed design approach is demonstrated by a numerical example.

Inspec keywords: linear systems; delays; discrete time systems; stochastic processes; stability; Lyapunov methods; Markov processes

Other keywords: system modes; system complexity; stochastic stability; discrete-time Markov jump linear systems; state detection delays; upper bounds; sufficient condition; lower bounds; modified stochastic Lyapunov function; stabilisation problem; mode detection delays; time delays

Subjects: Distributed parameter control systems; Markov processes; Stability in control theory; Discrete control systems

References

    1. 1)
    2. 2)
    3. 3)
    4. 4)
    5. 5)
    6. 6)
    7. 7)
    8. 8)
    9. 9)
    10. 10)
    11. 11)
    12. 12)
    13. 13)
    14. 14)
    15. 15)
    16. 16)
    17. 17)
    18. 18)
    19. 19)
    20. 20)
    21. 21)
    22. 22)
    23. 23)
      • 14. Zhao, X., Zeng, Q.: ‘Delay-dependent H∞ performance analysis for Markovian jump systems with mode-dependent time varying delays and partially known transition rates’, Int. J. Control, Autom. Syst., 2010, 8, (2), pp. 482–489 (doi: 10.1007/s12555-010-0238-0).
    24. 24)
      • 23. Boukas, E.K., Liu, Z.K.: ‘Robust H∞ control of discrete-time Markovian jump linear systems with mode-independent time-delays’, IEEE Trans. Autom. Control, 2001, 46, (12), pp. 1918–1924 (doi: 10.1109/9.975476).
    25. 25)
      • 11. Xiong, J., Lam, J.: ‘On robust stabilization of Markovian jump systems with uncertain switching probabilities’, Automatica, 2005, 41, (5), pp. 897–903 (doi: 10.1016/j.automatica.2004.12.001).
    26. 26)
      • 21. Xiong, J., Lam, J.: ‘Stabilization of discrete-time Markovian jump linear systems via time-delayed controllers’, Automatica, 2006, 42, (5), pp. 747–753 (doi: 10.1016/j.automatica.2005.12.015).
    27. 27)
      • 16. Mhaskar, P., EI-Farra, N.H., Christofides, P.D.: ‘Robust predictive control of switched systems: satisfying uncertain schedules subject to state and control constraints’, Int. J. Adapt. Control Signal Process., 2008, 22, (2), pp. 161–179 (doi: 10.1002/acs.975).
    28. 28)
      • 7. Shi, P., Xia, Y.Q., Liu, G.P., Rees, D.: ‘On designing of sliding-mode control for Stochastic jump systems’, IEEE Trans. Autom. Control, 2006, 51, (1), pp. 97–103 (doi: 10.1109/TAC.2005.861716).
    29. 29)
      • 8. Fang, Y.G., Loparo, K.A.: ‘Stochastic stability of jump linear systems’, IEEE Trans. Autom. Control, 2002, 47, (7), pp. 1204–1208 (doi: 10.1109/TAC.2002.800674).
    30. 30)
      • 6. Shi, P., Boukas, E.K.: ‘H∞ control for Markovian jumping linear systems with parametric uncertainty’, J. Optim. Theory Appl., 1997, 95, (1), pp. 75–99 (doi: 10.1023/A:1022683311870).
    31. 31)
      • 15. Zhang, L., Cui, N., Liu, M., Zhao, Y.: ‘Asynchronous filtering of discrete-time switched linear systems with average dwell time’, IEEE Trans. Circuits Syst. I, 2011, 58, (5), pp. 1109–1118 (doi: 10.1109/TCSI.2010.2092151).
    32. 32)
      • 9. Zhao, X., Zeng, Q.: ‘Stabilization of jump linear systems with modedependent time varying delays’, Optimal Control, Applications and Methods, 2011, 32, (2), pp. 132–152 (doi: 10.1002/oca.937).
    33. 33)
      • 20. Chen, W., Guan, Z.: ‘Delay-dependent stability and H∞ control of uncertain discrete-time Markovian jump systems with mode-dependent time delays’, Syst. Control Lett., 2004, 52, (5), pp. 361–376 (doi: 10.1016/j.sysconle.2004.02.012).
    34. 34)
      • 5. Li, L., Ugrinovskii, V.A.: ‘On necessary and sufficient conditions for H∞ output feedback control of Markov jump linear systems’, IEEE Trans. Autom. Control, 2007, 52, (7), pp. 1287–1292 (doi: 10.1109/TAC.2007.900832).
    35. 35)
      • 22. Liu, M., Ho, D.W.C., Niu, Y.: ‘Stabilization of Markovian jump linear system over networks with random communication delay’, Automatica, 2009, 45, (2), pp. 416–421 (doi: 10.1016/j.automatica.2008.06.023).
    36. 36)
      • 4. Ji, Y., Chizeck, H.J., Feng, X., Loparo, K.A.: ‘Stability and control of discrete-time jump linear-systems’, Control Theory Adv. Technol., 1991, 7, (2), pp. 247–270.
    37. 37)
      • 12. Zhang, L., Boukas, E.K.: ‘Stability and stabilization of Markovian jump linear systems with partly unknown transition probability’, Automatica, 2009, 45, (2), pp. 463–468 (doi: 10.1016/j.automatica.2008.08.010).
    38. 38)
      • 19. Cao, Y.Y., Lam, J.: ‘Robust H∞ control of uncertain Markovian jump systems with time-delay’, IEEE Trans. Autom. Control, 2000, 45, (1), pp. 77–83 (doi: 10.1109/9.827358).
    39. 39)
      • 17. Boukas, E.K., Liu, Z.K., Shi, P.: ‘Delay-dependent stability and output feedback stabilisation of Markov jump system with time-delay’, IEE Proc. Control Theory Appl., 2002, 149, (5), pp. 379–386 (doi: 10.1049/ip-cta:20020442).
    40. 40)
      • 13. Zhang, L., Lam, J.: ‘Necessary and sufficient conditions for analysis and synthesis of Markov jump linear systems with incomplete transition descriptions’, IEEE Trans. Autom. Control, 2010, 55, (7), pp. 1695–1701 (doi: 10.1109/TAC.2010.2046607).
    41. 41)
      • 10. Costa, O.L.V., Fragoso, M.D.: ‘Discrete-time LQ-optimal control-problems for infinite Markov jump parameter-systems’, IEEE Trans. Autom. Control, 1995, 40, (12), pp. 2076–2088 (doi: 10.1109/9.478328).
    42. 42)
      • 1. Bolzern, P., Colaneri, P., De Nicolao, G.: ‘On almost sure stability of continuous-time Markov jump linear systems’, Automatica, 2006, 42, (6), pp. 983–988 (doi: 10.1016/j.automatica.2006.02.007).
    43. 43)
      • 2. Zhao, X., Ling, M., Zeng, Q.: ‘Delay-dependent stability criterion and H∞ analysis for Markovian jump systems with time-varying delays’, Asian Journal of Control, 2011, 13, (2), pp. 232–239 (doi: 10.1002/asjc.302).
    44. 44)
      • 3. de Souza, C.E.: ‘Robust stability and stabilization of uncertain discrete-time Markovian jump linear systems’, IEEE Trans. Autom. Control, 2006, 51, (5), pp. 836–841 (doi: 10.1109/TAC.2006.875012).
    45. 45)
      • 18. Cao, Y.Y., Lam, J.: ‘Stochastic stabilizability and H∞ control for discrete-time jump linear systems with time delay’, J. Franklin Inst., 1999, 336, (8), pp. 1263–1281 (doi: 10.1016/S0016-0032(99)00035-6).
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cta.2013.0507
Loading

Related content

content/journals/10.1049/iet-cta.2013.0507
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading