Control and decision strategy for a class of Markovian jump systems in failure prone manufacturing process

Author(s): J. Zhu ; L.P. Wang ; M. Spiryagin
DOI: 10.1049/iet-cta.2011.0302

For access to this article, please select a purchase option:

Buy article PDF

Buy Knowledge Pack

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership

Recommend Title Publication to library

IET Control Theory & Applications — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Author(s): J. Zhu ¹ ; L.P. Wang ¹ ; M. Spiryagin ²
- Affiliations: 1: Department of Automation, University of Science and Technology of China, Hefei, People’s Republic of China
  2: Center for Railway Engineering, Central Queensland University, Rockhampton, Australia
Source: Volume 6, Issue 12, 16 August 2012, p. 1803 – 1811
DOI: 10.1049/iet-cta.2011.0302 , Print ISSN 1751-8644, Online ISSN 1751-8652

This study investigates control and decision strategy for the failure prone manufacturing process, which is modelled as a two-mode Markovian jump system (MJS). Considering the historical effects on the system, the mode transition rate matrix (MTRM) is time-varying instead of homogeneous. A piecewise homogeneous MJS is thus proposed to characterise this phenomenon, in which the MTRM is homogeneous during certain time intervals but non-homogeneous for the whole time interval. By regarding each homogeneous MTRM as one event, all the MTRMs over the whole time interval will take values in an event set and be governed by a higher-level Markov chain. To ensure such system operates normally with high probability, the decisions including preventive maintenance and corrective maintenance are introduced to adjust the higher-level Markov chain. Motivated by this, a new joint performance, consisting of both cost function for decision making and controller design, is developed. Optimal decisions are obtained by an iterative algorithm whose convergence is proved, as well as an optimal controller is designed. The effectiveness of this method is demonstrated by simulations.

References

1. 1)
  - M. Mariton . (1990) Jump linear systems in automatic control.
2. 2)
  - F. Tao , Q. Zhao . Synthesis of active fault-tolerant control based on Markovian jump system models. IET Control Theory Appl. , 4 , 1160 - 1168
3. 3)
  - J. Zhu , H.S. Xi , H.B. Ji , B. Wang . Robust adaptive tracking for Markovian jump nonlinear systems with unknown nonlinearities. Discret. Dyn. Nat. Soc.
4. 4)
  - J. Xiong , J. Lam . Stabilization of linear systems over networks with bounded packet loss. Automatica , 1 , 80 - 87
5. 5)
  - P.A. Kawka , A.G. Alleyne . Robust wireless servo control using a discrete-time uncertain Markovian jump linear model. IEEE Trans. Control Syst. Technol. , 3 , 733 - 742
6. 6)
  - X.R. Mao , J. Lam , S.Y. Xu , H.J. Gao . Razumikhin method and exponential stability of hybrid stochastic delay interval systems. J. Math. Anal. Appl. , 1 , 45 - 66
7. 7)
  - P. Shi , E.K. Boukas , R.K. Agarwal . Kalman filtering for continuous-time uncertain systems with markovian jumping parameters. IEEE Trans. Autom. Control , 8 , 1592 - 1597
8. 8)
  - E.K. Boukas , P. Shi , K. Benjelloun . On stabilization of uncertain systems with jump parameters. Int. J. Control , 9 , 842 - 850
9. 9)
  - D.W. Stroock . (2005) An introduction to Markov processes.
10. 10)
  - Y. Cao , J. Lam . Robust H∞ control of uncertain Markovian jump systems with time-delay. IEEE Trans. Autom. Control , 1 , 77 - 83
11. 11)
  - T. Kirrubarajan , Y. Bar-Shalom , K.R. Pattipati , I. Kadar . Ground target tracking with variable structure IMM estimator. IEEE Trans. Aerosp. Electron. Syst. , 1 , 26 - 46
12. 12)
  - X.R. Mao , J. Lam , L.R. Huang . Stabilisation of hybrid stochastic differential equations by delay feedback control. Syst. Control Lett. , 11 , 927 - 935
13. 13)
  - F. Martinelli . Manufacturing systems with a production dependent failure rate: structure of optimality. IEEE Trans. Autom. Control , 10 , 2401 - 2406
14. 14)
  - J.L. Xiong , J. Lam , H.J. Gao . On robust stabilization of Markovian jump systems with uncertain switching probabilities. Automatica , 897 - 903
15. 15)
  - M. Karan , P. Shi , C.Y. Koya . Transition probability bounds for the stochastic stability robustness of continuous- and discrete-time Markovian jump linear systems. Automatica , 2159 - 2168
16. 16)
  - Z. Mao , B. Jiang , P. Shi . H∞ fault detection filter design for networked control systems modelled by discrete Markovian jump systems. IET Control Theory Appl. , 8 , 675 - 681
17. 17)
  - P. Shi , E.K. Boukas , K. Agarwal . Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay. IEEE Trans. Autom. Control , 11 , 2139 - 2144
18. 18)
  - Y. Ji , H.J. Chizeck . Controllability, stabilisability, and continuous-time Markovian jump linear quadratic control. IEEE Trans. Autom. Control , 777 - 788
19. 19)
  - L. Zhang , E. Boukas , J. Lam . Analysis and synthesis of Markov jump linear systems with time-varying delays and partially known transition probabilities. IEEE Trans. Automat. Control , 10 , 2458 - 2464
20. 20)
  - Y. Xia , M. Fu , P. Shi , Z. Wu , J. Zhang . Adaptive backstepping controller design for stochastic jump systems. IEEE Trans. Autom. Control , 12 , 2853 - 2859
21. 21)
  - C.G. Cassandras , S. Lafortune . (1999) Introduction to discrete event systems.
22. 22)
  - B. Tan , S.B. Gershwin . Analysis of a general Markovian two-stage continuous-flow production system with a finite buffer. Int. J. Prod. Econ. , 2 , 327 - 339
23. 23)
  - E.K. Boukas , Z.K. Liu . Production and maintenance control for manufacturing systems. IEEE Trans. Autom. Control , 9 , 1455 - 1460
24. 24)
  - L. Tong , A.G. Wu , G.R. Duan . Finite iterative algorithm for solving coupled Lyapunov equations appearing in discrete-time Markov jump linear systems. IET Control Theory Appl. , 10 , 2223 - 2231
25. 25)
  - D.P. Bertsekas . (1999) Nonlinear programming.
26. 26)
  - L.X. Zhang . H∞ estimation for discrete-time piecewise homogeneous Markov jump linear systems. Automatica , 2570 - 2576
27. 27)
  - Z. Wang , J. Lam , X. Liu . Nonlinear filtering for state delayed systems with Markovian switching. IEEE Trans. Signal Process. , 9 , 2321 - 2328
28. 28)
  - G. Yin , Q. Zhang . (1996) Recent advances in control and optimization of manufacturing system.
29. 29)
  - S.P. Sethi , Q. Zhang . (1994) Hierarchical decision making in stochastic manufacturing systems.
30. 30)
  - Abou-Kandkil, H., Smet, O.D., Freiling, G., Jank, G.: `Flow control in a failure-prone multi-machine manufacturing system', Proc. INRIA/IEEE Symp. Emerging Technologies and Factory Automation, October 1995, Paris, France, p. 575–583.
31. 31)
  - Zhang, L.X.: ` control of a class of piecewise homogeneous Markov jump linear systems', Proc. Seventh Asian Control Conf., August 2009, Hong Kong, China, p. 197–202.
32. 32)
  - Y. Zhang , Y. He , M. Wu , J. Zhang . Stabilization for Markovian jump systems with partial information on transition probability based on free-connection weighting matrices. Automatica , 1 , 79 - 84

Control and decision strategy for a class of Markovian jump systems in failure prone manufacturing process

Control and decision strategy for a class of Markovian jump systems in failure prone manufacturing process

Buy article PDF

Buy Knowledge Pack

Thank you

References

Related content