© The Institution of Engineering and Technology
This study investigates control and decision strategy for the failure prone manufacturing process, which is modelled as a twomode Markovian jump system (MJS). Considering the historical effects on the system, the mode transition rate matrix (MTRM) is timevarying instead of homogeneous. A piecewise homogeneous MJS is thus proposed to characterise this phenomenon, in which the MTRM is homogeneous during certain time intervals but nonhomogeneous for the whole time interval. By regarding each homogeneous MTRM as one event, all the MTRMs over the whole time interval will take values in an event set and be governed by a higherlevel Markov chain. To ensure such system operates normally with high probability, the decisions including preventive maintenance and corrective maintenance are introduced to adjust the higherlevel Markov chain. Motivated by this, a new joint performance, consisting of both cost function for decision making and controller design, is developed. Optimal decisions are obtained by an iterative algorithm whose convergence is proved, as well as an optimal controller is designed. The effectiveness of this method is demonstrated by simulations.
References


1)

C.G. Cassandras ,
S. Lafortune
.
(1999)
Introduction to discrete event systems.

2)

M. Mariton
.
(1990)
Jump linear systems in automatic control.

3)

Y. Ji ,
H.J. Chizeck
.
Controllability, stabilisability, and continuoustime Markovian jump linear quadratic control.
IEEE Trans. Autom. Control
,
777 
788

4)

X.R. Mao ,
J. Lam ,
S.Y. Xu ,
H.J. Gao
.
Razumikhin method and exponential stability of hybrid stochastic delay interval systems.
J. Math. Anal. Appl.
,
1 ,
45 
66

5)

P. Shi ,
E.K. Boukas ,
R.K. Agarwal
.
Kalman filtering for continuoustime uncertain systems with markovian jumping parameters.
IEEE Trans. Autom. Control
,
8 ,
1592 
1597

6)

Z. Wang ,
J. Lam ,
X. Liu
.
Nonlinear filtering for state delayed systems with Markovian switching.
IEEE Trans. Signal Process.
,
9 ,
2321 
2328

7)

X.R. Mao ,
J. Lam ,
L.R. Huang
.
Stabilisation of hybrid stochastic differential equations by delay feedback control.
Syst. Control Lett.
,
11 ,
927 
935

8)

P. Shi ,
E.K. Boukas ,
K. Agarwal
.
Control of Markovian jump discretetime systems with norm bounded uncertainty and unknown delay.
IEEE Trans. Autom. Control
,
11 ,
2139 
2144

9)

E.K. Boukas ,
P. Shi ,
K. Benjelloun
.
On stabilization of uncertain systems with jump parameters.
Int. J. Control
,
9 ,
842 
850

10)

J.L. Xiong ,
J. Lam ,
H.J. Gao
.
On robust stabilization of Markovian jump systems with uncertain switching probabilities.
Automatica
,
897 
903

11)

Y. Zhang ,
Y. He ,
M. Wu ,
J. Zhang
.
Stabilization for Markovian jump systems with partial information on transition probability based on freeconnection weighting matrices.
Automatica
,
1 ,
79 
84

12)

M. Karan ,
P. Shi ,
C.Y. Koya
.
Transition probability bounds for the stochastic stability robustness of continuous and discretetime Markovian jump linear systems.
Automatica
,
2159 
2168

13)

Y. Cao ,
J. Lam
.
Robust H∞ control of uncertain Markovian jump systems with timedelay.
IEEE Trans. Autom. Control
,
1 ,
77 
83

14)

L. Zhang ,
E. Boukas ,
J. Lam
.
Analysis and synthesis of Markov jump linear systems with timevarying delays and partially known transition probabilities.
IEEE Trans. Automat. Control
,
10 ,
2458 
2464

15)

Zhang, L.X.: ` control of a class of piecewise homogeneous Markov jump linear systems', Proc. Seventh Asian Control Conf., August 2009, Hong Kong, China, p. 197–202.

16)

L.X. Zhang
.
H∞ estimation for discretetime piecewise homogeneous Markov jump linear systems.
Automatica
,
2570 
2576

17)

Y. Xia ,
M. Fu ,
P. Shi ,
Z. Wu ,
J. Zhang
.
Adaptive backstepping controller design for stochastic jump systems.
IEEE Trans. Autom. Control
,
12 ,
2853 
2859

18)

L. Tong ,
A.G. Wu ,
G.R. Duan
.
Finite iterative algorithm for solving coupled Lyapunov equations appearing in discretetime Markov jump linear systems.
IET Control Theory Appl.
,
10 ,
2223 
2231

19)

D.W. Stroock
.
(2005)
An introduction to Markov processes.

20)

T. Kirrubarajan ,
Y. BarShalom ,
K.R. Pattipati ,
I. Kadar
.
Ground target tracking with variable structure IMM estimator.
IEEE Trans. Aerosp. Electron. Syst.
,
1 ,
26 
46

21)

J. Zhu ,
H.S. Xi ,
H.B. Ji ,
B. Wang
.
Robust adaptive tracking for Markovian jump nonlinear systems with unknown nonlinearities.
Discret. Dyn. Nat. Soc.

22)

P.A. Kawka ,
A.G. Alleyne
.
Robust wireless servo control using a discretetime uncertain Markovian jump linear model.
IEEE Trans. Control Syst. Technol.
,
3 ,
733 
742

23)

J. Xiong ,
J. Lam
.
Stabilization of linear systems over networks with bounded packet loss.
Automatica
,
1 ,
80 
87

24)

AbouKandkil, H., Smet, O.D., Freiling, G., Jank, G.: `Flow control in a failureprone multimachine manufacturing system', Proc. INRIA/IEEE Symp. Emerging Technologies and Factory Automation, October 1995, Paris, France, p. 575–583.

25)

E.K. Boukas ,
Z.K. Liu
.
Production and maintenance control for manufacturing systems.
IEEE Trans. Autom. Control
,
9 ,
1455 
1460

26)

B. Tan ,
S.B. Gershwin
.
Analysis of a general Markovian twostage continuousflow production system with a finite buffer.
Int. J. Prod. Econ.
,
2 ,
327 
339

27)

F. Tao ,
Q. Zhao
.
Synthesis of active faulttolerant control based on Markovian jump system models.
IET Control Theory Appl.
,
4 ,
1160 
1168

28)

Z. Mao ,
B. Jiang ,
P. Shi
.
H∞ fault detection filter design for networked control systems modelled by discrete Markovian jump systems.
IET Control Theory Appl.
,
8 ,
675 
681

29)

S.P. Sethi ,
Q. Zhang
.
(1994)
Hierarchical decision making in stochastic manufacturing systems.

30)

G. Yin ,
Q. Zhang
.
(1996)
Recent advances in control and optimization of manufacturing system.

31)

D.P. Bertsekas
.
(1999)
Nonlinear programming.

32)

F. Martinelli
.
Manufacturing systems with a production dependent failure rate: structure of optimality.
IEEE Trans. Autom. Control
,
10 ,
2401 
2406
http://iet.metastore.ingenta.com/content/journals/10.1049/ietcta.2011.0302
Related content
content/journals/10.1049/ietcta.2011.0302
pub_keyword,iet_inspecKeyword,pub_concept
6
6