© The Institution of Engineering and Technology
This study investigates control and decision strategy for the failure prone manufacturing process, which is modelled as a twomode Markovian jump system (MJS). Considering the historical effects on the system, the mode transition rate matrix (MTRM) is timevarying instead of homogeneous. A piecewise homogeneous MJS is thus proposed to characterise this phenomenon, in which the MTRM is homogeneous during certain time intervals but nonhomogeneous for the whole time interval. By regarding each homogeneous MTRM as one event, all the MTRMs over the whole time interval will take values in an event set and be governed by a higherlevel Markov chain. To ensure such system operates normally with high probability, the decisions including preventive maintenance and corrective maintenance are introduced to adjust the higherlevel Markov chain. Motivated by this, a new joint performance, consisting of both cost function for decision making and controller design, is developed. Optimal decisions are obtained by an iterative algorithm whose convergence is proved, as well as an optimal controller is designed. The effectiveness of this method is demonstrated by simulations.
References


1)

M. Mariton
.
(1990)
Jump linear systems in automatic control.

2)

F. Tao ,
Q. Zhao
.
Synthesis of active faulttolerant control based on Markovian jump system models.
IET Control Theory Appl.
,
4 ,
1160 
1168

3)

J. Zhu ,
H.S. Xi ,
H.B. Ji ,
B. Wang
.
Robust adaptive tracking for Markovian jump nonlinear systems with unknown nonlinearities.
Discret. Dyn. Nat. Soc.

4)

J. Xiong ,
J. Lam
.
Stabilization of linear systems over networks with bounded packet loss.
Automatica
,
1 ,
80 
87

5)

P.A. Kawka ,
A.G. Alleyne
.
Robust wireless servo control using a discretetime uncertain Markovian jump linear model.
IEEE Trans. Control Syst. Technol.
,
3 ,
733 
742

6)

X.R. Mao ,
J. Lam ,
S.Y. Xu ,
H.J. Gao
.
Razumikhin method and exponential stability of hybrid stochastic delay interval systems.
J. Math. Anal. Appl.
,
1 ,
45 
66

7)

P. Shi ,
E.K. Boukas ,
R.K. Agarwal
.
Kalman filtering for continuoustime uncertain systems with markovian jumping parameters.
IEEE Trans. Autom. Control
,
8 ,
1592 
1597

8)

E.K. Boukas ,
P. Shi ,
K. Benjelloun
.
On stabilization of uncertain systems with jump parameters.
Int. J. Control
,
9 ,
842 
850

9)

D.W. Stroock
.
(2005)
An introduction to Markov processes.

10)

Y. Cao ,
J. Lam
.
Robust H∞ control of uncertain Markovian jump systems with timedelay.
IEEE Trans. Autom. Control
,
1 ,
77 
83

11)

T. Kirrubarajan ,
Y. BarShalom ,
K.R. Pattipati ,
I. Kadar
.
Ground target tracking with variable structure IMM estimator.
IEEE Trans. Aerosp. Electron. Syst.
,
1 ,
26 
46

12)

X.R. Mao ,
J. Lam ,
L.R. Huang
.
Stabilisation of hybrid stochastic differential equations by delay feedback control.
Syst. Control Lett.
,
11 ,
927 
935

13)

F. Martinelli
.
Manufacturing systems with a production dependent failure rate: structure of optimality.
IEEE Trans. Autom. Control
,
10 ,
2401 
2406

14)

J.L. Xiong ,
J. Lam ,
H.J. Gao
.
On robust stabilization of Markovian jump systems with uncertain switching probabilities.
Automatica
,
897 
903

15)

M. Karan ,
P. Shi ,
C.Y. Koya
.
Transition probability bounds for the stochastic stability robustness of continuous and discretetime Markovian jump linear systems.
Automatica
,
2159 
2168

16)

Z. Mao ,
B. Jiang ,
P. Shi
.
H∞ fault detection filter design for networked control systems modelled by discrete Markovian jump systems.
IET Control Theory Appl.
,
8 ,
675 
681

17)

P. Shi ,
E.K. Boukas ,
K. Agarwal
.
Control of Markovian jump discretetime systems with norm bounded uncertainty and unknown delay.
IEEE Trans. Autom. Control
,
11 ,
2139 
2144

18)

Y. Ji ,
H.J. Chizeck
.
Controllability, stabilisability, and continuoustime Markovian jump linear quadratic control.
IEEE Trans. Autom. Control
,
777 
788

19)

L. Zhang ,
E. Boukas ,
J. Lam
.
Analysis and synthesis of Markov jump linear systems with timevarying delays and partially known transition probabilities.
IEEE Trans. Automat. Control
,
10 ,
2458 
2464

20)

Y. Xia ,
M. Fu ,
P. Shi ,
Z. Wu ,
J. Zhang
.
Adaptive backstepping controller design for stochastic jump systems.
IEEE Trans. Autom. Control
,
12 ,
2853 
2859

21)

C.G. Cassandras ,
S. Lafortune
.
(1999)
Introduction to discrete event systems.

22)

B. Tan ,
S.B. Gershwin
.
Analysis of a general Markovian twostage continuousflow production system with a finite buffer.
Int. J. Prod. Econ.
,
2 ,
327 
339

23)

E.K. Boukas ,
Z.K. Liu
.
Production and maintenance control for manufacturing systems.
IEEE Trans. Autom. Control
,
9 ,
1455 
1460

24)

L. Tong ,
A.G. Wu ,
G.R. Duan
.
Finite iterative algorithm for solving coupled Lyapunov equations appearing in discretetime Markov jump linear systems.
IET Control Theory Appl.
,
10 ,
2223 
2231

25)

D.P. Bertsekas
.
(1999)
Nonlinear programming.

26)

L.X. Zhang
.
H∞ estimation for discretetime piecewise homogeneous Markov jump linear systems.
Automatica
,
2570 
2576

27)

Z. Wang ,
J. Lam ,
X. Liu
.
Nonlinear filtering for state delayed systems with Markovian switching.
IEEE Trans. Signal Process.
,
9 ,
2321 
2328

28)

G. Yin ,
Q. Zhang
.
(1996)
Recent advances in control and optimization of manufacturing system.

29)

S.P. Sethi ,
Q. Zhang
.
(1994)
Hierarchical decision making in stochastic manufacturing systems.

30)

AbouKandkil, H., Smet, O.D., Freiling, G., Jank, G.: `Flow control in a failureprone multimachine manufacturing system', Proc. INRIA/IEEE Symp. Emerging Technologies and Factory Automation, October 1995, Paris, France, p. 575–583.

31)

Zhang, L.X.: ` control of a class of piecewise homogeneous Markov jump linear systems', Proc. Seventh Asian Control Conf., August 2009, Hong Kong, China, p. 197–202.

32)

Y. Zhang ,
Y. He ,
M. Wu ,
J. Zhang
.
Stabilization for Markovian jump systems with partial information on transition probability based on freeconnection weighting matrices.
Automatica
,
1 ,
79 
84
http://iet.metastore.ingenta.com/content/journals/10.1049/ietcta.2011.0302
Related content
content/journals/10.1049/ietcta.2011.0302
pub_keyword,iet_inspecKeyword,pub_concept
6
6