access icon free Time optimisation problem for switched stochastic systems with multi-switching times

In this study, a time optimisation problem is solved for a class of linear time-invariant switched stochastic systems with multi-switching times using the calculus of variations. The objective of authors’ study is to minimise a cost functional defined on the system state, where the sequence of active subsystems is pre-specified and the switching times are the only control variables. The gradient of the cost functional with respect to the switching times is derived, which has an especially simple form and can be directly used in gradient descent algorithms to locate the optimal switching instants. The proposed method is applied on a two-tank system, which is a practical example of switched systems. Combining with another numerical example with three switching times case, the viability of the proposed method is further demonstrated.

Inspec keywords: switching theory; stochastic systems; gradient methods

Other keywords: control variables; multiswitching times; time optimisation problem; optimal switching instants; variations; cost functional; two-tank system; gradient descent algorithms; calculus; active subsystems; linear time-invariant switched stochastic systems; switched systems

Subjects: Optimisation techniques; Switching theory; Time-varying control systems

References

    1. 1)
    2. 2)
      • 20. Pola, G., Bujorianu, M.L., Lygeros, J., Benedetto, M.D.D.: ‘Stochastic hybrid models: an overview with application to air traffic management’. Proc. IFAC Conf. on Analysis and Design of Hybrid Systems, June 2003, pp. 4550.
    3. 3)
    4. 4)
    5. 5)
    6. 6)
    7. 7)
      • 13. Xu, X.P., Antsaklis, P.J.: ‘A dynamic programming approach for optimal control of switched systems’. Proc. IEEE Conf. on Decision and Control, Sydney, Australia, December 2000, pp. 18221827.
    8. 8)
    9. 9)
      • 36. Stursberg, O., Engell, S.: ‘Optimal control of switched continuous systems using mixed-integer programming’. Proc. IFAC World Congress Automatic Control, Barcelona, Spain, July 2002, pp. 558558.
    10. 10)
    11. 11)
    12. 12)
    13. 13)
    14. 14)
    15. 15)
    16. 16)
      • 27. Åström, K.J.: ‘Introduction to stochastic control theory’ (Academic Press, New York, 1970).
    17. 17)
      • 12. Xu, X.P., Antsaklis, P.J.: ‘Optimal control of switched systems: new results and open problems’. Proc. American Control Conf., Chicago, Illinois, June 2000, pp. 26832687.
    18. 18)
    19. 19)
    20. 20)
      • 35. Polak, E.: ‘Optimization algorithms and consistent approximations’ (Springer-Verlag Press’, New York, 1997).
    21. 21)
      • 37. Mahboubi, H., Moshiri, B., Khaki Seddigh, A.: ‘Hybrid modeling and optimal control of a two-tank system as a switched system’, World Acad. Sci. Eng. Tech., 2007, 1, (11), pp. 789803.
    22. 22)
    23. 23)
    24. 24)
      • 31. Oksendal, B.: ‘Stochastic differential equations – an introduction with applications’ (Springer-Verlag, Berlin, 2003, 6th edn.).
    25. 25)
    26. 26)
      • 10. Le Ny, J., Feron, E., Pappas, G.J.: ‘Resource constrained LQR control under fast sampling’. Proc. Int. Conf. on Hybrid Systems: Computation and Control, Chicago, USA, April 2011, pp. 271280.
    27. 27)
      • 34. Khasminskii, R.: ‘Stochastic stability of differential equations’ (Springer, 2012).
    28. 28)
    29. 29)
    30. 30)
    31. 31)
      • 16. Xu, X.P., Antsaklis, P.J.: ‘Optimal control of switched autonomous systems’. Proc. IEEE Conf. on Decision and Control, Las Vegas, Nevada, USA, December 2002, pp. 44014406.
    32. 32)
      • 15. Xu, X.P., Antsaklis, P.J.: ‘An approach to switched systems optimal control based on parameterization of the switching instants’. Proc. Int. Federation of Automatic Control, Barcelona, Spain, July 2002, p. 308.
    33. 33)
      • 17. Egerstedt, M., Wardi, Y., Delmotte, F.: ‘Optimal control of switching times in switched dynamical systems’. Proc. IEEE Conf. on Decision Control, Maui, Hawaii, December 2003, pp. 21382143.
    34. 34)
    35. 35)
    36. 36)
    37. 37)
      • 39. Majdoub, N., Sakly, A., Benrejeb, M.: ‘Hybrid approach compared to gradient method for optimal control problem of hydraulic system’, Int. J. Res. Rev. Appl. Sci., 2012, 10, (2), pp. 200214.
    38. 38)
    39. 39)
      • 29. Koutsoukos, X.D.: ‘Optimal control of stochastic hybrid systems based on locally consistent Markov decision processes’. Proc. IEEE Int. Symp. on Intelligent Control, Mediterrean Conf. on Control and Automation, Limassol, Cyprus, June 2005, pp. 435440.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cta.2014.0053
Loading

Related content

content/journals/10.1049/iet-cta.2014.0053
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading