access icon free Markov decision process-based routing algorithm in hybrid Satellites/UAVs disruption-tolerant sensing networks

Recently, a hybrid remote sensing network constituted by satellites in constellation and Unmanned Aerial Vehicles (UAVs) in formation attracts a lot of interests, benefiting from the flexible architecture and excellent rapid responsiveness. Considering frequently intermittent connectivity and limited resource onboard, Disruption-Tolerant Networking (DTN) develops a feasible solution for the remote sensing scenarios. However, the intrinsic motion models of multifarious nodes lead to deterministic or semi-deterministic contacts, which makes finding a reliable end-to-end routing path for timely data delivery difficult, with typical routing strategies such as Contact Graph Routing (CGR). To cope with such routing challenge in the hybrid network, a Probabilistic Contact Graph (PCG) is designed, taking the diverse node properties into consideration. In particular, a probability prediction model for semi-deterministic contacts between the UAV nodes is proposed, with a semi-Markov motion model for the UAV nodes. Besides, a Markov Decision Process based Routing (MDPR) algorithm is designed to search for a feasible data transmission path with a series of hybrid deterministic and semi-deterministic contacts. Through the numerical and experimental simulations with Interplanetary Overlay Network (ION), the proposed MDPR algorithm shows excellent routing performance concerning delivery delay and delivery ratio, compared with the typical CGR strategy.

Inspec keywords: Markov processes; autonomous aerial vehicles; satellite communication; remote sensing; probability; telecommunication network routing; overlay networks; graph theory; telecommunication network reliability; delay tolerant networks; numerical analysis; decision theory

Other keywords: interplanetary overlay network; hybrid remote sensing network; semiMarkov motion model; diverse node properties; limited resource onboard disruption-tolerant networking; experimental simulations; hybrid deterministic-semideterministic contacts; remote sensing scenarios; intrinsic motion models; delivery ratio; probabilistic contact graph; MDPR algorithm; flexible architecture; multifarious nodes; numerical simulations; deterministic contacts; hybrid network; Markov decision process-based routing algorithm; UAV nodes; hybrid satellites-UAVs disruption-tolerant sensing networks; unmanned aerial vehicles; reliable end-to-end routing path; CGR strategy; data transmission path; feasible data transmission path; contact graph routing; probability prediction model; intermittent connectivity; delivery delay

Subjects: Game theory; Reliability; Markov processes; Combinatorial mathematics; Communication network design, planning and routing; Other numerical methods; Satellite communication systems

References

    1. 1)
      • 10. Yang, Z., Zhang, Q., Wang, R., et al: ‘On storage dynamics of space delay/disruption tolerant network node’, Wirel. Netw., 2014, 20, (8), pp. 25292541.
    2. 2)
      • 2. Skinnemoen, H.: ‘UAV & satellite communications live mission-critical visual data’. IEEE Int. Conf. on Aerospace Electronics and Remote Sensing Technology, Bali, Indonesia, December 2015, pp. 1219.
    3. 3)
      • 19. Meshgi, H., Zhao, D.: ‘Opportunistic scheduling for a two-way relay network using Markov decision process’, IET Commun., 2016, 10, (14), pp. 18461854.
    4. 4)
      • 5. Gormally, J.M., Richards, R.L.: ‘Application layer protocols for disruption tolerant remote sensor SATCOM links’. Military Communications Conf., Baltimore, USA, October 2014, pp. 975982.
    5. 5)
      • 16. Segui, J., Jennings, E., Burleigh, S.: ‘Enhancing contact graph routing for delay tolerant space networking’. Global Telecommunications Conf., Houston, USA, December 2011, pp. 16.
    6. 6)
      • 3. Marchese, M., Patrone, F., Cello, M.: ‘DTN-based nanosatellite architecture and hot spot selection algorithm for remote areas connection’, IEEE Trans. Veh. Technol., 2018, 67, (1), pp. 115.
    7. 7)
      • 12. Albuquerque, J.C.D., Lucena, S.C.D., Campos, C.A.V.: ‘Evaluating data communications in natural disaster scenarios using opportunistic networks with unmanned aerial vehicles’. IEEE Int. Conf. on Intelligent Transportation Systems, Rio de Janeiro, Brazil, November 2016, pp. 14521457.
    8. 8)
      • 17. Wang, G., Burleigh, S.C., Wang, R., et al: ‘Scoping contact graph-routing scalability: investigating the systemś usability in space-vehicle communication networks’, IEEE Veh. Technol. Mag., 2016, 11, (4), pp. 4652.
    9. 9)
      • 14. Yuan, P., Yang, Z., Li, Y., et al: ‘An event-driven graph-based min-cost delivery algorithm in earth observation DTN networks’. Int. Conf. on Wireless Communications & Signal Processing, Nanjing, China, October 2015, pp. 16.
    10. 10)
      • 9. Caini, C., Firrincieli, R.: ‘Application of contact graph routing to LEO satellite DTN communications’. IEEE Int. Conf. on Communications, Ottawa, Canada, June 2012, pp. 33013305.
    11. 11)
      • 13. Zhang, W., Zhang, G., Xie, Z., et al: ‘A hierarchical autonomous system based space information network architecture and topology control’, J. Commun. Inf. Netw., 2016, 1, (3), pp. 7789.
    12. 12)
      • 11. Shi, L., Jiao, J., Sabbagh, A., et al: ‘Integration of Reed–Solomon codes to licklider transmission protocol (LTP) for space DTN’, IEEE Aerosp. Electron. Syst. Mag., 2017, 32, (4), pp. 4855.
    13. 13)
      • 8. Jiang, F., Yang, Z., Li, Y.: ‘Disruption-resilient bundle delivery mechanism in space DTNs with partial segments aggregation’, IET Commun., 2016, 10, (13), pp. 16461654.
    14. 14)
      • 1. Matese, A., Toscano, P., Gennaro, S.D., et al: ‘Intercomparison of UAV, aircraft and satellite remote sensing platforms for precision viticulture’, Remote Sens., 2015, 7, (3), pp. 29712990.
    15. 15)
      • 6. Araniti, G., Bezirgiannidis, N., Birrane, E., et al: ‘Contact graph routing in DTN space networks: overview, enhancements and performance’, IEEE Commun. Mag., 2015, 53, (3), pp. 3846.
    16. 16)
      • 25. Mesbahi, N., Dahmouni, H.: ‘Analytical framework for the characterization of the link properties in multi-hop mobile wireless networks’, Ad Hoc Netw., 2016, 58, pp. 127137.
    17. 17)
      • 7. Aung, C.Y., Ho, W.H., Chong, P.H.J.: ‘Store-carry-cooperative forward routing with information epidemics control for data delivery in opportunistic networks’, IEEE Access, 2017, 5, (99), pp. 66086625.
    18. 18)
      • 18. Puterman, M.L.: ‘Markov decision processes: discrete stochastic dynamic programming’ (John Wiley & Sons Inc., Hoboken, NJ, 1994, 1st edn.).
    19. 19)
      • 22. Luo, D., Zhou, T., Wu, S.: ‘Obstacle avoidance and formation regrouping strategy and control for UAV formation flight’. IEEE Int. Conf. on Control and Automation, Hang Zhou, China, June 2013, pp. 19211926.
    20. 20)
      • 24. Zhao, M., Wang, W.: ‘A novel semi-markov smooth mobility model for mobile ad hoc networks’. Global Telecommunications Conf., San Francisco, USA, November 2006, pp. 15.
    21. 21)
      • 23. Jia, S., Zhang, L.: ‘Modelling unmanned aerial vehicles base station in ground-to-air cooperative networks’, IET Commun., 2017, 11, (8), pp. 11871194.
    22. 22)
      • 20. Li, Y., Ye, W., Yuan, P., et al: ‘Markov decision based optimization on bundle size for satellite DTN links’, IET Commun., 2018, 12, (9), pp. 10481054.
    23. 23)
      • 15. Qi, W., Hou, W., Guo, L., et al: ‘A unified routing framework for integrated space/air information networks’, IEEE Access, 2017, 4, pp. 70847103.
    24. 24)
      • 26. Bezirgiannidis, N., Burleigh, S., Tsaoussidis, V.: ‘Delivery time estimation for space bundles’, IEEE Trans. Aerosp. Electron. Syst., 2013, 49, (3), pp. 18971910.
    25. 25)
      • 4. Vahidi, V., Yazdanpanah, A.P., Saberinia, E., et al: ‘Channel estimation, equalisation, and evaluation for high-mobility airborne hyperspectral data transmission’, IET Commun., 2016, 10, (18), pp. 26562662.
    26. 26)
      • 21. Shi, W., Gao, D., Zhou, H., et al: ‘Traffic aware inter-layer contact selection for multi-layer satellite terrestrial network’. IEEE Global Communications Conf., Singapore, Singapore, December 2018, pp. 17.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-com.2018.5932
Loading

Related content

content/journals/10.1049/iet-com.2018.5932
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading