access icon openaccess Bilayer game strategy of regional integrated energy system under multi-agent incomplete information

This is an open access article published by the IET under the Creative Commons Attribution-NoDerivs License (http://creativecommons.org/licenses/by-nd/3.0/)
Received 24/08/2018, Accepted 19/09/2018, Published 23/10/2018

In view of the high coupling degree of regional integrated energy system, a bilayer interaction strategy, consisting of energy suppliers, distribution networks, and users, is proposed. Game interaction strategy includes two aspects: scheduling and bidding. The independent system operator (ISO) coordinates all adjustable resources. Depending on the quotation price and multi-energy load prediction, ISO minimises the total energy cost, which realises the complementary of the multi-energy in the cooperative game. Under the assumption of incomplete information and bounded rationality, this study designs bidding functions and pay-as-bid settlement protocols. On this basis, according to history scheduling data and units’ characteristics, agents for energy suppliers pursue maximum interests. Also, the non-cooperative bidding process in multi-energy market is simulated by using Q-learning algorithm. Finally, the evolutionary process of the bilayer competitive game model is studied by practical example, and the existence local Nash equilibrium of the strategy is also proven.

Inspec keywords: pricing; learning (artificial intelligence); evolutionary computation; multi-agent systems; scheduling; power markets; tendering; game theory

Other keywords: history scheduling data; bilayer competitive game model; high coupling degree; local Nash equilibrium; multiagent incomplete information; evolutionary process; quotation price; total energy cost minimization; pay-as-bid settlement protocols; scheduling; ISO coordinates; regional integrated energy system; bidding functions; bounded rationality; independent system operator; bilayer interaction strategy; distribution networks; Q-learning algorithm; game interaction strategy; energy suppliers; bilayer game strategy; multienergy market; unit characteristics; multienergy load prediction; noncooperative bidding process

Subjects: Game theory; Power system management, operation and economics; Optimisation techniques

References

    1. 1)
      • 5. Rashedi, N., Tajeddini, M.A., Kebriaei, H.: ‘Markov game approach for multi-agent competitive bidding strategies in electricity market’, IET Gener. Transm. Distrib., 2016, 10, (15), pp. 3756–3763.
    2. 2)
      • 21. Ruan, W., Wang, B., Li, Y., et al: ‘Study on user response behavior under TOU price’, Power Grid Technol., 2012, 36, (7), pp. 86–93.
    3. 3)
      • 2. Wu, J.: ‘The driving force and current situation of European integrated energy system development’, Autom. Electr. Power Syst., 2016, 40, (5), pp. 1–7.
    4. 4)
      • 10. Zhou, R., Ran, X., Mao, J., et al: ‘Coordinated optimization of energy saving for distributed CCHP system’, Power Syst. Technol., 2012, 36, (6), pp. 8–14.
    5. 5)
      • 16. Huang, X., Guo, R.: ‘A multi-agent model for power planning in power market environment’, Power Syst. Prot. Control, 2016, 44, (24), pp. 1–8.
    6. 6)
      • 13. Herrando, M., Markides, C.N., Hellgardt, K.: ‘A UK-based assessment of hybrid PV and solar-thermal systems for domestic heating and power: system performance’, Appl. Energy, 2014, 122, pp. 288–309.
    7. 7)
      • 3. Yu, X., Xu, X., Chen, S., et al: ‘A brief overview of the integrated energy system and energy internet’, Trans. China Electrotech. Soc., 2016, 31, (1), pp. 1–13.
    8. 8)
      • 7. Lu, Q., Chen, L., Mei, S.: ‘Typical applications and prospects of game theory in power system’, Proc. CSEE, 2014, 34, (29), pp. 5009–5017.
    9. 9)
      • 23. Ragupathi, R., Das, T.K.: ‘A stochastic game approach for modeling wholesale energy bidding in deregulated power market’, IEEE Trans. Power Syst., 2004, 19, (2), pp. 849–856.
    10. 10)
      • 20. Tang, W., Jain, R.: ‘Dynamic economic dispatch game: the value of storage’, IEEE Trans. Smart Grid, 2016, 7, (5), pp. 2350–2358.
    11. 11)
      • 8. Mei, S.: ‘Engineering game theory and application of power system’ (Science Press, Beijing, 2016), pp. 178–191.
    12. 12)
      • 15. Tian, J., Hu, Z., Wu, J., et al: ‘Economic power dynamic simulation system based on multi-agent modeling’, Proc. CSEE, 2010, 30, (7), pp. 85–91.
    13. 13)
      • 19. Zhou, Z., Zhao, F., Wang, J.: ‘Agent-based electricity market simulation with demand response from commercial buildings’, IEEE Trans. Smart Grid, 2011, 2, (4), pp. 580–588.
    14. 14)
      • 6. Wang, S.: ‘Generator bidding strategy based on Q learning algorithm on the day-ahead market’, Energy Technol. Econ., 2010, 22, (3), pp. 34–39.
    15. 15)
      • 22. Gajjar, G.R., Khaparde, S.A., Nagaraju, P.: ‘Application of actor-critic learning algorithm for optimal bidding problem of a Genco’, IEEE Trans. Power Syst., 2003, 18, (1), pp. 11–18.
    16. 16)
      • 9. Moghaddam, I.G., Saniei, M., Mashhour, E.: ‘A comprehensive model for self-scheduling an energy hub to supply cooling, heating and electrical demands of a building’, Energy, 2016, 94, pp. 157–170.
    17. 17)
      • 1. Jia, H., Wang, D., Xu, X., et al: ‘Research on some key problems related to integrated energy systems’, Autom. Electr. Power Syst., 2015, 38, (7), pp. 198–207.
    18. 18)
      • 14. Duan, W., Hu, Z., Wu, S., et al: ‘Economic policy dynamic simulation of power demand based on agent response equilibrium model’, Proc. CSEE, 2014, 34, (7), pp. 1206–1212.
    19. 19)
      • 17. Dehghanpour, K., Nehrir, M.H., Sheppard, J.W., et al: ‘Agent-based modeling in electrical energy markets using dynamic Bayesian networks’, IEEE Trans. Power Syst., 2016, 31, (6), pp. 4744–4754.
    20. 20)
      • 18. Neshat, N., Amin-Naseri, M.R.: ‘Cleaner power generation through market-driven generation expansion planning: an agent-based hybrid framework of game theory and particle swarm optimization’, J. Clean Prod., 2014, 105, pp. 206–217.
    21. 21)
      • 11. Gu, Z., Kang, C., Chen, X., et al: ‘Operation optimization of integrated power and heat energy systems and the benefit on wind power considering heating network constraints’, Proc. CSEE, 2015, 35, (14), pp. 3596–3604.
    22. 22)
      • 4. Wang, W., Wan, D., Jia, H., et al: ‘Overview of steady state analysis of typical regional comprehensive energy system under the background of energy internet’, Proc. CSEE, 2016, 36, (12), pp. 3292–3305.
    23. 23)
      • 12. Gu, W., Wang, J., Lu, S., et al: ‘Optimal operation for integrated energy system considering thermal inertia of district heating network and buildings’, Appl. Energy, 2017, 199, pp. 234–246.
http://iet.metastore.ingenta.com/content/journals/10.1049/joe.2018.8571
Loading

Related content

content/journals/10.1049/joe.2018.8571
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading