LAPSE:2023.15147
Published Article

LAPSE:2023.15147
Autonomous Energy Management by Applying Deep Q-Learning to Enhance Sustainability in Smart Tourism Cities
March 2, 2023
Abstract
Autonomous energy management is becoming a significant mechanism for attaining sustainability in energy management. This resulted in this research paper, which aimed to apply deep reinforcement learning algorithms for an autonomous energy management system of a microgrid. This paper proposed a novel microgrid model that consisted of a combustion set of a household load, renewable energy, an energy storage system, and a generator, which were connected to the main grid. The proposed autonomous energy management system was designed to cooperate with the various flexible sources and loads by defining the priority resources, loads, and electricity prices. The system was implemented by using deep reinforcement learning algorithms that worked effectively in order to control the power storage, solar panels, generator, and main grid. The system model could achieve the optimal performance with near-optimal policies. As a result, this method could save 13.19% in the cost compared to conducting manual control of energy management. In this study, there was a focus on applying Q-learning for the microgrid in the tourism industry in remote areas which can produce and store energy. Therefore, we proposed an autonomous energy management system for effective energy management. In future work, the system could be improved by applying deep learning to use energy price data to predict the future energy price, when the system could produce more energy than the demand and store it for selling at the most appropriate price; this would make the autonomous energy management system smarter and provide better benefits for the tourism industry. This proposed autonomous energy management could be applied to other industries, for example businesses or factories which need effective energy management to maintain microgrid stability and also save energy.
Autonomous energy management is becoming a significant mechanism for attaining sustainability in energy management. This resulted in this research paper, which aimed to apply deep reinforcement learning algorithms for an autonomous energy management system of a microgrid. This paper proposed a novel microgrid model that consisted of a combustion set of a household load, renewable energy, an energy storage system, and a generator, which were connected to the main grid. The proposed autonomous energy management system was designed to cooperate with the various flexible sources and loads by defining the priority resources, loads, and electricity prices. The system was implemented by using deep reinforcement learning algorithms that worked effectively in order to control the power storage, solar panels, generator, and main grid. The system model could achieve the optimal performance with near-optimal policies. As a result, this method could save 13.19% in the cost compared to conducting manual control of energy management. In this study, there was a focus on applying Q-learning for the microgrid in the tourism industry in remote areas which can produce and store energy. Therefore, we proposed an autonomous energy management system for effective energy management. In future work, the system could be improved by applying deep learning to use energy price data to predict the future energy price, when the system could produce more energy than the demand and store it for selling at the most appropriate price; this would make the autonomous energy management system smarter and provide better benefits for the tourism industry. This proposed autonomous energy management could be applied to other industries, for example businesses or factories which need effective energy management to maintain microgrid stability and also save energy.
Record ID
Keywords
autonomous energy, deep Q-learning, energy management, Renewable and Sustainable Energy, smart city, smart tourism
Subject
Suggested Citation
Suanpang P, Jamjuntr P, Jermsittiparsert K, Kaewyong P. Autonomous Energy Management by Applying Deep Q-Learning to Enhance Sustainability in Smart Tourism Cities. (2023). LAPSE:2023.15147
Author Affiliations
Suanpang P: Faculty of Science and Technology, Suan Dusit University, Bangkok 10300, Thailand
Jamjuntr P: Computer Engineering Department, King Mongkut’s University of Technology Thonburi, Bangkok 10140, Thailand
Jermsittiparsert K: Faculty of Education, University of City Island, 9945 Famagusta, Cyprus; Faculty of Social and Political Sciences, Universitas Muhammadiyah Sinjai, Kabupaten Sinjai 92615, Sulawesi Selatan, Indonesia; Faculty of Social and Political Sciences, Universitas [ORCID]
Kaewyong P: Faculty of Science and Technology, Suan Dusit University, Bangkok 10300, Thailand
Jamjuntr P: Computer Engineering Department, King Mongkut’s University of Technology Thonburi, Bangkok 10140, Thailand
Jermsittiparsert K: Faculty of Education, University of City Island, 9945 Famagusta, Cyprus; Faculty of Social and Political Sciences, Universitas Muhammadiyah Sinjai, Kabupaten Sinjai 92615, Sulawesi Selatan, Indonesia; Faculty of Social and Political Sciences, Universitas [ORCID]
Kaewyong P: Faculty of Science and Technology, Suan Dusit University, Bangkok 10300, Thailand
Journal Name
Energies
Volume
15
Issue
5
First Page
1906
Year
2022
Publication Date
2022-03-04
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en15051906, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.15147
This Record
External Link

https://doi.org/10.3390/en15051906
Publisher Version
Download
Meta
Record Statistics
Record Views
290
Version History
[v1] (Original Submission)
Mar 2, 2023
Verified by curator on
Mar 2, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.15147
Record Owner
Auto Uploader for LAPSE
Links to Related Works
