Electric Water Heaters Management via Reinforcement Learning with Time-Delay in Isolated Microgrids
dc.contributor.author | Xu, J | |
dc.contributor.author | Mahmood, H | |
dc.contributor.author | Xiao, H | |
dc.contributor.author | Anderlini, E | |
dc.contributor.author | Abusara, M | |
dc.date.accessioned | 2021-09-02T13:08:35Z | |
dc.date.issued | 2021-09-14 | |
dc.description.abstract | Isolatedmicrogridspoweredbyrenewable energy sources, battery storage, and backup diesel generators need appropriate demand response to utilize available energy and reduce diesel consumption efficiently. However, real-time demand-side management has become a significant challenge due to the communication time-delay issue. In this paper, a distributed model-free strategy is proposed to manage the demand of Electric Water Heater (EWH) units. The distributed artificial intelligence technology based on Reinforcement Learning (RL) is adopted to independently control the 150 EWHs using a virtual tariff. Two different strategies are proposed to generate the virtual tariff and they are compared to each other to investigate the impact of communication time-delay to the proposed RL algorithm in real-time control scenario. The first strategy is based on measuring the battery State of Charge (SOC) in real time while the second method is based on predicting the SOC 24-hours in advance using an Artificial Neural Network (ANN). The results show that the communication time-delay greatly influences the convergence result of the first method while the second method showed high immunity. The results also show that the proposed algorithm reduces the use of energy consumption by an average of 8.91%(6.675kW) for each EWH, which symbolizes the viability of the proposed approach. | en_GB |
dc.description.sponsorship | European Commission | en_GB |
dc.identifier.citation | Published online 14 September 2021 | en_GB |
dc.identifier.uri | http://hdl.handle.net/10871/126948 | |
dc.language.iso | en | en_GB |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | en_GB |
dc.rights | © 2021. Open access under a Creative Commons License: https://creativecommons.org/licenses/by/4.0/ | |
dc.subject | Energy storage | en_GB |
dc.subject | distributed control | en_GB |
dc.subject | reinforcement learning | en_GB |
dc.subject | electric water heaters | en_GB |
dc.subject | Q-learning | en_GB |
dc.subject | time-delay | en_GB |
dc.title | Electric Water Heaters Management via Reinforcement Learning with Time-Delay in Isolated Microgrids | en_GB |
dc.type | Article | en_GB |
dc.date.available | 2021-09-02T13:08:35Z | |
dc.identifier.issn | 2169-3536 | |
dc.description | This is the author accepted manuscript. The final version is available on open access from IEEE via the DOI in this record | en_GB |
dc.identifier.journal | IEEE Access | en_GB |
dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ | en_GB |
dcterms.dateAccepted | 2021-09-02 | |
exeter.funder | ::European Commission | en_GB |
rioxxterms.version | AM | en_GB |
rioxxterms.licenseref.startdate | 2021-09-02 | |
rioxxterms.type | Journal Article/Review | en_GB |
refterms.dateFCD | 2021-09-02T13:07:01Z | |
refterms.versionFCD | AM | |
refterms.dateFOA | 2021-09-17T14:43:29Z | |
refterms.panel | B | en_GB |
Files in this item
This item appears in the following Collection(s)
Except where otherwise noted, this item's licence is described as © 2021. Open access under a Creative Commons License: https://creativecommons.org/licenses/by/4.0/