dc.contributor.author | Chen, Z | |
dc.contributor.author | Hu, J | |
dc.contributor.author | Min, G | |
dc.date.accessioned | 2019-03-04T11:15:17Z | |
dc.date.issued | 2019-07-15 | |
dc.description.abstract | Due to the ever-changing system states and various
user demands, resource allocation in cloud data center is faced
with great challenges in dynamics and complexity. Although
there are solutions that focus on this problem, they cannot
effectively respond to the dynamic changes of system states and
user demands since they depend on the prior knowledge of
the system. Therefore, it is still an open challenge to realize
automatic and adaptive resource allocation in order to satisfy
diverse system requirements in cloud data center. To cope
with this challenge, we propose an advantage actor-critic based
reinforcement learning (RL) framework for resource allocation
in cloud data center. First, the actor parameterizes the policy
(allocating resources) and chooses continuous actions (scheduling
jobs) based on the scores (evaluating actions) from the critic.
Next, the policy is updated by gradient ascent and the variance
of policy gradient can be significantly reduced with the advantage
function. Simulations using Google cluster-usage traces show the
effectiveness of the proposed method in cloud resource allocation.
Moreover, the proposed method outperforms classic resource
allocation algorithms in terms of job latency and achieves faster convergence speed than the traditional policy gradient method. | en_GB |
dc.identifier.citation | IEEE ICC-2019: IEEE International Conference on Communications, 20-24 May 2019, Shanghai, China | en_GB |
dc.identifier.doi | 10.1109/ICC.2019.8761309 | |
dc.identifier.uri | http://hdl.handle.net/10871/36224 | |
dc.language.iso | en | en_GB |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | en_GB |
dc.rights | © 2019 IEEE. | |
dc.subject | Resource allocation | en_GB |
dc.subject | reinforcement learning | en_GB |
dc.subject | cloud computing | en_GB |
dc.subject | actor-critic | en_GB |
dc.title | Learning-Based Resource Allocation in Cloud Data Center Using Advantage Actor-Critic | en_GB |
dc.type | Conference paper | en_GB |
dc.date.available | 2019-03-04T11:15:17Z | |
dc.description | This is the author accepted manuscript. The final version is available from IEEE via the DOI in this record. | en_GB |
dc.rights.uri | http://www.rioxx.net/licenses/all-rights-reserved | en_GB |
dcterms.dateAccepted | 2019-02-04 | |
rioxxterms.version | AM | en_GB |
rioxxterms.licenseref.startdate | 2019-02-04 | |
rioxxterms.type | Conference Paper/Proceeding/Abstract | en_GB |
refterms.dateFCD | 2019-03-01T13:27:51Z | |
refterms.versionFCD | AM | |
refterms.dateFOA | 2019-07-18T13:19:09Z | |
refterms.panel | B | en_GB |