We consider an auto-scaling technique in a cloud system where virtual machines hosted on a physical node are turned on and off depending on the queue's occupation (or thresholds), in order to minimise a global cost integrating both energy consumption and performance. We propose several efficient optimisation methods to find threshold values minimising this global cost: local search heuristics coupled with aggregation of Markov chain and with queues approximation techniques to reduce the execution time and improve the accuracy. The second approach tackles the problem with a Markov Decision Process (MDP) for which we proceed to a theoretical study and provide theoretical comparison with the first approach. We also develop structured MDP algorithms integrating hysteresis properties. We show that MDP algorithms (value iteration, policy iteration) and especially structured MDP algorithms outperform the devised heuristics, in terms of time execution and accuracy. Finally, we propose a cost model for a real scenario of a cloud system to apply our optimisation algorithms and show their relevance.
Dynamic Pricing in Smart Grids under Thresholding Policies: Algorithms and Heuristics
Masdar Institute of Science and Technology(马斯达尔理工学院);Brigham Young University(杨百翰大学);New York University, Abu Dhabi(纽约大学阿布扎比分校);Massachusetts Institute of Technology(麻省理工学院)
Learning Optimal and Fair Policies for Online Allocation of Scarce Societal Resources from Data Collected in Deployment
USC CAIS Center for Artificial Intelligence in Society(USC 人工智能与社会中心);Luxembourg Centre for Logistics and Supply Chain Management, University of Luxembourg(卢森堡物流与供应链管理中心,卢森堡大学)
Comparing Socially-Equitable Renewable Energy Budget Allocation MDP Policies in Mature and Emerging Economies
Management \& Technology University of Pennsylvania Philadelphia, PA, USA;Systems Engineering Institute Technology of Sepuluh Nopember (ITS) Surabaya, Indonesia;Systems Engineering King Fahd University of Petroleum