Abstract
In this paper we propose a novel reservation plan adaptation system based on machine learning. In the context of cloud auto-scaling, an important issue is the ability to define and use a resource reservation plan, which enables efficient resource scheduling. If necessary, the plan may allocate new resources upon reservation where a sufficient amount of resources is available. Our solution allows the updating of a reservation plan initially prepared by an administrator. It makes it possible to adapt reservation plans one or more weeks ahead. Hence, it allows time for the administrator to analyze the plan and discover potential problems with resource under-provisioning or over-provisioning, which may prevent server overload in the former case and unnecessary expenses in the latter. It also makes it possible to extract and analyze the knowledge learned, which may provide useful information about resource usage characteristics. The proposed solution is tested on OpenStack using real Wikipedia server traffic data. Experimental results demonstrate that machine learning enables an improvement in resource usage.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Abdelwahab, S., Hamdaoui, B., Guizani, M., Znati, T.: Network function virtualization in 5g. IEEE Commun. Mag. 54(4), 84–91 (2016)
Costa-Requena, J., Santos, J.L., Guasch, V.F., Ahokas, K., Premsankar, G., Luukkainen, S., Pérez, O. L., Itzazelaia, M.U., Ahmad, I., Liyanage, M., Ylianttila, M., de Oca, E.M.: Sdn and nfv integration in generalized mobile network architecture. In: 2015 European Conference on Networks and Communications (EuCNC), pp. 154–158 (2015)
Kukreja, S., Dalal, S.: Performance analysis of cloud resource provisioning algorithms. In: Saeed, K., Chaki, N., Pati, B., Bakshi, S., Mohapatra, D.P. (eds.) Progress in Advanced Computing and Intelligent Engineering, pp 593–602. Springer, Singapore (2018)
Jala, J, Rao, K.R.H.: Qos-based technique for dynamic resource allocation in cloud services. In: Smys, S., Bestak, R., Chen, J.I.-Z., Kotuliak, I. (eds.) International Conference on Computer Networks and Communication Technologies, pp 65–73. Springer, Singapore (2019)
Maurer, M., Breskovic, I., Emeakaroha, V.C., Brandic, I.: Revealing the mape loop for the autonomic management of cloud infrastructures. In: 2011 IEEE Symposium on Computers and Communications (ISCC), pp. 147–152 (2011)
Arcaini, P., Riccobene, E., Scandurra, P.: Modeling and analyzing mape-k feedback loops for self-adaptation. In: 2015 IEEE/ACM 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, pp. 13–23 (2015)
Lin, C.-C., Wu, J.-J., Liu, P., Lin, J.-A., Song, L.-C.: Automatic Resource Scaling for Web Applications in the Cloud, pp 81–90. Springer, Berlin (2013)
Hu, R., Jiang, J., Liu, G., Wang, L.: Efficient resources provisioning based on load forecasting in cloud. Sci. World J., 2014 (2014)
Wang, W., Niu, D., Li, B., Liang, B.: Dynamic cloud resource reservation via cloud brokerage. In: 2013 IEEE 33rd International Conference on Distributed Computing Systems, pp. 400–409 (2013)
Islam, S., Keung, J., Lee, K., Liua, A.: Empirical prediction models for adaptive resource provisioning in the cloud. Futur. Gener. Comput. Syst. 28, 155–162 (2012)
Celesti, A, Mulfari, D., Fazio, M., Puliafito, A, Villari, M.: Evaluating alternative daas solutions in private and public openstack clouds. Softw.: Pract. Exper. 47(9), 1185–1200 (2017)
Kabiri, M.N., Wannous, M.: An experimental evaluation of a cloud-based virtual computer laboratory using openstack. In: 2017 6th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI), vol. 00, pp. 667–672 (2018)
Liaqat, M., Chang, V., Gani, A., Hamid, S.H.A., Toseef, M., Shoaib, U., Ali, R.L.: Federated cloud resource management: Review and discussion. J. Netw. Comput. Appl. 77, 87–105 (2017)
Zhang, Y., Yao, J., Guan, H.: Intelligent cloud resource management with deep reinforcement learning. IEEE Cloud Comput. 4(6), 60–69 (2017)
Witanto, J.N., Lim, H., Atiquzzaman, M.: Adaptive selection of dynamic vm consolidation algorithm using neural network for cloud resource management. Futur. Gener. Comput. Syst. 87, 35–42 (2018)
Qureshi, M.B., Dehnavi, M.M., Min-Allah, N., Qureshi, M.S., Hussain, H., Rentifis, I., Tziritas, N., Loukopoulos, T., Khan, S.U., Xu, C.-Z., Zomaya, A.Y. : Survey on grid resource allocation mechanisms. J. Grid Comput. 12(2), 399–441 (2014)
Mao, M., Humphrey, M.: Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC ’11, pp 49:1–49:12. ACM, New York (2011)
Fuerst, C., Schmid, S., Suresh, L., Costa, P.: Kraken: Online and elastic resource reservations for cloud datacenters. IEEE/ACM Trans. Network. 26(1), 422–435 (2018)
Imam, M.T., Miskhat, S., Rahman, M., Amin, M.A.: Neural network and regression based processor load prediction for efficient scaling of grid and cloud resources. In: 14th International Conference on Computer and Information Technology, ICCIT 2011, pp. 333–338, 12 (2011)
Singh, H., Randhawa, R.: Dynamic resource prediction and allocation in clouds using pattern matching. Indian J. Sci. Technol., 9(47) (2016)
Shahin, A.A.: Automatic cloud resource scaling algorithm based on long short-term memory recurrent neural network. arXiv:1701.03295 (2016)
Szydlo, T., Brzoza-woch, R.: Predictive power consumption adaptation for future generation embedded devices powered by energy harvesting sources. Microprocess. Microsyst. Embedded Hardware Des. 39(4–5), 250–258 (2015)
Nawrocki, P., Sniezynski, B.: Autonomous context-based service optimization in mobile cloud computing. J. Grid Comput. 15(3), 343–356 (2017)
Nawrocki, P., Sniezynski, B.: Adaptive service management in mobile cloud computing by means of supervised and reinforcement learning. J. Netw. Syst. Manag. 26(1), 1–22 (2018)
Dong, D., Xiong, H., Castañé, G.G., Stack, P., Morrison, J.P.: Heterogeneous resource management and orchestration in cloud environments. In: Ferguson, D., Muñoz, V.M., Cardoso, J., Helfert, M., Pahl, C. (eds.) Cloud Computing and Service Science, pp 61–80. Springer International Publishing, Cham (2018)
Chen, J., Chen, Y., Tsai, S., Lin, Y.: Implementing nfv system with openstack. In: 2017 IEEE Conference on Dependable and Secure Computing, pp. 188–194 (Aug 2017)
Witten, I.H, Frank, E., Hall, M.A., Pal, C.J.: Data mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann (2016)
Acknowledgements
The research presented in this paper was supported by Samsung Research Poland.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Sniezynski, B., Nawrocki, P., Wilk, M. et al. VM Reservation Plan Adaptation Using Machine Learning in Cloud Computing. J Grid Computing 17, 797–812 (2019). https://doi.org/10.1007/s10723-019-09487-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10723-019-09487-x