DOI QR코드

DOI QR Code

Research on Hot-Threshold based dynamic resource management in the cloud

  • Gun-Woo Kim (Department of Computer Science, Kwangwoon University) ;
  • Seok-Jae Moon (Department of Artificial Intelligence Institute of Information Technology, KwangWoon University) ;
  • Byung-Joon Park (Department of Computer Science, Kwangwoon University)
  • Received : 2024.07.27
  • Accepted : 2024.09.10
  • Published : 2024.09.30

Abstract

Recent advancements in cloud computing have significantly increased its importance across various sectors. As sensors, devices, and customer demands have become more diverse, workloads have become increasingly variable and difficult to predict. Cloud providers, connected to multiple physical servers to support a range of applications, often over-provision resources to handle peak workloads. This approach results in inconsistent services, imbalanced energy usage, waste, and potential violations of service level agreements. In this paper, we propose a novel engine equipped with a scheduler based on the Hot-Threshold concept, aimed at optimizing resource usage and improving energy efficiency in cloud environments. We developed this engine to employ both proactive and reactive methods. The proactive method leverages workload estimate-based provisioning, while the reactive Hot-Cold Scheduler consists of a Predictor, Solver, and Processor, which together suggest an intelligent migration flow. We demonstrate that our approach effectively addresses existing challenges in terms of cost and energy consumption. By intelligently managing resources based on past user statistics, we provide significant improvements in both energy efficiency and service consistency.

Keywords

Acknowledgement

This work is financially supported by Korea Ministry of Environment(MOE) Graduate School specialized in Integrated Pollution Prevention and Control Project.

References

  1. A. M. Joy, "Performance comparison between Linux containers and virtual machines," 2015 International Conference on Advances in Computer Engineering and Applications, IEEE, pp. 342-346, March 2015, doi: 10.1109/ICACEA.2015.7164727.
  2. M. Xu, W. Tian, and R. Buyya, "A survey on load balancing algorithms for virtual machines placement in cloud computing," Concurrency and Computation: Practice and Experience, p. e4123, October 2017, doi: doi.org/10.1002/cpe.4123.
  3. A. K. Singh and J. Kumar, "Secure and energy aware load balancing framework for cloud data centre networks," Electronics Letters, pp. 342-346, March 2015, doi: doi.org/10.1049/el.2019.0022.
  4. L. A. Barroso, U. Holzle, and P. Ranganathan, "The Datacenter as a Computer," Synthesis Lectures on Computer Architecture, Springer, pp. 1-189, August 2013, doi: 10.1007/978-3-031-01761-2.
  5. J. Kumar and A. K. Singh, "Workload prediction in cloud using artificial neural network and adaptive differential evolution," Future Generation Computer Systems, Elsevier, pp. 41-52, October 2018, doi: doi.org/10.1016/j.future.2017.10.047.
  6. G.-W. Kim, S.-Y. Gu, S.-J. Moon, and B.-J. Park, "An Engine for DRA in Container Orchestration Using Machine Learning," International Journal of Advanced Smart Convergence, vol. 12, no. 4, pp. 126-133, December 2023, doi: doi.org/10.7236/IJASC.2023.12.4.126.
  7. R. N. Calheiros, et al., "Cloudsim: A novel framework for modeling and simulation of cloud computing infrastructures and services," March 2009, doi: doi.org/10.48550/arXiv.0903.2525.
  8. A. Dixit, Ensemble Machine Learning: A Beginner's Guide That Combines Powerful Machine Learning Algorithms to Build Optimized Models, 2017.
  9. M. H. Shirvani, "A hybrid meta-heuristic algorithm for scientific workflow scheduling in heterogeneous distributed computing systems," Engineering Applications of Artificial Intelligence, vol. 90, 2020, Art. no. 103501, doi: 10.1016/j.engappai.2020.103501.
  10. N. Mansouri, B. M. H. Zade, and M. M. Javidi, "Hybrid task scheduling strategy for cloud computing by modified particle swarm optimization and fuzzy theory," Computers and Industrial Engineering, vol. 130, pp. 597-633, 2019, doi: 10.1016/j.cie.2019.03.006.
  11. H. M. Alkhashai and F. A. Omara, "BF-PSO-TS: Hybrid heuristic algorithms for optimizing task scheduling on cloud computing environment," International Journal of Advanced Computer Science and Applications (IJACSA), vol. 7, no. 6, pp. 207-212, 2016, doi: 10.14569/ijacsa.2016.070626.
  12. Z. Xiao, W. Song, and Q. Chen, "Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment," IEEE Transactions on Parallel and Distributed Systems, vol. 24, no. 6, pp. 1107-1117, June 2013, doi: 10.1109/TPDS.2012.283.
  13. Wiktionary, "Flash crowd," Wiktionary, accessed September 2024. Available: en.wiktionary.org/wiki/flashcrowd.