KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Parallel task scheduling under multi-Clouds

  • Hao, Yongsheng (Information management department, Nanjing University of Information Science & Technology) ;
  • Xia, Mandan (School of languages and cultures, Nanjing University of Information Science & Technology) ;
  • Wen, Na (College of Atmospherics Science, Nanjing University of Information Science & Technology) ;
  • Hou, Rongtao (School of computer and software, Nanjing University of Information Science & Technology) ;
  • Deng, Hua (College of Atmospherics Science, Nanjing University of Information Science & Technology) ;
  • Wang, Lina (School of electronic & information engineering, Nanjing University of Information Science & Technology) ;
  • Wang, Qin (School of computer and software, Nanjing University of Information Science & Technology)
  • Received : 2016.08.15
  • Accepted : 2016.12.04
  • Published : 2017.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

In the Cloud, for the scheduling of parallel jobs, there are many tasks in a job and those tasks are executed concurrently on different VMs (Visual machines), where each task of the job will be executed synchronously. The goal of scheduling is to reduce the execution time and to keep the fairness between jobs to prevent some jobs from waiting more time than others. We propose a Cloud model which has multiple Clouds, and under this model, jobs are in different lists according to the waiting time of the jobs and every job has different parallelism. At the same time, a new method-ZOMT (the scheduling parallel tasks based on ZERO-ONE scheduling with multiple targets) is proposed to solve the problem of scheduling parallel jobs in the Cloud. Simulations of ZOMT, AFCFS (Adapted First Come First Served), LJFS (Largest Job First Served) and Fair are executed to test the performance of those methods. Metrics about the waiting time, and response time are used to test the performance of ZOMT. The simulation results have shown that ZOMT not only reduces waiting time and response time, but also provides fairness to jobs.

Keywords

References

  1. Brandic, I. and R. Buyya, "Special section: Recent advances in utility and cloud computing," Future Generation Computer Systems, 28(1): 36-38, 2012. https://doi.org/10.1016/j.future.2011.06.001
  2. X. Liu, Y. Zha, Q. Yin, Y. Peng, L. Qin, "Scheduling parallel jobs with tentative runs and consolidation in the cloud," Journal of Systems and Software, Volume 104, Pages 141-151, ISSN 0164-1212, June 2015. https://doi.org/10.1016/j.jss.2015.03.007
  3. F. Zhang, J. Cao, K. Li, S. U. Khan, K. Hwang, "Multi-objective scheduling of many tasks in cloud platforms," Future Generation Computer Systems, Volume 37, Pages 309-320, ISSN 0167-739X, , July 2014. https://doi.org/10.1016/j.future.2013.09.006
  4. Y. Laili, F. Tao, L. Zhang, Y. Cheng, Y. Luo, B. R. Sarker, "A Ranking Chaos Algorithm for dual scheduling of cloud service and computing resource in private cloud," Computers in Industry, Volume 64, Issue 4, Pages 448-463, ISSN 0166-3615, May 2013. https://doi.org/10.1016/j.compind.2013.02.008
  5. W. Li, J. Wu, Q. Zhang, K. Hu, J. Li, "Trust-driven and QoS demand clustering analysis based cloud workflow scheduling strategies," Cluster Computing, Volume 17, Issue 3, 1013-1030, 2014. https://doi.org/10.1007/s10586-013-0340-1
  6. F. Satoh, H. Yanagisawa, H. Takahashi, T. Kushida, "Total Energy Management System for Cloud Computing," in Proc. of 2013 IEEE International Conference on Cloud Engineering (IC2E), pp.233, 240, 25-27 March 2013.
  7. A. Alnowiser, E. Aldhahri, A. Alahmadi, M. M. Zhu, "Enhanced Weighted Round Robin (EWRR) with DVFS Technology in Cloud Energy-Aware," in Proc. of 2014 International Conference on Computational Science and Computational Intelligence (CSCI), pp.320,326, 10-13 March 2014.
  8. R. Martin, L. David, A. Taleb-Bendiab, "A Comparative Study into Distributed Load Balancing Algorithms for Cloud Computing," in Proc. of waina, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops, 551-556, 2010.
  9. S. Nakrani, C. Tovey, "On Honey Bees and Dynamic Server Allocation in Internet Hosting Centers," Adaptive Behavior, 12, pp: 223-240, 2004. https://doi.org/10.1177/105971230401200308
  10. Z. Papazachos, H. Karatza, "The impact of task service time variability on Gang scheduling performance in a two-cluster system," Simulation Modelling Practice and Theory, 17:1276-1289. https://doi.org/10.1016/j.simpat.2009.05.002
  11. H. Karatza, "Performance of Gang scheduling policies in the presence of critical sporadic jobs in distributed systems," in Proc. of symp perform evaluation of comp telecommun syst 2007, San Diego, CA, pp. 547-554, 2007.
  12. H. Karatza, "Performance of Gang scheduling methods in a parallel system," Simulation Modelling Practice and Theory, 17:430-441. https://doi.org/10.1016/j.simpat.2008.10.001
  13. Z. C. Papazachos, H. Karatza, "Gang scheduling in multi-core clusters implementing migrations," Future Generation Computer Systems, 27(8): 1153-1165. https://doi.org/10.1016/j.future.2011.02.010
  14. I. Moschakis, H. Karatza, "Evaluation of gang scheduling performance and cost in a cloud computing system," The Journal of Supercomputing, 59(2): 975-992. https://doi.org/10.1007/s11227-010-0481-4
  15. N. Cordeschi, M. Shojafar, E. Baccarelli, "Energy-saving self-configuring networked data centers," Computer Networks, 57.17, 3479-3491, 2013. https://doi.org/10.1016/j.comnet.2013.08.002
  16. N. Cordeschi, M. Shojafar, D. Amendola, E. Baccarelli, "Energy-efficient adaptive networked datacenters for the QoS support of real-time applications," The Journal of Supercomputing, 71.2, 448-478, 2015. https://doi.org/10.1007/s11227-014-1305-8
  17. L. Liu, G. Xie, L. Yang, R. Li, "Schedule Dynamic Multiple Parallel Jobs with Precedence-Constrained Tasks on Heterogeneous Distributed Computing Systems," in Proc. of 2015 14th International Symposium on Parallel and Distributed Computing (ISPDC), pp.130-137, June 29 2015-July 2 2015.
  18. S. Prabhakaran, M. Neumann, S. Rinke, F. Wolf, "A Batch System with Efficient Adaptive Scheduling for Malleable and Evolving Applications," in Proc. of 2015 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 25-29, Page(s):429-438, May 2015.
  19. K. Oh-Heum, C. Kyung-Yong, "Scheduling parallel tasks with individual deadlines," Theoretical Computer Science, Volume 215, Issues 1-2, Pages 209-223, ISSN 0304-3975, 28 February 1999. https://doi.org/10.1016/S0304-3975(97)00178-3
  20. J. G. Barbosa, B. Moreira, "Dynamic scheduling of a batch of parallel task jobs on heterogeneous clusters, Parallel Computing," Volume 37, Issue 8, Pages 428-438, ISSN 0167-8191, August 2011. https://doi.org/10.1016/j.parco.2010.12.004
  21. W. Wang,Y. Chang,W. Lo,Y. Lee, "Adaptive scheduling for parallel tasks with QoS satisfaction for hybrid cloud environments," The Journal of Supercomputing, Volume 66, Issue 2, pp 783-811, 2013. https://doi.org/10.1007/s11227-013-0890-2
  22. T. He, S. Chen, H. Kim, L. Tong, K. Lee, "Scheduling Parallel Tasks onto Opportunistically Available Cloud Resources," in Proc. of 2012 IEEE 5th International Conference on Cloud Computing (CLOUD), Page(s): 180-187, 2012.
  23. D. Oliveira, K. A. C. S. Ocana, F. Baiao, M. Mattoso, "A Provenance-based Adaptive Scheduling Heuristic for Parallel Scientific Workflows in Clouds," Journal of Grid Computing, Volume 10, Issue 3, pp 521-552, 2012. https://doi.org/10.1007/s10723-012-9227-2
  24. Y. Hao, "Enhanced resource scheduling in Grid considering overload of different attributes," KSII Transactions on Internet and Information Systems, Vol.10 No.3, 1071-1090, 2016. https://doi.org/10.3837/tiis.2016.03.007
  25. M. S. Squillante, F. Wang, M. Papaefthymiou, "Stochastic analysis of gang scheduling in parallel and distributed systems," Performance Evaluation, 27-28(0): 273-296, 1996. https://doi.org/10.1016/S0166-5316(96)90031-0
  26. C. L. Morefield, "Application of 0-1 integer programming to multi-goal tracking problems," IEEE Transactions on Automatic Control, 22(3): 302-312, 1977. https://doi.org/10.1109/TAC.1977.1101500
  27. M. Zaharia, D. Borthakur, J. Sen Sarma, K. Elmeleegy, S. Shenker, I. Stoica, "Delay Scheduling: A Simple Technique for Achieving Locality and Fairness in Cluster Scheduling," In EuroSys 10, 2010.
  28. Amazon Web Services LLC, Amazon elastic compute cloud (EC2), 2009.
  29. Y. Hao, G. Liu, R. Hou, Yongsheng Zhu, Junwen Lu. "Performance Analysis of Gang Scheduling in a Grid," Journal of the Network and Systems Management, Volume 23, Issue 3, pp 650-672, July 2015. https://doi.org/10.1007/s10922-014-9312-x
  30. Y. Hao, G. Liu, "An Evaluation of Nine Heuristic Algorithms with Data-intensive Jobs and Computing-intensive Jobs in a Dynamic Environment," IET software, Value 9, No. 1, Page 7-16, 2015. https://doi.org/10.1049/iet-sen.2014.0014
  31. Y. Hao, G. Liu, N. Wen, "An enhanced load balancing mechanism based on deadline control on GridSim," Future Generation Computer Systems, Volume 28, Issue 4, Pages 657-665, ISSN 0167-739X, April 2012. https://doi.org/10.1016/j.future.2011.10.010
  32. F. Ramezani, J. Lu, J. Taheri, F. K. Hussain, "Evolutionary algorithm-based multi-objective task scheduling optimization model in cloud environments," World Wide Web-internet & Web Information Systems, 18(6), 1737-1757, 2015.
  33. Y. Hao, L. Wang, M. Zheng, "An adaptive algorithm for scheduling parallel jobs in meteorological Cloud," Knowledge-Based Systems, Volume 98, Pages 226-240, ISSN 0950-7051, 15 April 2016. https://doi.org/10.1016/j.knosys.2016.01.038

Cited by

  1. A parallel tasks Scheduling heuristic in the Cloud with multiple attributes vol.12, pp.1, 2017, https://doi.org/10.3837/tiis.2018.01.014
  2. Location-Aware Web Service Composition Based on the Mixture Rank of Web Services and Web Service Requests vol.2019, pp.None, 2017, https://doi.org/10.1155/2019/9871971