DOI QR코드

DOI QR Code

Adaptive Resource Management and Provisioning in the Cloud Computing: A Survey of Definitions, Standards and Research Roadmaps

  • Keshavarzi, Amin (Department of Computer & Information Technology Engineering, Qazvin branch, Islamic Azad University) ;
  • Haghighat, Abolfazl Toroghi (Department of Computer & Information Technology Engineering, Qazvin branch, Islamic Azad University) ;
  • Bohlouli, Mahdi (Institute for Web Science and Technologies (WeST) University of Koblenz-Landau Universitaetstr. 1)
  • Received : 2016.11.20
  • Accepted : 2017.04.18
  • Published : 2017.09.30

Abstract

The fact that cloud computing services have been proposed in recent years, organizations and individuals face with various challenges and problems such as how to migrate applications and software platforms into cloud or how to ensure security of migrated applications. This study reviews the current challenges and open issues in cloud computing, with the focus on autonomic resource management especially in federated clouds. In addition, this study provides recommendations and research roadmaps for scientific activities, as well as potential improvements in federated cloud computing. This survey study covers results achieved through 190 literatures including books, journal and conference papers, industrial reports, forums, and project reports. A solution is proposed for autonomic resource management in the federated clouds, using machine learning and statistical analysis in order to provide better and efficient resource management.

Keywords

References

  1. H. Abelson, Architects of the information society: Thirty-five years of the laboratory for computer science at MIT. MIT Press, 1999.
  2. M. Siegel and F. Gibbons, "Amazon enters the Cloud computing business," CasePublisher Com May, vol. 20, 2008.
  3. P. Mell and T. Grance, "The NIST definition of cloud computing," 2011.
  4. R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic, "Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility," Future Gener. Comput. Syst., vol. 25, no. 6, pp. 599-616, 2009. https://doi.org/10.1016/j.future.2008.12.001
  5. I. Foster, Y. Zhao, I. Raicu, and S. Lu, "Cloud computing and grid computing 360-degree compared," in Proc. of Grid Computing Environments Workshop, 2008. GCE'08, pp. 1-10, 2008.
  6. Global Inter-Cloud Technology Forum, "Use Cases and Functional Requirements for Inter-Cloud Computing. Technical Report."
  7. N. Grozev and R. Buyya, "Inter-Cloud architectures and application brokering: taxonomy and survey," Softw. Pract. Exp., vol. 44, no. 3, pp. 369-390, 2014. https://doi.org/10.1002/spe.2168
  8. A. L. Garcia, E. F. del Castillo, and P. O. Fernandez, "Standards for enabling heterogeneous IaaS cloud federations," Comput. Stand. Interfaces, vol. 47, pp. 19-23, 2016. https://doi.org/10.1016/j.csi.2016.02.002
  9. A. Keshavarzi, A. T. Haghighat, and M. Bohlouli, "Research challenges and prospective business impacts of cloud computing: A survey," in Proc. of Intelligent Data Acquisition and Advanced Computing Systems (IDAACS), 2013 IEEE 7th International Conference on, vol. 2, pp. 731-736, 2013.
  10. M. Maurer, I. Brandic, and R. Sakellariou, "Simulating autonomic SLA enactment in clouds using case based reasoning," in Proc. of Towards a Service-Based Internet, Springer, pp. 25-36, 2010.
  11. V. C. Emeakaroha, M. A. Netto, R. N. Calheiros, I. Brandic, R. Buyya, and C. A. De Rose, "Towards autonomic detection of SLA violations in Cloud infrastructures," Future Gener. Comput. Syst., vol. 28, no. 7, pp. 1017-1029, 2012. https://doi.org/10.1016/j.future.2011.08.018
  12. R. Buyya, A. Beloglazov, and J. Abawajy, "Energy-efficient management of data center resources for cloud computing: a vision, architectural elements, and open challenges," ArXiv Prepr. ArXiv10060308, 2010.
  13. S.-S. Wang, K.-Q. Yan, and S.-C. Wang, "Achieving efficient agreement within a dual-failure cloud-computing environment," Expert Syst. Appl., vol. 38, no. 1, pp. 906-915, 2011. https://doi.org/10.1016/j.eswa.2010.07.072
  14. W. Zhao, P. M. Melliar-Smith, and L. E. Moser, "Fault tolerance middleware for cloud computing," in Proc. of Cloud Computing (CLOUD), 2010 IEEE 3rd International Conference on, pp. 67-74, 2010.
  15. S. Islam, J. Keung, K. Lee, and A. Liu, "Empirical prediction models for adaptive resource provisioning in the cloud," Future Gener. Comput. Syst., vol. 28, no. 1, pp. 155-162, 2012. https://doi.org/10.1016/j.future.2011.05.027
  16. C. O. Rolim, F. Schubert, A. G. Rossetto, V. R. Leithardt, C. F. Geyer, and C. Westphall, "Comparison of a Multi output Adaptative Neuro-Fuzzy Inference System (MANFIS) and Multi Layer Perceptron (MLP) in Cloud Computing Provisioning," in Proc. of 29th Brazilian Symposium on Computer Networks and Distributed Systems, Paris, 2012.
  17. G. Copil et al., "On controlling elasticity of cloud applications in celar," Emerg. Res. Cloud Distrib. Comput. Syst., p. 222, 2015.
  18. P. Martin, A. Brown, W. Powley, and J. L. Vazquez-Poletti, "Autonomic management of elastic services in the cloud," in Proc. of Computers and Communications (ISCC), 2011 IEEE Symposium on, pp. 135-140, 2011.
  19. S. Srivastava, R. Mehrotra, I. Banicescu, and S. Abdelwahed, "A Model-Based Framework for Autonomic Performance Management of Cloud Computing Systems."
  20. O. Rogers and D. Cliff, "A financial brokerage model for cloud computing," J. Cloud Comput., vol. 1, no. 1, pp. 1-12, 2012. https://doi.org/10.1186/2192-113X-1-1
  21. R. Mehrotra, S. Srivastava, I. Banicescu, and S. Abdelwahed, "Towards an autonomic performance management approach for a cloud broker environment using a decomposition-coordination based methodology," in Proc. of Future Gener. Comput. Syst., vol. 54, pp. 195-205, 2016. https://doi.org/10.1016/j.future.2015.03.020
  22. G. Carella, T. Magedanz, K. Campowsky, and F. Schreiner, "Elasticity as a service for federated cloud testbeds," in Proc. of Communications Workshops (ICC), 2013 IEEE International Conference on,pp. 256-260, 2013.
  23. B. Javadi, J. Abawajy, and R. Buyya, "Failure-aware resource provisioning for hybrid Cloud infrastructure," J. Parallel Distrib. Comput., vol. 72, no. 10, pp. 1318-1331, 2012. https://doi.org/10.1016/j.jpdc.2012.06.012
  24. J. L. Lucas-Simarro, R. Moreno-Vozmediano, R. S. Montero, and I. M. Llorente, "Scheduling strategies for optimal service deployment across multiple clouds," in Proc. of Future Gener. Comput. Syst., vol. 29, no. 6, pp. 1431-1441, 2013. https://doi.org/10.1016/j.future.2012.01.007
  25. "A Fast and Secure Scheme for Data Outsourcing in the Cloud," in Proc. of KSII Trans. Internet Inf. Syst., vol. 8, no. 8, Aug. 2014.
  26. S. Pearson and A. Benameur, "Privacy, security and trust issues arising from cloud computing," in Proc. of Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on, pp. 693-702, 2010.
  27. C. N. Hofer and G. Karagiannis, "Cloud computing services: taxonomy and comparison," J. Internet Serv. Appl., vol. 2, no. 2, pp. 81-94, 2011. https://doi.org/10.1007/s13174-011-0027-x
  28. D. M. Rousseau, S. B. Sitkin, R. S. Burt, and C. Camerer, "Not so different after all: A cross-discipline view of trust," Acad. Manage. Rev., vol. 23, no. 3, pp. 393-404, 1998. https://doi.org/10.5465/AMR.1998.926617
  29. S. Bradshaw, C. Millard, and I. Walden, "Contracts for clouds: comparison and analysis of the Terms and Conditions of cloud computing services," Int. J. Law Inf. Technol., vol. 19, no. 3, pp. 187-223, 2011. https://doi.org/10.1093/ijlit/ear005
  30. S. Subashini and V. Kavitha,"A survey on security issues in service delivery models of cloud computing," J. Netw.Comput.Appl.,vol.34, no.1,pp. 1-11, 2011. https://doi.org/10.1016/j.jnca.2010.07.006
  31. C. S. Alliance, Top threats to cloud computing. March, 2010.
  32. D. Zissis and D. Lekkas, "Addressing cloud computing security issues," Future Gener. Comput. Syst., vol. 28, no. 3, pp. 583-592, 2012. https://doi.org/10.1016/j.future.2010.12.006
  33. E. Prieto, R. Diaz, L. Romano, R. Rieke, and M. Achemlal, "MASSIF: A promising solution to enhance olympic games IT security," in Proc. of Global Security, Safety and Sustainability & e-Democracy, Springer, pp. 139-147, 2012.
  34. S. Kamara and K. Lauter, "Cryptographic cloud storage," in Proc. of Financial Cryptography and Data Security, Springer, pp. 136-149, 2010.
  35. C. Rong, S. T. Nguyen, and M. G. Jaatun, "Beyond lightning: A survey on security challenges in cloud computing," Comput. Electr. Eng., vol. 39, no. 1, pp. 47-54, Jan. 2013. https://doi.org/10.1016/j.compeleceng.2012.04.015
  36. R. Buyya, R. N. Calheiros, and X. Li, "Autonomic cloud computing: Open challenges and architectural elements," in Proc. of Emerging Applications of Information Technology (EAIT), 2012 Third International Conference on, pp. 3-10, 2012.
  37. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, "Benchmarking cloud serving systems with YCSB," in Proc. of the 1st ACM symposium on Cloud computing, pp. 143-154, 2010.
  38. J. Schad, J. Dittrich, and J.-A. Quiane-Ruiz, "Runtime measurements in the cloud: observing, analyzing, and reducing variance," in Proc. of VLDB Endow., vol. 3, no. 1-2, pp. 460-471, 2010. https://doi.org/10.14778/1920841.1920902
  39. D. Kossmann and T. Kraska, "Data management in the cloud: promises, state-of-the-art, and open questions," Datenbank-Spektrum, vol. 10, no. 3, pp. 121-129, 2010. https://doi.org/10.1007/s13222-010-0033-3
  40. M. A. El-Refaey and M. A. Rizkaa, "CloudGauge: a dynamic cloud and virtualization benchmarking suite," in Proc. of Enabling Technologies: Infrastructures for Collaborative Enterprises (WETICE), 2010 19th IEEE International Workshop on, pp. 66-75, 2010.
  41. B. J. Lheureux, D. C. Plummer, T. Bova, M. Cantara, E. Knipp, P. Malinverno, "Who's Who in Cloud Services Brokerage," Gartner, 2011.
  42. S. K. Nair et al., "Towards secure cloud bursting, brokerage and aggregation," in Proc. of Web services (ecows), 2010 ieee 8th european conference on, pp. 189-196, 2010.
  43. R. Buyya, S. Pandey, and C. Vecchiola, "Cloudbus toolkit for market-oriented cloud computing," in Proc. of Cloud Computing, Springer, pp. 24-44, 2009.
  44. R. Buyya, S. Pandey, and C. Vecchiola, "Market-oriented cloud computing and the cloudbus toolkit," ArXiv Prepr. ArXiv12035196, 2012.
  45. E. Carlini, M. Coppola, P. Dazzi, L. Ricci, and G. Righetti, "Cloud federations in contrail," in Proc. of Euro-Par 2011: Parallel Processing Workshops, pp. 159-168, 2011.
  46. B. Rochwerger et al., "The reservoir model and architecture for open federated cloud computing," IBM J. Res. Dev., vol. 53, no. 4, p. 4: 1-4: 11, 2009.
  47. J. Tordsson, R. S. Montero, R. Moreno-Vozmediano, and I. M. Llorente, "Cloud brokering mechanisms for optimized placement of virtual machines across multiple providers," Future Gener. Comput. Syst., vol. 28, no. 2, pp. 358-367, 2012. https://doi.org/10.1016/j.future.2011.07.003
  48. "J. Catone, How Much Data Will Humans Create & Store This Year? [INFOGRAPHIC], Mashable Social Media, June 2011." .
  49. J. Gantz and D. Reinsel, "The digital universe in 2020: Big data, bigger digital shadows, and biggest growth in the far east," IDC IView IDC Anal. Future, vol. 2007, pp. 1-16, 2012.
  50. P. Russom, "Big data analytics," TDWI Best Pract. Rep. Fourth Quart., pp. 1-35, 2011.
  51. S. Chaudhuri, "What next?: a half-dozen data management research goals for big data and the cloud," in Proc. of the 31st symposium on Principles of Database Systems, pp. 1-4, 2012.
  52. M. Bohlouli et al., "Towards an integrated platform for big data analysis," in Proc. of Integration of Practice-Oriented Knowledge Technology: Trends and Prospectives, Springer, pp. 47-56, 2013.
  53. H. Demirkan and D. Delen, "Leveraging the capabilities of service-oriented decision support systems: Putting analytics and big data in cloud," Decis. Support Syst., vol. 55, no. 1, pp. 412-421, 2013. https://doi.org/10.1016/j.dss.2012.05.048
  54. S. Gilbert and N. Lynch, "Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services," ACM SIGACT News, vol. 33, no. 2, pp. 51-59, 2002. https://doi.org/10.1145/564585.564601
  55. R. Cattell, "Scalable SQL and NoSQL data stores," ACM SIGMOD Rec., vol. 39, no. 4, pp. 12-27, 2011. https://doi.org/10.1145/1978915.1978919
  56. " Marozzo F, Talia D, Trunfio P. Large-Scale Data Analysis on Cloud Systems. ERCIM News. 2012." .
  57. M. Bohlouli, J. Dalter, M. Dornhofer, J. Zenkert, and M. Fathi, "Knowledge discovery from social media using big data-provided sentiment analysis (SoMABiT)," J. Inf. Sci., vol. 41, no. 6, pp. 779-798, 2015. https://doi.org/10.1177/0165551515602846
  58. C. Chu et al., "Map-reduce for machine learning on multicore," Adv. Neural Inf. Process. Syst., vol. 19, p. 281, 2007.
  59. J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," Commun. ACM, vol. 51, no. 1, pp. 107-113, 2008. https://doi.org/10.1145/1327452.1327492
  60. T. White, Hadoop: The definitive guide. O'Reilly Media, Inc., 2012.
  61. S. Owen, R. Anil, T. Dunning, and E. Friedman, Mahout in action. Manning Shelter Island, 2011.
  62. "Adaptive Cloud Offloading of Augmented Reality Applications on Smart Devices for Minimum Energy Consumption," KSII Trans. Internet Inf. Syst., vol. 9, no. 8, pp. 3090-3102, Aug. 2015. https://doi.org/10.3837/tiis.2015.08.020
  63. "A Classification-Based Virtual Machine Placement Algorithm in Mobile Cloud Computing," KSII Trans. Internet Inf. Syst., vol. 10, no. 5, May 2016.
  64. H. T. Dinh, C. Lee, D. Niyato, and P. Wang, "A survey of mobile cloud computing: architecture, applications, and approaches," Wirel. Commun. Mob. Comput., vol. 13, no. 18, pp. 1587-1611, 2013. https://doi.org/10.1002/wcm.1203
  65. S. Li and Z. Chen, "Social services computing: Concepts, research challenges, and directions," in Proc. of the 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing, pp. 840-845, 2010.
  66. K. Chard, K. Bubendorfer, S. Caton, and O. F. Rana, "Social cloud computing: A vision for socially motivated resource sharing," Serv. Comput. IEEE Trans. On, vol. 5, no. 4, pp. 551-563, 2012. https://doi.org/10.1109/TSC.2011.39
  67. D. Satria, D. Park, and M. Jo, "Recovery for overloaded mobile edge computing," Future Gener. Comput. Syst., 2016.
  68. S. Caton, C. Haas, K. Chard, K. Bubendorfer, and O. F. Rana, "A social compute cloud: allocating and sharing infrastructure resources via social networks," Serv. Comput. IEEE Trans. On, vol. 7, no. 3, pp. 359-372, 2014. https://doi.org/10.1109/TSC.2014.2303091
  69. J. O. Kephart and D. M. Chess, "The vision of autonomic computing," Computer, vol. 36, no. 1, pp. 41-50, 2003. https://doi.org/10.1109/MC.2003.1160055
  70. G. Zhang, B. E. Patuwo, and M. Y. Hu, "Forecasting with artificial neural networks:: The state of the art," Int. J. Forecast., vol. 14, no. 1, pp. 35-62, 1998. https://doi.org/10.1016/S0169-2070(97)00044-7
  71. J. L. Elman, "Finding structure in time," Cogn. Sci., vol. 14, no. 2, pp. 179-211, 1990. https://doi.org/10.1207/s15516709cog1402_1
  72. O. De Jeses and M. T. Hagan, "Backpropagation through time for a general class of recurrent network," in Proc. of Neural Networks, 2001. Proceedings. IJCNN'01. International Joint Conference on, vol. 4, pp. 2638-2643, 2001.
  73. M. P. Cuellar, M. Delgado, and M. C. Pegalajar, "An application of non-linear programming to train recurrent neural networks in time series prediction problems," in Proc. of Enterprise Information Systems VII, Springer, pp. 95-102, 2007.
  74. Z. Zheng and M. R. Lyu, "Collaborative reliability prediction of service-oriented systems," in Proc. of the 32nd ACM/IEEE International Conference on Software Engineering-Volume 1, pp. 35-44, 2010.

Cited by

  1. A Systematic Mapping Study of Cloud Resources Management and Scalability in Brokering, Scheduling, Capacity Planning and Elasticity vol.12, pp.2, 2017, https://doi.org/10.3923/ajsr.2019.151.166
  2. Enhanced time-aware QoS prediction in multi-cloud: a hybrid k-medoids and lazy learning approach (QoPC) vol.102, pp.4, 2020, https://doi.org/10.1007/s00607-019-00747-y