KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

The Performance Study of a Virtualized Multicore Web System

  • Lu, Chien-Te (Dept. of Electrical Engineering, National Taipei University of Technology) ;
  • Yeh, C.S. Eugene (Dept. of Information Management, Kainan University) ;
  • Wang, Yung-Chung (Dept. of Electrical Engineering, National Taipei University of Technology) ;
  • Yang, Chu-Sing (Dept. of Electrical Engineering, National Cheng Kung University)
  • Received : 2015.10.12
  • Accepted : 2016.09.25
  • Published : 2016.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Enhancing the performance of computing systems has been an important topic since the invention of computers. The leading-edge technologies of multicore and virtualization dramatically influence the development of current IT systems. We study performance attributes of response time (RT), throughput, efficiency, and scalability of a virtualized Web system running on a multicore server. We build virtual machines (VMs) for a Web application, and use distributed stress tests to measure RTs and throughputs under varied combinations of virtual cores (VCs) and VM instances. Their gains, efficiencies and scalabilities are also computed and compared. Our experimental and analytic results indicate: 1) A system can perform and scale much better by adopting multiple single-VC VMs than by single multiple-VC VM. 2) The system capacity gain is proportional to the number of VM instances run, but not proportional to the number of VCs allocated in a VM. 3) A system with more VMs or VCs has higher physical CPU utilization, but lower vCPU utilization. 4) The maximum throughput gain is less than VM or VC gain. 5) Per-core computing efficiency does not correlate to the quality of VCs or VMs employed. The outcomes can provide valuable guidelines for selecting instance types provided by public Cloud providers and load balancing planning for Web systems.

Keywords

References

  1. H. Ghiasi andM.G. Arani, "Smart Virtual Machine Placement Using Learning Automata to Reduce Power Consumption in Cloud Data Centers," Smart Computing Review, Vol. 5, No. 6, pp. 553-562, 2015.
  2. Wikipedia, "Computer performance," http://en.wikipedia.org/wiki/Computer_performance.
  3. N.J. Kansal and I. Chana, "Cloud Load Balancing Techniques: A Step Towards Green Computing," IJCSI International Journal of Computer Science Issues, Vol. 9, No. 1, pp. 238- 246, Jan. 2012.
  4. K. Hwang, G. Fox, and J. Dongarra, "Distributed and Cloud Computing: From Parallel Processing to Internet of Things," Morgan Kaufman, pp. 34-36, 130-133 and 569-572, 2012.
  5. G. Hager and G. Wellein, "Introduction to High Performance Computing for Scientists and Engineers," CRC Press, pp.95-104 and 115-120, 2011.
  6. K.L. Kroeker, "The Evolution of Virtualization," Communications of the ACM, Vol. 52, No. 3, pp. 18-20, March 2009. https://doi.org/10.1145/1467247.1467253
  7. B. Hayes, "Cloud Computing," Communications of the ACM, Vol. 51, No. 7, pp. 9-11, July 2008. https://doi.org/10.1145/1342327.1342330
  8. N.E. Jerger, D. Vantrease, and M. Lipasti, "An Evaluation of Server Consolidation Workloads for Multi-Core Designs," in Proc. of IEEE 10th International Symposium on Workload Characterization (IISWC), Sep. 27-29, pp. 47-56, 2007.
  9. R. Buyya, C. Vecchiola, and S. T. Selvi, Mastering Cloud Computing, Morgan Kaufmann, p. 93, 2013.
  10. D. Menasce, "Workload Characterization," IEEE Internet Computing, pp. 89-92, Sep./Oct. 2003.
  11. J. Dilley, "Web Server Workload Characterization," HP Technical Report, HPL-96-160, Hewlett-Packard Laboratories, 1996.
  12. J.A. Lacort, A. Pont, J.A Gil, and J.Shuquillo, "A Comprehensive Web Workload Characterization," in Proc. of the Conference on Performance Modeling and Evaluation on the Heterogeneous Network, pp. 67/1-67/10, July 2004.
  13. X. Wang, S. Huang, S. Fu, and K. Kavii, "Characterizing Workload of Web Applications on Virtualized Servers," Big Data Benchmarks, Performance Optimization, and Emerging Hardware. Springer International Publishing, pp. 98-108, 2014.
  14. A.K. Misha, J.L. Hellerstein, W. Cirne, and C.R. Das, "Towards Characterizing Cloud Backend Workloads: Insights from Google Compute Clusters," ACM SIGMETRICS Performance Evaluation Review, Vol. 37, No. 4, pp. 34-41, March 2010. https://doi.org/10.1145/1773394.1773400
  15. B. Veal and A. Foong, "Performance scalability of a Multi-core Web Server," in Proc. of the 3rd ACM/IEEE Symposium on Architecture for Networking and Communications Systems, ACM, pp. 57-66, 2007.
  16. R. Hashemian, D. Krishnamurthy, M. Arlitt, and N. Carlsson, "Characterizing the Scalability of a Web Application on a Multi-core Server," Concurrency and Computation: Practice and Experience, 2014.
  17. R. Hashemian, D. Krishnamurthy, M. Arlitt, and N. Carlsson, "Improving the Scalability of a Multi-core Web Server," in Proc. of the ACM/SPEC International Conference on Performance Engineering, ACM, pp. 161-172, 2013.
  18. Y. Cui, Y. Chen, and Y. Shi, "Scaling OLTP Applications on Commodity Multi-core Platforms," IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), IEEE, pp. 134-143, 2010.
  19. A.S. Harji, P.A. Buhr, and T. Brecht, "Comparing High-performance Multi-core Web-server Architectures," in Proc. of the 5th Annual International Systems and Storage Conference, ACM, p. 1, 2012.
  20. J. Park, Q. Wang, D. Jayasinghe, J. Li, Y. Kanemasa, M. Matsubara, D. Yokoyama, M. Kitsuregawa and C. Pu, "Variations in Performance Measurements of Multi-Core Processors: A Study of n-Tier Applications," in Proc. of IEEE International Conference on Services Computing (SCC2013), IEEE, pp. 336-343, 2013.
  21. R. NasiriGerdeh, N. Hosseini, K. RahimiZadeh, and M. AnaLoui, "Performance Analysis of Web Application in Xen-based Virtualized Environment," in Proc. of 2015 5th International Conference on Computer and Knowledge Engineering (ICCKE), IEEE, pp. 256-261, 2015.
  22. X. Chen, C.P. Ho, R. Osman, P. Harrison, and W.J. Knottenbelt, "Understanding, Modelling, and Improving the Performance of Web Applications in Multicore Virtualized Environments," in Proc. of the 5th ACM/SPEC International Conference on Performance Engineering, ACM, 2014.
  23. H.Y. Sit, K.S. Ho, R.W. Luk, and L.K. Ho, "An Adaptive Clustering Approach to Dynamic Load Balancing," in Proc. of the 7th International Symposium on Parallel Architecture, Algorithms and Networks (ISPAN'04), pp. 415-420, 2004.
  24. S. Banawan and N.M. Zeidat, "A Comparative Study of Load Sharing in Heterogeneous Multicomputer System," in Proc. of the 25th Annual Simulation Symposium, pp. 22-31, April 1992.
  25. T.D. Braun, H.J. Siegel, N. Beck, L.L. Boloni, M. Maheswaran, A.I. Reuther, J.P. Roberts, M.D. Theys, B. Yao, D. Hensgen, and R.F. Freund, "A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems," Journal of Parallel and Distributed Computing , Vol. 61, No. 6, pp. 810-837, June 2001. https://doi.org/10.1006/jpdc.2000.1714
  26. S.-C. Wang, K.-Q. Yan, W.-P. Liao, and S.-S. Wang, "Towards a Load Balancing in a Three-level Cloud Computing Network," in Proc. of 3rd IEEE International Conference on Computer Science and Information Technology (ICCSIT), pp.108-113, 2010.
  27. Wikipedia, "Load Balancing (computing)," http://en.wikipedia.org/wiki/Load_balancing_(computing).
  28. H.-J. Lu, C.-Z. Lai, M.-Y. Shih, Y.-H. Lee, C.-Y. Lu, C.-S. Yeh, and S.-A. Lee, "The Analysis of Load Balancing Performance for Virtualized Web Servers," (in Chinese) #F-417-1, Session F1, TANET2012, Oct. 23-25, Taoyuan, Taiwan, 2012.
  29. Editing Think Times to Simulate Web Site Human Interaction Delays in Load Tests Scenarios, http://msdn.microsoft.com/en-us/library/dd997697.aspx.
  30. C.-T. Lu, C.-S. Yeh, Y.-C. Wang, and F.-T. Tsai, "Research on Load Testing of Web Applications with Virtualization" (in Chinese), #1509, Session PDCC-2, National Computing Symposium, Taichung, Taiwan, Dec. 13-14, pp. PDCC 64-69, 2013.

Cited by

  1. Information Sharing and Creativity in a Virtual Team: Roles of Authentic Leadership, Sharing Team Climate and Psychological Empowerment vol.11, pp.8, 2016, https://doi.org/10.3837/tiis.2017.08.020
  2. Effect of Movile Communication during Non-Worktime: Increasing Worker's Stress in the IT Industry vol.19, pp.4, 2016, https://doi.org/10.7472/jksii.2018.19.4.95
  3. Cohesiveness of Internet Based Virtual Teams in the e-business: Roles of Various Types of Leadership vol.19, pp.5, 2016, https://doi.org/10.7472/jksii.2018.19.5.123