Journal of Communications and Networks

The Korean Institute of Commucations and Information Sciences (한국통신학회)
권호 표지
DOI QR코드

DOI QR Code

Advanced Resource Management with Access Control for Multitenant Hadoop

  • Won, Heesun (Department of Big Data Software Research at Electronics and Telecommunications Research Institute(ETRI)) ;
  • Nguyen, Minh Chau (Department of Big Data Software Research at Electronics and Telecommunications Research Institute(ETRI)) ;
  • Gil, Myeong-Seon (Department of Computer Science at Kangwon National University) ;
  • Moon, Yang-Sae (Department of Computer Science at Kangwon National University)
  • Received : 2015.04.30
  • Published : 2015.12.31
⟨ Previous Next ⟩

Abstract

Multitenancy has gained growing importance with the development and evolution of cloud computing technology. In a multitenant environment, multiple tenants with different demands can share a variety of computing resources (e.g., CPU, memory, storage, network, and data) within a single system, while each tenant remains logically isolated. This useful multitenancy concept offers highly efficient, and cost-effective systems without wasting computing resources to enterprises requiring similar environments for data processing and management. In this paper, we propose a novel approach supporting multitenancy features for Apache Hadoop, a large scale distributed system commonly used for processing big data. We first analyze the Hadoop framework focusing on "yet another resource negotiator (YARN)", which is responsible for managing resources, application runtime, and access control in the latest version of Hadoop. We then define the problems for supporting multitenancy and formally derive the requirements to solve these problems. Based on these requirements, we design the details of multitenant Hadoop. We also present experimental results to validate the data access control and to evaluate the performance enhancement of multitenant Hadoop.

Keywords

Acknowledgement

Grant : Smart Networking Core Technology Development, Collaborative Analytics Platform

Supported by : MSIP/IITP, MOTIE/KIAT, National Research Foundation of Korea (NRF)

References

  1. S. Bobrowski, The Force.com Multitenant Architecture, Force.com Architects White Paper Series, 2008.
  2. M. Adrian and N. Heudecker, Hadoop 2015: The Road Ahead, Gartner Webinars, Nov. 2014.
  3. C. D. Weissman and S. Bobrowski, "The design of the force.com multitenant Internet application development platform," in Proc. ACM SIGMOD, Providence, Rhode Island, June 2009, pp. 889-896.
  4. C. J. Guo, W. Sun , Y. Huang, Z. H. Wang, and B. Gao, "A framework for native multi-tenancy application development and management," in Proc. IEEE CEC and EEE, Tokyo, Japan, July 2007, pp. 551-558.
  5. T. Kwok, T. Nguyen, and L. Lam, "A software as a service with multitenancy support for an electronic contract management application," in Proc. IEEE SCC, Honolulu, Hawaii, July 2008, pp. 179-186.
  6. R. Mietzner, T. Unger, R. Titze, and F. Leymann, "Combining different multi-tenancy patterns in service-oriented applications," in Proc. IEEE EDOC, Auckland, New Zealand, Sept. 2009, pp. 131-140.
  7. J. M. A. Calero, N. Edwards, J. Kirschnick, L. Wilcock, and M. Wray, "Toward a multi-tenancy authorization system for cloud services," IEEE Security Privacy, Vol. 8, No. 6, pp. 48-55, Dec. 2010.
  8. J. Huang, D. M. Nicol, and R.H. Campbell, "Denial-of-service threat to Hadoop/YARN clusters with multi-tenancy," in Proc. IEEE Int'l Congress on Big Data, Anchorage, Alaska, June 2014, pp. 48-55.
  9. A. Jasti, P. Shah, R. Nagaraj, and R. Pendse, "Security in multi-tenancy cloud," in Proc. IEEE ICCST, Medellin, Colombia, Oct. 2010, pp. 35-41.
  10. C.-P. Bezemer, A. Zaidman, B. Platzbeecker, T. Hurkmans, and A. 't Hart , "Enabling multi-tenancy: An industrial experience report," in Proc. IEEE ICSM, Timisoara, Romania, Sept. 2010.
  11. Z. Shen, S. Subbiah, X. Gu, and J. Wilkes, "CloudScale: Elastic resource scaling for multi-tenant cloud systems," in Proc. ACMSoCC, Cascais, Portugal, Article No. 5, Oct. 2011.
  12. S. Narayanan, Securing Hadoop, Packt Publishing Ltd., Nov. 2013.
  13. V. K. Vavilapalli et al., "Apache Hadoop YARN: Yet another resource negotiator," in Proc. ACM SOCC, Santa Clara, California, Article No. 5, Oct. 2013.
  14. Hortonworks: Open Enterprise Hadoop, [Online]. Available: http://hortonworks.com/
  15. Cloudera, [Online]. Available: http://www.cloudera.com/
  16. Y. V. Natis, Gartner Reference Model for Elasticity and Multitenancy, Gartner, Inc., June 2012.
  17. T. White, Hadoop: The Definitive Guide, 3rd Edition, O'Reilly Media, 2012.
  18. Apache Hadoop YARN-Concepts and Applications, [Online]. Available: http://hortonworks.com/blog/
  19. B. C. Neuman and T. Ts'o, "Kerberos: An authentication service for computer network," IEEE Commun. Mag., vol. 32, no. 19, pp. 33-38, Sept. 1994. https://doi.org/10.1109/35.312841