The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

The Bigdata Processing Environment Building for the Learning System

학습 시스템을 위한 빅데이터 처리 환경 구축

  • 김영근 (순천대학교 컴퓨터과학과) ;
  • 김승현 (순천대학교 컴퓨터과학과) ;
  • 조민희 (순천대학교 컴퓨터과학과) ;
  • 김원중 (순천대학교 컴퓨터공학과)
  • Received : 2014.06.21
  • Accepted : 2014.07.18
  • Published : 2014.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

In order to create an environment for Apache Hadoop for parallel distributed processing system of Bigdata, by connecting a plurality of computers, or to configure the node, using the configuration of the virtual nodes on a single computer it is necessary to build a cloud fading environment. However, be constructed in practice for education in these systems, there are many constraints in terms of cost and complex system configuration. Therefore, it is possible to be used as training for educational institutions and beginners in the field of Bigdata processing, development of learning systems and inexpensive practical is urgent. Based on the Raspberry Pi board, training and analysis of Big data processing, such as Hadoop and NoSQL is now the design and implementation of a learning system of parallel distributed processing of possible Bigdata in this study. It is expected that Bigdata parallel distributed processing system that has been implemented, and be a useful system for beginners who want to start a Bigdata and education.

빅데이터의 병렬분산처리 시스템을 위한 아파치 하둡 환경을 구축하기 위해서는 다수의 컴퓨터를 연결하여 노드를 구성하거나, 하나의 컴퓨터에 다수의 가상 노드 구성을 통해 클라우딩 환경을 구축하여야 한다. 그러나 이러한 시스템을 교육 환경에서 실습용으로 구축하는 것은 복잡한 시스템 구성과 비용적인 측면에서 많은 제약이 따른다. 따라서 빅데이터 처리 분야의 입문자들과 교육기관의 실습용으로 사용할 수 있는 실용적이고 저렴한 학습 시스템의 개발이 시급하다. 본 연구에서는 라즈베리파이 보드를 기반으로 하둡과 NoSQL과 같은 빅데이터 처리 및 분석 실습이 가능한 빅데이터 병렬분산처리 학습시스템을 설계 및 구현하였다. 구현된 빅데이터 병렬분산처리시스템은 교육현장과 빅데이터를 시작하는 입문자들에게 유용한 시스템이 될 것으로 기대된다.

Keywords

References

  1. S.-Y. Lee and H.-J. Yoon, "The Study on Strategy of National Information for Electronic Government of S. Korea with Public Data analysed by the Application of Scenario Planning," J. of the Korea Institute of Electronic Communication Sciences, vol. 7, no. 6, Dec. 2012, pp. 1259-1273.
  2. H. Yoon, "Research on the Application Methods of Big Data within the Cultural Industry," Academic Association of Global Cultural Contents, vol. 10, no. 1, Feb. 2013, pp. 157-179.
  3. S. Yoo and K. Choi, "Characterizing Business Strategy in a New Ecosystem of Big Data," J. of Digital Convergence, vol. 12, no. 4, Apr, 2014, pp. 1-9. https://doi.org/10.14400/JDC.2014.12.4.1
  4. K.-W. Park, K.-J. Ban, S.-H. Song, and E.-K. Kim, "Cloud-based Intelligent Management System for Photovoltaic Power Plants," J. of the Korea Institute of Electronic Communication Sciences, vol. 7, no. 3, June 2012, pp. 591-596.
  5. B.-R. Cha, H.-G. Kim, D.-G. Kim, J.-W, Kim, and Y.-I. Kim, "Basic Prototype Design and Verification of Hadoop Cluster based on Private Cloud Infrastructure for SMB," The J. of Korea navigation institute, vol. 17, no. 2, Apr. 2013, pp. 225-233. https://doi.org/10.12673/jkoni.2013.17.2.225
  6. J.-H. Kwak, J. Yoon, Y. Jung, J. Hahm, and D. Park, "A Study on Large-scale Data Analysis based on Hadoop for Astroinformatics," In Proc. Int. Conf. Korean Institute of Information Scientists and Engineers, Gyeongju, Korea, vol. 38, no. 1, June 2011, pp. 13-16.
  7. G. Ji and W. Kim, "Raspberry Pi using the Private Cloud Service," In Proc. Int. Conf. Korean Society for Internet Information, Seoul, Korea, vol. 14, no. 2, Nov. 2013, pp. 115-116.
  8. Y.-G. Kim, S.-H. Kim, and W.-J. Kim "Big data processing environment for building learning systems development and production," In Proc. Int. Conf. the Korea Institute of Electronic Communication Sciences, Busan, Korea, vol. 8, no. 1, June 2014, pp. 179-182.
  9. C. Kim, "A Study on the Educational Use of Tiny PC in an Elementary School," J. of The Korean Association of Information Education, vol. 18, no. 1, Mar. 2014, pp. 101-110. https://doi.org/10.14352/jkaie.2014.18.1.101
  10. J. Park, "The Study of Process and Method of Interactive Exhibits Prototyping-Focused on Open Source applicate-," Master's Thesis, Graduate School of NID Fusion Technology, Seoul National University of Science and Technology, Feb. 2013.