International journal of advanced smart convergence

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Design of DBaaS-Based Collaboration System for Big Data Processing

  • Jung, Yean-Woo (Department of Information System, KwangWoon University Graduate School of Information Contents) ;
  • Lee, Jong-Yong (Ingenium college of liberal arts, KwangWoon University) ;
  • Jung, Kye-Dong (Ingenium college of liberal arts, KwangWoon University)
  • Received : 2016.04.20
  • Accepted : 2016.05.20
  • Published : 2016.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

With the recent growth in cloud computing, big data processing and collaboration between businesses are emerging as new paradigms in the IT industry. In an environment where a large amount of data is generated in real time, such as SNS, big data processing techniques are useful in extracting the valid data. MapReduce is a good example of such a programming model used in big data extraction. With the growing collaboration between companies, problems of duplication and heterogeneity among data due to the integration of old and new information storage systems have arisen. These problems arise because of the differences in existing databases across the various companies. However, these problems can be negated by implementing the MapReduce technique. This paper proposes a collaboration system based on Database as a Service, or DBaaS, to solve problems in data integration for collaboration between companies. The proposed system can reduce the overhead in data integration, while being applied to structured and unstructured data.

Keywords

References

  1. Agrawal, Divyakant, Sudipto Das, and Amr El Abbadi. "Big data and cloud computing: new wine or just new bottles?." Proceedings of the VLDB Endowment 3.1-2 (2010). pp 1647-1648. 2010 https://doi.org/10.14778/1920841.1921063
  2. Changqing Ji, Yu Li, Wenming Qiu, Uchechukwu Awada and Keqiu Li. "Big data processing in cloud computing environments." Pervasive Systems, Algorithms and Networks (ISPAN), 2012 12th International Symposium on. IEEE. pp17-23. 2012.
  3. Yean-Woo Jung, Seongsoo Cho, Jong-Yong Lee and KyeDong Jeong. "A Design of P2P Cloud System Using The Super P2P". The International Journal of Internet, Broadcasting and Communication(IJIBC) VoL.7 No.1. pp42-48. 2015
  4. Kye-Dong Jung, Chi-Gon Hwang, Jong-Yong Lee, Hyo-Young Shin. "The Study of DBaaS Hub System for Integration of Database In the Cloud Environment ". The Society of Digital Policy and Management. Journal of Digital Convergence Vol.12 No. 9. pp201-207. 2014.
  5. Yean-Woo Jung, Jong-Yong Lee, Seong Ro Lee and Kye-Dong Jung. "Design of the P2P cloud system based MapReduce". The 2nd International Conference on Contents(ICCPND). pp36-37. 2015
  6. Shimura, Takeyuki, Masatoshi Yoshikawa, and Shunsuke Uemura. "Storage and retrieval of XML documents using object-relational databases." Database and Expert Systems Applications Volume 1677 of the series Lecture Notes in Computer Science pp 206-217. 1999.
  7. Padhy, Rabi Prasad, Manas Ranjan Patra, and Suresh Chandra Satapathy. "RDBMS to NoSQL: Reviewing some next-generation non-relational databases." International Journal of Advanced Engineering Science and Technologies Vol.11 No.1. pp15-30. 2011.
  8. Wei-ping, Zhu, Li Ming-Xin, and Chen Huan. "Using MongoDB to implement textbook management system instead of MySQL." Communication Software and Networks (ICCSN), 2011 IEEE 3rd International Conference on. IEEE, pp300-305. 2011.
  9. Nurzhan Nurseitov, Michael Paulson, Randall Reynolds, Clemente Izurieta. "Comparison of JSON and XML Data Interchange Formats: A Case Study." Caine 9. pp157-162. 2009.
  10. Lammel, R. "Google's MapReduce programming model-Revisited". Science of computer programming Vol.70 No.1. pp1-30. 2008. https://doi.org/10.1016/j.scico.2007.07.001
  11. Hung-chih Yang, Ali Dasdan, Ruey-Lung Hsiao and D. Stott Parker. "Map-reduce-merge: simplified relational data processing on large clusters".Proceedings of the 2007 ACM SIGMOD international conference on Management of data. pp1029-1040. 2007.
  12. Junhui Lee. "The Realtime Complex Event Detection System in Bigdata using Heterogeneous Data Integration". Inha University Graduate School. Master's Thesis. 2013.
  13. Konstantin Shvachko, Hairong Kuang, Sanjay Radia, Robert Chansler. "The hadoop distributed file system." Mass Storage Systems and Technologies (MSST), 2010 IEEE 26th Symposium on. IEEE, pp1-10. 2010.