Journal of Advanced Research in Ocean Engineering

Korean Society of Ocean Engineers (한국해양공학회)
권호 표지
DOI QR코드

DOI QR Code

Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside

  • Kim, Seong-Hoon (Department of Naval Architecture and Ocean Engineering, Seoul National University) ;
  • Roh, Myung-Il (Department of Naval Architecture and Ocean Engineering, Seoul National University) ;
  • Kim, Ki-Su (Department of Naval Architecture and Ocean Engineering, Seoul National University) ;
  • Oh, Min-Jae (Research Institute of Marine Systems Engineering, Seoul National University)
  • Received : 2016.12.21
  • Accepted : 2017.02.24
  • Published : 2017.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, the amount of data to be processed and the complexity thereof have been increasing due to the development of information and communication technology, and industry's interest in such big data is increasing day by day. In the shipbuilding and offshore industry also, there is growing interest in the effective utilization of data, since various and vast amounts of data are being generated in the process of design, production, and operation. In order to effectively utilize big data in the shipbuilding and offshore industry, it is necessary to store and process large amounts of data. In this study, it was considered efficient to apply Hadoop and R, which are mostly used in big data related research. Hadoop is a framework for storing and processing big data. It provides the Hadoop Distributed File System (HDFS) for storing big data, and the MapReduce function for processing. Meanwhile, R provides various data analysis techniques through the language and environment for statistical calculation and graphics. While Hadoop makes it is easy to handle big data, it is difficult to finely process data; and although R has advanced analysis capability, it is difficult to use to process large data. This study proposes a big data platform based on Hadoop for applications in the shipbuilding and offshore industry. The proposed platform includes the existing data of the shipyard, and makes it possible to manage and process the data. To check the applicability of the platform, it is applied to estimate the weights of offshore structure topsides. In this study, we store data of existing FPSOs in Hadoop-based Hortonworks Data Platform (HDP), and perform regression analysis using RHadoop. We evaluate the effectiveness of large data processing by RHadoop by comparing the results of regression analysis and the processing time, with the results of using the conventional weight estimation program.

Keywords

References

  1. Bae, D.M., Park, H. S. and Oh, K. H., 2013, Big Data Trend and Policy Implication, Information and Communication Policy, 25(10) (2013) pp.37-74.
  2. Ha, S., Seo, S.H., Roh, M.I. and Shin, H.K., Simplified Nonlinear Model for the Weight Estimation of FPSO Plant Topside Using the Statistical Method, Ships and Offshore Structures, 11(6) (2016) pp.603-619. https://doi.org/10.1080/17445302.2015.1038870
  3. Ha, S., Um, T.S., Roh, M.I. and Shin, H.K., A Structural Weight Estimation Model of FPSO Topsides using an Improved Genetic Programming Method, Ships and Offshore Structure, 12(1) (2017) pp.43-55. https://doi.org/10.1080/17445302.2015.1099246
  4. Lee, D.H., Analysis of Production Process in Shipbuilding Industry using Process Mining, Ph.D. thesis, Pusan National University (2014), Korea.
  5. Lee, H.H., Application of Big Data for Strengthen of Manufacturing Business, Seoul, Korea: Korea Institute for Industrial Economics and Trade (KIET), (2013).
  6. Kim, K.I., Jung, J.S. and Park, K.K., Assessment of External Force Acting on Ship using Big Data in Maritime Traffic, Journal of Korea Intelligent Information System Society, 23(5) (2013) pp.379-384. https://doi.org/10.5391/JKIIS.2013.23.5.379
  7. Kim, S.R. and Kang, M.M., The Trends and Prospects in Cloud-Based Bigdata Technology, Journal of Korean Institute of Information Scientists and Engineers, 32(2) (2014) pp.22-31.
  8. Kim, S.R. and Kang, M.M., Today and Tomorrow of Big Data Analysis Technology, Journal of Institute of Information Scientists and Engineers, 32(1) (2014) pp.8-17.
  9. Kim, U.G., Ship & Offshore industry and Big Data collected during Operation of Ships as ICT Convergence Model, Journal of Mechanical Science and Technology, 54(12) (2014) pp.49-52.
  10. Kim, Y.J., Park, J.K., Lee, J.H., Yang, H.Y. and Jung, M.A., A Study on the Bigdata Technology and Analysis Technique for Vessel Design Automation, Journal of Korea Institute of Communication Sciences, 2013(6) (2013) pp.213-215.
  11. Kim, W.K., Park, M.K. and Han, M.K., Design of a Framework for Support System of Ship Design Engineering, Journal of Korea Institute of Information and Communication Engineering, 16(10) (2012) pp.2316-2322. https://doi.org/10.6109/jkiice.2012.16.10.2316
  12. Perera, L.P., Handling Big Data in Ship Performance & Navigation Monitoring, Smart Ship Technology, London, UK, January 24-25, (2017)
  13. Um, T.S., Roh, M.I., Shin, H.K. and Ha, S., Simplified Model for the Weight Estimation of Floating Offshore Structure Using the Genetic Programming Method, Transactions of the Society of CAD/CAM Engineers, 19(1) (2014) pp.1-11. https://doi.org/10.7315/CADCAM.2014.001
  14. Wang, H., Osen, O.L., Li, G., Li, W., Dai, HN. and Zeng, W., Big Data and Industrial Internet of Things for the Maritime Industry in Northwestern Norway, IEEE Region 10 Conference, Macao, China, November 1-4, (2015), doi: 10.1109/TENCON.2015.7372918

Cited by

  1. Weight-Estimation Method of FPSO Topsides Considering the Work Breakdown Structure vol.140, pp.1, 2017, https://doi.org/10.1115/1.4037828