• Journal of Practical Engineering Education
• /
• v.12 no.1
• /
• pp.31-39
• /
• 2020

Big data analysis is analyzed and used in a variety of management and industrial sites, and plays an important role in management decision making. The job competency of big data analysis personnel engaged in management analysis work does not necessarily require the acquisition of microscopic IT skills, but requires a variety of experiences and humanities knowledge and analytical skills as a Data Scientist. However, big data education by state-run and state-run educational institutions and job education institutions based on the National Competency Standards (NCS) is proceeding in terms of software engineering, and this teaching methodology can have difficult and inefficient consequences for non-technical majors. Therefore, we analyzed the current Big Data platform and its related technologies and defined which of them are the requisite job competency requirements for field personnel. Based on this, the education courses for big data analysis and visualization techniques were organized for non-technical-based majors. This specialized curriculum was conducted by working-level officials of financial institutions engaged in management analysis at the management site and was able to achieve better educational effects The education methods presented in this study will effectively carry out big data tasks across industries and encourage visualization of big data analysis for non-technical professionals.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.15 no.6
• /
• pp.17-24
• /
• 2015

With the rapid growth of Information technology and up-to-date wireless network application technologies, huge and various types of data are produced in every moment, the value and significance of the analysis techniques using big data are increased recently. Big data, which were useless since they were too huge to manage in the past, enables us to get new inspirations and values in various practical application areas through the development of big data computing devices and analytic tools. Nowadays, however, it is true that most of the big data are still wasted without properly analyzed and used. In the long run, the preliminary stipulations for finding inspirations and extracting new values from big data are securing big data analysis and application techniques to process big data efficiently. In this paper, we study accurate data analysis techniques and data process technologies those are able to extract needed inspirations and values from big data efficiently, then design the smart application that adopts these techniques practically.

• The Journal of Bigdata
• /
• v.4 no.2
• /
• pp.93-103
• /
• 2019

In this paper, we introduce a big data platform and a metadata management technique for fishery science R & D information. The big data platform collects and integrates various types of fisheries science R & D information and suggests how to build it in the form of a data lake. In addition to existing data collected and accumulated in the field of fisheries science, we also propose to build a big data platform that supports diverse analysis by collecting unstructured big data such as satellite image data, research reports, and research data. Next, by collecting and managing metadata during data extraction, preprocessing and storage, systematic management of fisheries science big data is possible. By establishing metadata in a standard form along with the construction of a big data platform, it is meaningful to suggest a systematic and continuous big data management method throughout the data lifecycle such as data collection, storage, utilization and distribution.

• Journal of Digital Convergence
• /
• v.13 no.9
• /
• pp.269-276
• /
• 2015

Recently, with the activation of the industry related to the big data, the global security companies have expanded their scopes from structured to unstructured data for the intelligent security threat monitoring and prevention, and they show the trend to utilize the technique of user's tendency analysis for security prevention. This is because the information scope that can be deducted from the existing structured data(Quantify existing available data) analysis is limited. This study is to utilize the analysis of security tendency(Items classified purpose distinction, positive, negative judgment, key analysis of keyword relevance) applying the machine learning algorithm($Na{\ddot{i}}ve$ Bayes, Decision Tree, K-nearest neighbor, Apriori) in the big data environment. Upon the capability analysis, it was confirmed that the security items and specific indexes for the decision of security tendency could be extracted from structured and unstructured data.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2019.05a
• /
• pp.429-429
• /
• 2019

최근 들어 이상기후 등 다양한 환경적 요인으로 인해 국지적이고 집중적인 호우가 빈발하고 있으며 도로상의 교통체증과 도로재해가 사회적으로 큰 문제가 되고 있다. 이러한 문제를 해결하기 위해서는 실시간, 단기간 이동성 강우정보 기술과 도로 기상정보를 활용할 수 있는 방법에 대한 연구가 필요하다. 본 연구는 차량의 AW(AutoWiping) 기능을 위해 장착된 강우센서를 이용하여 강우정보를 생산하는 기술을 개발하고자 하였다. 강우센서는 총 4개의 채널로 이루어져있고, 초당 250개의 광신호 데이터를 수집하며, 1시간이면 약 360만 개의 데이터가 생산되게 된다. 5단계의 인공강우를 재현하여 실내 인공강우실험을 실시하고 이를 통해 강우센서 데이터와 강우량과의 상관성을 W-S-R관계식으로 정의하였다. 실내실험데이터와 비교하여 외부환경 및 데이터 생성조건이 다른 실외 데이터의 누적값을 계산하기 위해 Threshold Map 방식을 개발하였다. 강우센서에서 생산되는 대량의 데이터를 이용하여 실시간으로 정확한 강우정보를 생산하기 위해 빅 데이터 처리기법을 사용하여 계산된 실내 데이터의 Threshold를 강우강도 및 채널에 따라 평균값을 계산하고 $4{\times}5$ Threshold Map(4 = 채널, 5 = 강우정보 사상)을 생성하였고 강우센서 기반의 강우정보 생산에 적합한 빅데이터 처리기법을 선정하기 위하여 빅데이터 처리기법 중 Gradient Descent와 Optima Rainfall Intensity을 적용하여 분석하고 결과를 지상 관측강우와 비교검증을 하였다. 이 결과 Optima Rainfall Intensity의 적합도를 검증하였고 실시간으로 관측한 8개 강우사상을 대상으로 강우센서 강우를 생산하였다.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.13 no.2
• /
• pp.1-7
• /
• 2013

Big data management is becoming increasingly important in both industry and academia of information science community. One of the important categories of big data generated from software systems is log data. Log data is generally used for better services in various service providers and can also be used as information for qualification. This paper presents a big data management architecture specialized for log data. Specifically, it provides the aggregation of log messages sent from multiple clients and provides intelligent functionalities such as analyzing log data. The proposed architecture supports an asynchronous process in client-server architectures to prevent the potential bottleneck of accessing data. Accordingly, it does not affect the client performance although using remote data store. We implement the proposed architecture and show that it works well for processing big log data. All components are implemented based on open source software and the developed prototypes are now publicly available.

• Journal of Korea Entertainment Industry Association
• /
• v.14 no.4
• /
• pp.145-153
• /
• 2020

In the rapidly changing era of the fourth industry, big data is being used in various fields. In recent years, the use of big data has been rapidly applied to overall cultural and artistic contents, and among them, the use of big data is essential as a film genre with a lot of capital. This research method is analyzed as the film , which won the Palme d'Or Prize of the 72nd Cannes Film Festival in 2019 and the works and directors' award at the Academy Awards. The analyzed value predicts the film's performance through opinion mining, which gives the value of the change and sensitivity of each data cycle, and extracts the utilization index and topic keywords of SNS such as Facebook and Twitter to reflect the audience's interest. Identify the factors. As such, if model performance and model development can be predicted through model analysis of film performance using big data, the efficiency of the film production process will be maximized while the risk of production cost and the risk of film failure will be minimized.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2016.10a
• /
• pp.66-67
• /
• 2016

최근 수많은 국 내외 글로벌 기업들이 클라우드 자원의 제공자 겸 소비자 역할을 하는 프라이빗 IaaS 클라우드 환경을 구축하고 있는 추세이며 이를 위해 오픈소스 클라우드 플랫폼인 오픈스택(OpenStack)이 많이 사용되고 있다. 이 논문에서는 대규모 빅데이터 처리를 위해 오픈스택 클라우드 환경의 가상머신 라이브 마이그레이션 기법을 사용할 경우 발생할 수 있는 문제점을 분석한다. 이러한 문제점에 대하여 가상머신에서 빅데이터 연산 처리 시 스토리지 병목현상을 해결하기 위한 마이그레이션 기법을 제시한다.

• Journal of Digital Convergence
• /
• v.14 no.4
• /
• pp.251-258
• /
• 2016

Big data processing is a broad term for processing data sets so large or complex that traditional data processing applications are inadequate. Widespread use of smart devices results in a huge impact on the way we process data. Many organizations are contemplating how to incorporate or integrate those devices into their enterprise data systems. We have proposed a way to process big data by way of integrating Raspberry Pi into a Hadoop cluster as a computational grid. We have then shown the efficiency through several experiments and the ease of scaling of the proposed system.

• Proceedings of the Korea Contents Association Conference
• /
• 2014.11a
• /
• pp.223-224
• /
• 2014

최근 빅데이터 시대에 다가와서 소셜 네트워크 서비스(Social Network Service)가 중요한 정보 공유의 수단으로 발전함에 따라 그에 따른 예측분석, 동향분석, 이슈탐지 등이 증가하고 있으며, 콘텐츠 분야에서 빅데이터 기법 사례가 증가하는 추세이다. 모바일기기 보급이 빠르게 확산되면서 SNS 활성화와 함께 많은 양의 데이터가 증가하고 있으며, 인스타그램과 같은 해시태그 사용 가능 SNS 서비스에서 해시태그의 동시출현은 해시태그만의 연관성이 있음을 의미한다. 본 논문에서는 대상 SNS의 동시출현 해시태그를 분석하기 위해 발생되는 데이터를 가지고 현재 트렌드에 맞게 분석하여 정보를 제공하는 방법을 제시한다.