• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2015.05a
• /
• pp.741-743
• /
• 2015

오늘날 BI(Business Intelligence)시스템 다차원 데이터를 다루는 많은 방법들이 제안되어 TB 이상의 데이터를 다룰 수 있다. 하지만 IT 전문가 및 IT에 대한 투자여력이 충분하지 않은 중소 제조 기업들은 발 맞춰가기 힘들다. 또한 생산관리시스템(MES)을 미 도입한 기업이 대다수이고, 존재하는 현장데이터의 대부분도 수기데이터 또는 Excel 데이터로 보관 되어 있어, 수작업에 의한 데이터 분석과 의사결정을 수행한다. 이로 인해, 불량 요인 파악이나 이상 현상 파악이 불분명하기 때문에 데이터 분석에 어려움을 겪는다. 이에 본 연구에서는 중소제조기업의 경쟁력 강화를 위하여 제조 기업현장에서 사용되는 데이터를 자동으로 수집하여 정제 및 처리하여 저장이 가능하도록 하는 빅 데이터 분석 시스템 모델을 개발하였다. 이 분석 시스템 모델은 ERP, MIS 등에 존재하는 데이터들이 각 시스템의 DB 기능을 활용하여 데이터를 추출하고 정제하여 수집하는 ETL(Extract Transform Loading)과정을 통한다. 현장에서 비정형으로 기록되고 있는 정보들(ex. Excel)은 ODE(Office Data Excavation)모듈을 통해 문서의 패턴을 자동으로 인식하고 정형화된 정보로서 추출, 정제되어 수집된다. 저장된 데이터는 오픈소스 데이터 시각화 라이브러리인 D3.js를 이용하여 다양한 chart들을 통한 강력한 시각효과를 제공함으로써, 정보간의 연관 관계 및 다차원 분석의 기반을 마련하여 의사결정체계를 효과적으로 지원한다. 또한, 높은 가격에 형성되어 있는 빅데이터 솔루션을 대신해 오픈소스 Spago BI를 이용하여 경제적인 빅 데이터 솔루션을 제공한다. 본 연구의 기대효과로는 첫째, 현장 데이터 중심의 효과적인 의사결정 기반을 마련할 수 있다. 둘째, 통합 데이터 기반의 연관/다차원 분석으로 경영 효율성이 향상된다. 마지막으로, 중소 제조기업 환경에 적합한 분석 시스템을 구축함으로써 경쟁력과 생산력을 강화한다.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.1
• /
• pp.655-661
• /
• 2023

Big data, an important element of the 4th industrial revolution, is actively opening public data in public institutions and local governments. In the public data portal, everyone can conveniently search for data and check related data, but only those in ICT-related fields are using public data. Although data held by public institutions is open to citizens, it is difficult for anyone to easily utilize public data to develop applications. In this paper, data provided in open API format from public data portals has XML and JSON formats. In this study, we are a method of modularizing public data in XML format into a part that can be easily developed by linking it to a GUI interface. Based on the necessary public data, we propose a way to easily develop mobile programs and promote the use of public data.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.16 no.4
• /
• pp.193-202
• /
• 2023

In recent years, the outstanding performance of large language models (LLMs) trained on extensive datasets has become a hot topic. Since studies on LLMs are available on open-source approaches, the ecosystem is expanding rapidly. Models that are task-specific, lightweight, and high-performing are being actively disseminated using additional training techniques using pre-trained LLMs as foundation models. On the other hand, the performance of LLMs for Korean is subpar because English comprises a significant proportion of the training dataset of existing LLMs. Therefore, research is being carried out on Korean-specific LLMs that allow for further learning with Korean language data. This paper identifies trends of open source based LLMs and introduces research on Korean specific large language models; moreover, the applications and limitations of large language models are described.

• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.10
• /
• pp.409-418
• /
• 2022

In this paper, we propose SAAnnot-C3Pap, a semi-automatic annotation method for obtaining ground truth of a player's posture. In order to obtain ground truth about the two-dimensional joint position in the existing music domain, openpose, a two-dimensional posture estimation method, was used or manually labeled. However, automatic annotation methods such as the existing openpose have the disadvantages of showing inaccurate results even though they are fast. Therefore, this paper proposes SAAnnot-C3Pap, a semi-automated annotation method that is a compromise between the two. The proposed approach consists of three main steps: extracting postures using openpose, correcting the parts with errors among the extracted parts using supervisely, and then analyzing the results of openpose and supervisely. Perform the synchronization process. Through the proposed method, it was possible to correct the incorrect 2D joint position detection result that occurred in the openpose, solve the problem of detecting two or more people, and obtain the ground truth in the playing posture. In the experiment, we compare and analyze the results of the semi-automated annotation method openpose and the SAAnnot-C3Pap proposed in this paper. As a result of comparison, the proposed method showed improvement of posture information incorrectly collected through openpose.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.40 no.5
• /
• pp.393-402
• /
• 2022

Effective data management of underground facilities is very important in terms of human life. For this, input of up-to-date and high-accuracy data should be preceded. Therefore, it is important to have an efficient data input method. In this study, by developing a sewage facility site survey program using open source software, paper drawings could be replaced with tablet PCs. By using a tablet PC, figures and property information acquired from the field are transmitted in real time through a database server. PostGIS query is developed to automate structured editing to minimize manual work in constructing a GIS (Geographic Information System) database for sewage facilities. did. In addition, the database was built using the sewage facility GIS database building program. As a result of comparing and analyzing the existing sewage facility database construction, work process, and work time, the work process was simplified and work time was shortened. In addition, through simple customization of open source software, it will be able to be used for field surveys and database construction in other fields.

• Journal of the Korean Association of Geographic Information Studies
• /
• v.22 no.4
• /
• pp.215-228
• /
• 2019

HDF5 data format is used to effectively store and distribute large volume of Geostationary Ocean Color Imager(GOCI) satellite data. The Korea Ocean Satellite Center has developed and provided a GOCI Data Processing System(GDPS) for general users who are not familiar with HDF5 format. Nevertheless, it is not easy to merge and process Hierarchical Data Format version5(HDF5) data that requires an understanding of satellite data characteristics, needs to learn how to use GDPS, and stores location and attribute information separately. Therefore, the open source R and rhdf5, data.table, and matrixStats packages were used to develop algorithm that could easily utilize satellite data in HDF5 format without the need for the process of using GDPS.

• Smart Media Journal
• /
• v.10 no.2
• /
• pp.110-118
• /
• 2021

The Internet of Things (IoT) technology, a key growth engine of the 4th industrial revolution, has grown to a stage where it can autonomously communicate with each other and process data according to space and circumstances. Accordingly, the IT infrastructure becomes increasingly complex and the importance of the monitoring field for maintaining the system stably is increasing. Monitoring technology has been used in the past, but there is a need to find a flexible monitoring system that can respond to the rapidly changing ICT technology. This paper conducts research on designing and testing an open source-based Prometheus monitoring system. We builds a simple infrastructure based on IoT devices and collects data about devices through the Exporter. Prometheus collects data based on pull and then integrates into one dashboard using Grafana and visualizes data to monitor device information.

• Journal of Integrative Natural Science
• /
• v.13 no.3
• /
• pp.114-119
• /
• 2020

IoT 및 사물인터넷 기반 빅데이터 시스템을 구축하는 경우 발생하는 빈번한 전송에 따른 데이터 오류율과 자원의 비효율적 이용율을 극복하기 위하고 오픈소스기반 하둡시스템의 문제점을 극복하기 위한 본 연구에서는 순수 하둡을 기반으로 적용된 결과를 분석하고 하둡 2.x대 버전을 기준으로 빅데이터 시스템의 용량을 산정한 가이드를 제시하고 용량 산정의 기준을 에코 소프트웨어 적용 플랫폼을 제안한다.

• Journal of the Korean Society for information Management
• /
• v.40 no.3
• /
• pp.25-54
• /
• 2023

At a time when open data receives attention as an international trend, there is a need to discuss the role of international journals in Korea to support data sharing. Based on surveys and interviews of editors from the international journals, we identified factors affecting the policy adoption and examined the journal editors' perception on the adoption and components of the data sharing policy. As a result, scholarly journals that have adopted or are planning to adopt policies have recognized that data sharing is an international trend and can contribute to research development, but they stressed that efforts to improve the perception of data sharing were still necessary. Educational activities and compensation for sharing data were needed at scholarly journals' and communities' level. Also, components perceived important and selected by more than half of the editors as mandatory were 'data availability statement', 'data sharing level', 'data sharing method', and 'data citation'. While scholarly journals do not always need to mandate data sharing, it was necessary to mention conditions where data cannot be shared through data availability statements. The role of the organization developing and operating a repository appropriate for situations in Korea was also emphasized. In addition, by identifying factors affecting the policy adoption, significant differences were found in Journal Impact Factor quartiles, publication type, and subject area. This finding indicated that journals with a high impact factor are likely to have resources to support data sharing, and open access or hybrid journals are likely to have interest in open data as a part of open science. In the medical research area, active movements for data sharing in academic communities have promoted the adoption of data sharing policies. This study would be used as basic data to facilitate the adopton and operation of scholarly journals' data sharing policies in Korea.

• Proceedings of the Korea Contents Association Conference
• /
• 2017.05a
• /
• pp.65-66
• /
• 2017

최근 오픈 사이언스 운동과 함께 정부 부처, 연구비 지원기관 등에서는 공적 기금으로 연구를 수행하는 경우 생성된 각종 연구 데이터를 관리하고 공개하도록 의무화하려는 움직임이 있다. 데이터에 DOI와 같은 식별자를 부여하여 데이터 리파지토리를 통해 출판하면 이해당사자들에게 많은 이익을 가져다 줄 수 있으며, 데이터의 인용을 활성화하기 위해 주제별 또는 기관별 리파지토리나 데이터센터에서 표준적인 인용 방법과 인용 요소들을 발표하고 있다. 앞으로 과학연구의 공개, 개방화가 더욱 추진되면 더욱 많은 연구데이터의 공유 활동이 일어날 것으로 예상되며 분야별 또는 유형별로 국제적인 데이터 리파지토리들이 출현하여 학술 논문의 근거가 되는 데이터 저장소로서의 역할을 수행할 것으로 생각된다.