• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제12권7호
• /
• pp.2977-2997
• /
• 2018

In big data era, fresh data grows rapidly every day. More than 30,000 gigabytes of data are created every second and the rate is accelerating. Many organizations rely heavily on real time streaming, while big data stream computing helps them spot opportunities and risks from real time big data. Storm, one of the most common online stream computing platforms, has been used for big data stream computing, with response time ranging from milliseconds to sub-seconds. The performance of Storm plays a crucial role in different application scenarios, however, few studies were conducted to evaluate the performance of Storm. In this paper, we investigate the performance of Storm under different application scenarios. Our experimental results show that throughput and latency of Storm are greatly affected by the number of instances of each vertex in task topology, and the number of available resources in data center. The fault-tolerant mechanism of Storm works well in most big data stream computing environments. As a result, it is suggested that a dynamic topology, an elastic scheduling framework, and a memory based fault-tolerant mechanism are necessary for providing high throughput and low latency services on Storm platform.

• 유통과학연구
• /
• 제22권8호
• /
• pp.65-76
• /
• 2024

Purpose: The study aims to recognize the relationship between big data analytics capabilities, big data analytics process, and perceived business performance from supply chain management to total customer satisfaction. Research design, data and methodology: The study followed a quantitative approach with a descriptive design. The data was collected from leading e-commerce companies in India using a structured questionnaire, and the data was coded and decoded using MS Excel, SPSS, and R language. It was further tested using Cronbach's alpha, KMO, and Bartlett's test for reliability and internal consistency. Results: The results showed that the big data analytics process acts as a robust mediator between big data analytics capabilities and perceived business performance. The 'direct, indirect and total effect of the model' and 'PLS-SEM model' showed that the big data analytics process directly impacts business performance. Conclusions: A complete indirect relationship exists between big data analytics capabilities and perceived business performance through the big data analytics process. The research contributesto e-commerce companies' understanding of the importance of big data analytics capabilities and processes.

• 한국콘텐츠학회:학술대회논문집
• /
• 한국콘텐츠학회 2016년도 춘계 종합학술대회 논문집
• /
• pp.23-24
• /
• 2016

본 논문에서는 과학 데이터 특성을 고려한 아카이브 시스템 설계를 위한 Data Curation Profile을 분석한다. Data Curation Profile은 생명과학데이터, 천문우주 데이터, 지질 데이터화학데이터, 사회과학데이터 등과 같은 13개의 과학데이터로 이루어져 있다. 13개의 과학데이터의 분석된 내용을 바탕으로 아카이브 시스템 설계시 고려해야 할 과학데이터 특성을 도출하고 이를 아카이브 요소 기술과 연계한다.

• 한국세라믹학회지
• /
• 제56권6호
• /
• pp.596-600
• /
• 2019

Artificial intelligence with a sufficient amount of realistic big data in certain applications has been demonstrated to play an important role in designing new materials or in manufacturing high-quality products. To reduce cracks in ceramic products using machine learning, it is desirable to utilize big data in recently developed data-driven optimization schemes. However, there is insufficient big data for ceramic processes. Therefore, we developed a numerical algorithm to make "virtual" manufacturing data sets using indirect methods such as computer simulations and image processing. In this study, a numerical algorithm based on the random walk was demonstrated to generate images of cracks by adjusting the conditions of the random walk process such as the number of steps, changes in direction, and the number of cracks.

• 한국정보통신학회논문지
• /
• 제25권3호
• /
• pp.471-477
• /
• 2021

디스플레이 분야에 스마트 팩토리란 작업 자동화 뿐만 아니라 기존의 공정관리, 이동설비, 공정이상, 결함 분류 등에 AI/BIG DATA 기술을 이용한 보다 효율적인 디스플레이 제조를 의미한다. 과거 디스플레이 제조 과정에서 불량이 나오면 결함 분류, 공정 이상에 대한 대처가 시시각각 달랐기 때문에 이에 대한 많은 시간 소모가 발생했었다. 하지만 디스플레이 제조 분야는 고도화된 공정 장비를 이용해야 하고 불량 원인을 신속하게 파악해 수율을 올리는 것이 디스플레이 제조 산업의 경쟁력이다. 본 논문에는 스마트 팩토리 AI/BIG DATA 기술을 디스플레이 제조에 접목한 사례들에 대해 정리해 보고 기존 방법 대비 어떤 장점이 도출 되어질 수 있는지에 대해 처음으로 분석해 보고자 한다. 이를 통해 향후 AI/BIG DATA를 이용한 디스플레이 제조 분야에 보다 향상된 스마트 팩토리 개발을 위한 사전지식으로 활용하고자 한다.

• Journal of information and communication convergence engineering
• /
• 제20권2호
• /
• pp.96-102
• /
• 2022

We aim to build predictive models for Airbnb's prices using a GPU-accelerated RAPIDS in a big data cluster. The Airbnb Listings datasets are used for the predictive analysis. Several machine-learning algorithms have been adopted to build models that predict the price of Airbnb listings. We compare the results of traditional and big data approaches to machine learning for price prediction and discuss the performance of the models. We built big data models using Databricks Spark Cluster, a distributed parallel computing system. Furthermore, we implemented models using multiple GPUs using RAPIDS in the spark cluster. The model was developed using the XGBoost algorithm, whereas other models were developed using traditional central processing unit (CPU)-based algorithms. This study compared all models in terms of accuracy metrics and computing time. We observed that the XGBoost model with RAPIDS using GPUs had the highest accuracy and computing time.

• 한국신뢰성학회지:신뢰성응용연구
• /
• 제18권3호
• /
• pp.208-212
• /
• 2018

Purpose: The three Vs of volume, velocity and variety are commonly used to characterize different aspects of Big Data. Volume refers to the amount of data, variety refers to the number of types of data and velocity refers to the speed of data processing. According to these characteristics, the size of Big Data varies rapidly, some data buckets will contain outliers, and buckets might have different sizes. Correlation plays a big role in Big Data. We need something better than usual correlation measures. Methods: The correlation measures offered by traditional statistics are compared. And conditions to meet the characteristics of Big Data are suggested. Finally the correlation measure that satisfies the suggested conditions is recommended. Results: Mutual Information satisfies the suggested conditions. Conclusion: This article builds on traditional correlation measures to analyze the co-relation between two variables. The conditions for correlation measures to meet the characteristics of Big Data are suggested. The correlation measure that satisfies these conditions is recommended. It is Mutual Information.

• 국제학술발표논문집
• /
• The 6th International Conference on Construction Engineering and Project Management
• /
• pp.276-279
• /
• 2015

Along with the increase of the quantity of data in various industries, the construction industry has also developed various systems focusing on collecting data related to the construction performance such as productivity and costs achieved in construction job sites. Numerous researchers worldwide have been focusing on developing efficient methodologies to analyze such data. However, applications of such methodologies have shown serious limitations on practical applications due to lack of data and difficulty in finding appropriate analytic methodologies which were capable of implementing significant insights. With development of information technology, the new trend in analytic methodologies has been introduced and steeply developed with the new name of "big data analysis" in various fields in academia and industry. The new concept of big data can be applied for significant analysis on various formats of construction data such as structured, semi-structured, or non-structured formats. This study investigates preliminary application methods based on data collected from actual construction site. This preliminary investigation in this study expects to assess fundamental feasibility of big data analytic applications in construction.

• 한국융합학회논문지
• /
• 제4권1호
• /
• pp.43-48
• /
• 2013

Designing of similarity on high dimensional data was done. Similarity measure between high dimensional data was considered by analysing neighbor information with respect to data sets. Obtained result could be applied to big data, because big data has multiple characteristics compared to simple data set. Definitely, analysis of high dimensional data could be the pre-study of big data. High dimensional data analysis was also compared with the conventional similarity. Traditional similarity measure on overlapped data was illustrated, and application to non-overlapped data was carried out. Its usefulness was proved by way of mathematical proof, and verified by calculation of similarity for artificial data example.

• 산업경영시스템학회지
• /
• 제42권4호
• /
• pp.84-90
• /
• 2019

Lately, there have been tremendous shifts in the business technology landscape. Advances in cloud technology and mobile applications have enabled businesses and IT users to interact in entirely new ways. One of the most rapidly growing technologies in this sphere is business intelligence, and associated concepts such as big data and data mining. BI is the collection of systems and products that have been implemented in various business practices, but not the information derived from the systems and products. On the other hand, big data has come to mean various things to different people. When comparing big data vs business intelligence, some people use the term big data when referring to the size of data, while others use the term in reference to specific approaches to analytics. As the volume of data grows, businesses will also ask more questions to better understand the data analytics process. As a result, the analysis team will have to keep up with the rising demands on the infrastructure that supports analytics applications brought by these additional requirements. It's also a good way to ascertain if we have built a valuable analysis system. Thus, Business Intelligence and Big Data technology can be adapted to the business' changing requirements, if they prove to be highly valuable to business environment.