• Title/Summary/Keyword: Processing method

Search Result 18,070, Processing Time 0.041 seconds

Concurrency Control Method to Provide Transactional Processing for Cloud Data Management System

  • Choi, Dojin;Song, Seokil
    • International Journal of Contents
    • /
    • v.12 no.1
    • /
    • pp.60-64
    • /
    • 2016
  • As new applications of cloud data management system (CDMS) such as online games, cooperation edit, social network, and so on, are increasing, transaction processing capabilities for CDMS are required. Several transaction processing methods for cloud data management system (CDMS) have been proposed. However, existing transaction processing methods have some problems. Some of them provide limited transaction processing capabilities. Some of them are hard to be integrated with existing CDMSs. In this paper, we proposed a new concurrency control method to support transaction processing capability for CDMS to solve these problems. The proposed method was designed and implemented based on Spark, an in-memory distributed processing framework. It uses RDD (Resilient Distributed Dataset) model to provide fault tolerant to data in the main memory. In our proposed method, database stored in CDMS is loaded to main memory managed by Spark. The loaded data set is then transformed to RDD. In addition, we proposed a multi-version concurrency control method through immutable characteristics of RDD. Finally, we performed experiments to show the feasibility of the proposed method.

Comparison of Sentiment Analysis from Large Twitter Datasets by Naïve Bayes and Natural Language Processing Methods

  • Back, Bong-Hyun;Ha, Il-Kyu
    • Journal of information and communication convergence engineering
    • /
    • v.17 no.4
    • /
    • pp.239-245
    • /
    • 2019
  • Recently, effort to obtain various information from the vast amount of social network services (SNS) big data generated in daily life has expanded. SNS big data comprise sentences classified as unstructured data, which complicates data processing. As the amount of processing increases, a rapid processing technique is required to extract valuable information from SNS big data. We herein propose a system that can extract human sentiment information from vast amounts of SNS unstructured big data using the naïve Bayes algorithm and natural language processing (NLP). Furthermore, we analyze the effectiveness of the proposed method through various experiments. Based on sentiment accuracy analysis, experimental results showed that the machine learning method using the naïve Bayes algorithm afforded a 63.5% accuracy, which was lower than that yielded by the NLP method. However, based on data processing speed analysis, the machine learning method by the naïve Bayes algorithm demonstrated a processing performance that was approximately 5.4 times higher than that by the NLP method.

Development of Two Dimensional Position Measuring Device for Floating Structure Using an Image Processing Method (이미지 프로세싱을 이용한 부유구조물의 2차원 위치 계측장치 개발)

  • 지명석;김성근;김상봉
    • Journal of Ocean Engineering and Technology
    • /
    • v.8 no.2
    • /
    • pp.166-172
    • /
    • 1994
  • This paper presents an image processing method for two dimensional position measurement of a floating structure. This method is based on image processing technique using concept of window and threshold processing to track the target object. The experimental results for position measurement of the target object in two dimensional water tank demonstrate the validity of this method.

  • PDF

Electronic Document Automation System Model for Improving Productivity in maintenance work - in Inspection Process of Construction Equipment Maintenance - (정비작업의 생산성 향상을 위한 전자문서자동화시스템 모형 - 건설장비 정비작업을 중심으로 -)

  • Kong, Myung-Dal
    • Journal of the Korea Safety Management & Science
    • /
    • v.19 no.3
    • /
    • pp.49-58
    • /
    • 2017
  • This paper suggests a specific model that could efficiently improve the interaction and the interface between MES(Manufacturing Execution System) server and POP(Point of Production) terminal through electronic document server and electronic pen, bluetooth receiver and form paper in disassembly and process inspection works. The proposed model shows that the new method by electronic document automation system can more efficiently perform to reduce processing time for maintenance work, compared with the current approach by handwritten processing system. It is noted in case of the method by electronic document automation system that the effects of proposed model are as follows; (a) While the processing time per equipment for maintenance by the current method was 300 minutes, the processing time by the new method was 50 minutes. (b) While the processing error ratio by the current method was 20%, the error ratio by the new method was 1%.

Detection of Knots by Image Processing Technique (화상처리기술을 이용한 옹이의 검출)

  • 김병남;이형우
    • Journal of the Korea Furniture Society
    • /
    • v.12 no.1
    • /
    • pp.27-37
    • /
    • 2001
  • Automation of wood processing is strongly required to improve the productivity and quality of wood products in wood industry which is one of the most labor-intensive industries. Classification of surface defects on wood boards such as knots is one of the important steps towards a completely automated wood processing system. In this study the possibility of detection of knots by image processing technique was investigated. Algorithm for the automatic determination of threshold value was developed to enhance the flexibility of image processing system. Two different approaches, grid method and tile method, were developed to enhance the speed in extracting features from images. Grid method showed slightly higher processing speed and tile method proved much more stable in determining threshold values. Tile size of $5{\times}5$ pixels or $6{\times}6$ pixels was found to be proper to get stable results with resonable processing time.

  • PDF

In-Memory Based Incremental Processing Method for Stream Query Processing in Big Data Environments (빅데이터 환경에서 스트림 질의 처리를 위한 인메모리 기반 점진적 처리 기법)

  • Bok, Kyoungsoo;Yook, Misun;Noh, Yeonwoo;Han, Jieun;Kim, Yeonwoo;Lim, Jongtae;Yoo, Jaesoo
    • The Journal of the Korea Contents Association
    • /
    • v.16 no.2
    • /
    • pp.163-173
    • /
    • 2016
  • Recently, massive amounts of stream data have been studied for distributed processing. In this paper, we propose an incremental stream data processing method based on in-memory in big data environments. The proposed method stores input data in a temporary queue and compare them with data in a master node. If the data is in the master node, the proposed method reuses the previous processing results located in the node chosen by the master node. If there are no previous results of data in the node, the proposed method processes the data and stores the result in a separate node. We also propose a job scheduling technique considering the load and performance of a node. In order to show the superiority of the proposed method, we compare it with the existing method in terms of query processing time. Our experimental results show that our method outperforms the existing method in terms of query processing time.

Implementation of Parallel Processing Based Pedestrian Detection Using a Modified CENTRIST Algorithm (개선된 CENTRIST 알고리즘을 적용한 병렬처리 기반 보행자 인식 구현)

  • Jung, Jun-Mo
    • Journal of IKEEE
    • /
    • v.18 no.3
    • /
    • pp.398-402
    • /
    • 2014
  • In this paper, we propose a parallel processing method of pedestrian detection algorithm based on ROI-CENTRIST. There is a difficulty in the real-time processing of pedestrian detection in the embedded environment, using the conventional pedestrian detection method. This problem can be solved by a parallel processing method of applying the ROI to the conventional algorithm. The proposed parallel processing method of pedestrian detection using ROI-CENTRIST show the result of 5.2 frames per second, which is about 10% improvement over the conventional pedestrian detection method based on CENTRIST.

Measurement of Surface Crack Length Using Image Processing Technology (영상처리기법을 이용한 표면균열길이 측정)

  • Nahm, Seung-Hoon;Kim, Yong-Il;Kim, Si-Cheon;Ryu, Dae-Hyun
    • Proceedings of the KSME Conference
    • /
    • 2001.06a
    • /
    • pp.96-101
    • /
    • 2001
  • The development of a new experimental method is required to easily observe the growth behavior of fatigue cracks. To satisfy the requirement, an image processing technique was introduced to fatigue testing. The length of surface fatigue crack could be successfully measured by the image processing system. At first, the image data of cracks were stored into the computer while the cyclic loading was interrupted. After testing, crack length was determined using image processing software which was developed by ourselves. Block matching method was applied to the detection of surface fatigue cracks. By comparing the data measured by image processing system with the data measured by manual measurement with a microscope, the effectiveness of the image processing system was established. If the proposed method is used to monitor and observe the crack growth behavior automatically, the time and efforts for fatigue test could be dramatically reduced.

  • PDF

Tree aging observation of XLPE by image processing (화상처리에 의한 XLPE의 트리열화관측)

  • 임장섭;김태성;길촌승
    • Electrical & Electronic Materials
    • /
    • v.8 no.5
    • /
    • pp.551-557
    • /
    • 1995
  • For the observation of treeing, a visual measurement with an optical microscope has been used to explain breakdown mechanism in high-voltage systems. The conventional directed visual method of tree aging observation is difficult to measure in short time processing, and it is impossible to analyze on tree degradation area, progressed direction, tree pattern, etc. By using an image processing technique, the tree features which appear immediately after the tree initiation as well as changes in the configuration of the tree can be easily measured and observed than using the conventional visual methods. In this paper, we have developed a tree observating system by using image processing for tree growth, degradation area and other treeing progress. As an experimental result, it can be concluded that the image processing method is a more effective alternative than directed visual observation method. As a matter of fact, it is possible to record the image of tree propagation immediately after its first appearance and explain the characteristics of tree growth froth the computer processing image.

  • PDF

A Study on the Base Material Specific and Processing Methods of Recycled New Materials in Space (실내공간에 사용되는 재활용 신재료의 소재 및 가공방법 연구)

  • Seo, Ji-Eun;Jeong, Hee-Jeong
    • Korean Institute of Interior Design Journal
    • /
    • v.21 no.3
    • /
    • pp.22-30
    • /
    • 2012
  • Nowadays the issue of environmental pollution and ecological destruction is not a simple issue but an important issue to be continuously considered. It is deemed that a study for recycled new materials is immediately required and this study is to analyze features and processing methods of new materials which can be used to interior space. We found the recycled new materials used for space through researching various web sits. And then we analyzed what the base materials are and classified that base materials are whether natural or artificial of the recycled materials. We classified processing methods of the recycled new materials after researching general processing methods. The result of this study would be an important material to the research and development of new finishing materials with consideration of environment and to the research for a guideline of applicable new materials. The results of this study are as follows : First, we could classify widely 2 categories into natural material and artificial material and then 10 subcategories into metal, glass, wood, rubber, stone, plastic, leather or fabric, ceramic, concrete and so on, and analyzed that which material is mostly used and whether it is single material or multiple material. In order to analyze the feature of processing method. Second, we could classify into 4 categories such as junction, surface process, molding, and insert, and found out which processing method is applied based on objects of research. Third, as an analysis result of the recycled new material feature, in order to develop various new materials, it is required to study on combination and application of 2 materials or more rather than single material. Four, as a analysis result of the processing method feature, I would like to suggest that development and application of various processing methods are required. Especially, it is necessary to grope for a way to develop new functional materials for interior space through a systemic research and analysis of processing method of other fields. Furthermore, a way to reuse recycled new materials should be considered in a stage of selection and application of processing method.

  • PDF