• 제목/요약/키워드: Distributed Processing System

Search Result 1,182, Processing Time 0.028 seconds

A Simulated Distributed Database System for Response Time Evaluation (응답시간평가를 위한 분산데이터베이스 시뮬레이션시스템)

  • Rho, Sang-Kyu
    • Asia pacific journal of information systems
    • /
    • v.7 no.3
    • /
    • pp.23-37
    • /
    • 1997
  • Although numerous models and solution algorithms to design efficient distributed databases have been developed, very few have been validated for their effectiveness. In this paper, we develop a simulation system which can be used to analyze and validate the average response time of distributed database designs. Our simulation system models comprehensive query processing strategies such as semijoin as well as a concurrency control mechanism We analyze and validate an average response time distributed database design model using our simulation system.

  • PDF

Concurrency Control Method to Provide Transactional Processing for Cloud Data Management System

  • Choi, Dojin;Song, Seokil
    • International Journal of Contents
    • /
    • v.12 no.1
    • /
    • pp.60-64
    • /
    • 2016
  • As new applications of cloud data management system (CDMS) such as online games, cooperation edit, social network, and so on, are increasing, transaction processing capabilities for CDMS are required. Several transaction processing methods for cloud data management system (CDMS) have been proposed. However, existing transaction processing methods have some problems. Some of them provide limited transaction processing capabilities. Some of them are hard to be integrated with existing CDMSs. In this paper, we proposed a new concurrency control method to support transaction processing capability for CDMS to solve these problems. The proposed method was designed and implemented based on Spark, an in-memory distributed processing framework. It uses RDD (Resilient Distributed Dataset) model to provide fault tolerant to data in the main memory. In our proposed method, database stored in CDMS is loaded to main memory managed by Spark. The loaded data set is then transformed to RDD. In addition, we proposed a multi-version concurrency control method through immutable characteristics of RDD. Finally, we performed experiments to show the feasibility of the proposed method.

Distributed Processing System Design and Implementation for Feature Extraction from Large-Scale Malicious Code (대용량 악성코드의 특징 추출 가속화를 위한 분산 처리 시스템 설계 및 구현)

  • Lee, Hyunjong;Euh, Seongyul;Hwang, Doosung
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.8 no.2
    • /
    • pp.35-40
    • /
    • 2019
  • Traditional Malware Detection is susceptible for detecting malware which is modified by polymorphism or obfuscation technology. By learning patterns that are embedded in malware code, machine learning algorithms can detect similar behaviors and replace the current detection methods. Data must collected continuously in order to learn malicious code patterns that change over time. However, the process of storing and processing a large amount of malware files is accompanied by high space and time complexity. In this paper, an HDFS-based distributed processing system is designed to reduce space complexity and accelerate feature extraction time. Using a distributed processing system, we extract two API features based on filtering basis, 2-gram feature and APICFG feature and the generalization performance of ensemble learning models is compared. In experiments, the time complexity of the feature extraction was improved about 3.75 times faster than the processing time of a single computer, and the space complexity was about 5 times more efficient. The 2-gram feature was the best when comparing the classification performance by feature, but the learning time was long due to high dimensionality.

The impact of distributed/open architecture on Seoul regional control center SCADA system of KEPCO (한국전력 서울지역급전소 SCADA 시스템의 분산/개방형 구조)

  • 김용팔
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1993.10a
    • /
    • pp.1147-1154
    • /
    • 1993
  • This paper introduces a case of SCADA System replacing from centralized processing system to distributed/open architecture system. The cons and pros of the distinctive two system configurations were studied and the requirements of new system that would be enable to easily follow 21 century's technical and operational inovation were presented.

  • PDF

The Analysis of Mobile Agent System for the Wide Distributed Processing (광역 분산 처리 환경에서의 모바일 에이전트 시스템 분석)

  • 방정원
    • Journal of the Korea Society of Computer and Information
    • /
    • v.8 no.4
    • /
    • pp.132-137
    • /
    • 2003
  • Due to the advances of the Internet technologies and web-based applications, the demand for wide distributed processing is increased. Mobile Agents have been proposed as a model to meet with the requirement for such environment. But current mobile agent system has the technical restriction. The requirement of mobile agent for the wide distributed processing is analysed in mobile agent system architecture, programming paradigm and technologies.

  • PDF

On the Current Status and Future Trend of Distributed Object System (분산 객체 시스템의 현찰과 기술 전망)

  • 윤석환;김평중
    • Journal of the Korean Professional Engineers Association
    • /
    • v.30 no.2
    • /
    • pp.79-86
    • /
    • 1997
  • As network has high speed and wide communication capability, users demand diverse and new software to satisfy their needs. To meet users needs, the softwares for multimedia or groupware or distributed virtual environments can communicate the widely distributed information fast and accurately. Even though the technology for this is under development, it is deficient to support the reliable computer communication. Distributed Object System aims, as the new paradigm of distributed system software development to overcome this problem, to obtain in distributed environment the easiness of development and management, expandability, reusability which object oriented technologies support by solving the complexity of communication processing through the object oriented methods. This paper aims to introduce distributed object system, its technological properties and the current status and trend of technology development related to its standardization. Additionally, with explaining the Replicated Shared Object System(RSOS) which is developed in our country as one of the distributed object systems, its future prospects and technical issues are discussed.

  • PDF

Ontology data processing method in distributed semantic web environment (분산 시맨틱웹 환경에서의 온톨로지 데이터 처리 기법 연구)

  • Kim, Byung-Gon;Oh, Sung-Kyun
    • Journal of Digital Contents Society
    • /
    • v.9 no.2
    • /
    • pp.277-284
    • /
    • 2008
  • As the increasing of users' request about internet web service, the importance of ontology to construct semantic web is increasing now. Early Internet data processing was studied in the form of data integration through centralized ontology construction. However, because of distributed environment of internet, when integrating data of distributed site, it is required to integrate data of each site in terms of peer-to-peer data processing for corresponding to fast change of internet. In this paper, in distributed environment, we propose data processing method which construct ontology in each site with ontology language OWL. Furthermore, through relational representation of OWL, we propose the system containing distributed query processing for data constructed in different site with different method.

  • PDF

Performance Enhancement and Evaluation of Distributed File System for Cloud (클라우드 분산 파일 시스템 성능 개선 및 평가)

  • Lee, Jong Hyuk
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.7 no.11
    • /
    • pp.275-280
    • /
    • 2018
  • The choice of a suitable distributed file system is required for loading large data and high-speed processing through subsequent applications in a cloud environment. In this paper, we propose a write performance improvement method based on GlusterFS and evaluate the performance of MapRFS, CephFS and GlusterFS among existing distributed file systems in cloud environment. The write performance improvement method proposed in this paper enhances the response time by changing the synchronization level used by the synchronous replication method from disk to memory. Experimental results show that the distributed file system to which the proposed method is applied is superior to other distributed file systems in the case of sequential write, random write and random read.

An Intelligent New Dynamic Load Redistribution Mechanism in Distributed Environments

  • Lee, Seong-Hoon
    • International Journal of Contents
    • /
    • v.3 no.1
    • /
    • pp.34-38
    • /
    • 2007
  • Load redistribution is a critical resource in computer system. In sender-initiated load redistribution algorithms, the sender continues to send unnecessary request messages for load transfer until a receiver is found while the system load is heavy. These unnecessary request messages result in inefficient communications, low CPU utilization, and low system throughput in distributed systems. To solve these problems, we propose a genetic algorithm based approach for improved sender-initiated load redistribution in distributed systems. Compared with the conventional sender-initiated algorithms, the proposed algorithm decreases the response time and task processing time.

Real-time system control for the 6-DOF simulation (6-DOF 시뮬레이터의 real-time 시스템 제어에 관한 연구)

  • 김영대;김충영;백인철;민성기
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1989.10a
    • /
    • pp.17-21
    • /
    • 1989
  • 6-DOE simulator system is designed to real-time processing for motion control, data acquisition, image generation and image processing etc.. In this paper, we introduce hardware and software design technologies for distributed processing, event-trapping, system monitoring and time scheduling procedure in 6-DOF simulator system design.

  • PDF