• 제목/요약/키워드: Distributed Processing

검색결과 2,318건 처리시간 0.029초

센서 네트워크 기반의 홀리스틱 분산 클러스터링 알고리즘 (A holistic distributed clustering algorithm based on sensor network)

  • 진평;임기욱;남지은;이경오
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2008년도 추계학술발표대회
    • /
    • pp.874-877
    • /
    • 2008
  • Nowadays the existing data processing systems can only support some simple query for sensor network. It is increasingly important to process the vast data streams in sensor network, and achieve effective acknowledges for users. In this paper, we propose a holistic distributed k-means algorithm for sensor network. In order to verify the effectiveness of this method, we compare it with central k-means algorithm to process the data streams in sensor network. From the evaluation experiments, we can verify that the proposed algorithm is highly capable of processing vast data stream with less computation time. This algorithm prefers to cluster the data streams at the distributed nodes, and therefore it largely reduces redundant data communications compared to the central processing algorithm.

하둡 플랫폼을 이용한 대량의 스몰파일 처리방법 (Processing Method of Mass Small File Using Hadoop Platform)

  • 김창복;정재필
    • 한국항행학회논문지
    • /
    • 제18권4호
    • /
    • pp.401-408
    • /
    • 2014
  • 하둡(Hadoop)은 맵리듀스(MapReduce) 분산처리 프로그래밍 모델과 HDFS(Hadoop distributed file system) 분산 파일시스템으로 구성된다. 하둡은 빅데이터 처리에 적합한 프레임워크로서, 대량의 스몰파일 처리에 문제점이 있다. 하둡에서 대량의 스몰파일 처리는 하나의 파일마다 매퍼가 생성되며, 파일의 메타정보를 저장하기 위해 많은 메모리가 필요한 문제점이 있다. 본 논문은 하둡 플랫폼에서 다양한 방법으로 대량의 스몰파일 처리방법을 비교 검토하였다. 일반 압축은 데이터의 크기와 상관없이 하나의 매퍼로 처리해야 하기 때문에, 하둡 처리 포맷으로 적절하지 않다. 시퀀스 와 하둡 아카이브 파일의 처리는 스몰파일을 압축 및 병합을 통해 네임노드의 메모리 문제가 제거되었다. 하둡 아카이브 파일은 스몰파일의 병합시간이 시퀀스 파일보다 빠른 속도를 보였다. CombineFileInputFormat 클래스를 이용한 처리는 병합과정이 필요 없으며, 빅데이터 처리방법과 유사한 속도를 보였다.

소프트웨어 디자인 패턴을 적용한 실시간 분산 시뮬레이션을 위한 데이터 전달처리 시스템 설계 (Data Transmission Processing System Design for Real-Time Distributed Simulation by Using Software Design Patterns)

  • 석진원;유인태
    • 디지털콘텐츠학회 논문지
    • /
    • 제10권4호
    • /
    • pp.649-657
    • /
    • 2009
  • 일반적으로 초고속 네트워크에서 실행되는 분산 시스템의 데이터 전달처리 효율은 시스템 구조 및 데이터의 전달처리 시스템에 의존한다. 분산 환경을 이용한 실시간 분산 시뮬레이션 시스템은 데이터전달처리의 실시간성과 시스템의 신뢰성 보장을 위하여 데이터 전달처리 시스템에 의하여 요구된 성능을 만족하고자 하였다. 그러나 실시간 시뮬레이션 시스템에 적용된 클라이언트/서버 기반의 데이터 전달처리 시스템은 시스템의 안정성 및 시스템의 변경에 따른 확장성과 유지보수성 확보가 어려웠다. 따라서 기존의 데이터 전달처리 시스템의 문제점을 해결하기 위하여 새로운 데이터 전달처리 시스템이 필요하다. 본 논문에서는 기존의 실시간 시뮬레이션 시스템을 분석하여 시스템 개선방향을 제시하고, 시스템 확장성, 상호운용성, 재사용성 및 유지보수성을 위하여 소프트웨어 디자인 패턴을 적용한 새로운 실시간 데이터 전달처리 시스템을 제안한다.

  • PDF

분산처리서버에서의 멀티 쓰레드 방식을 적용한 원격얼굴인식 시스템 (Study on Remote Face Recognition System Using by Multi Thread on Distributed Processing Server)

  • 김의선;고일주
    • 한국차세대컴퓨팅학회논문지
    • /
    • 제13권5호
    • /
    • pp.19-28
    • /
    • 2017
  • IP보안 카메라의 보급으로 원격에서 얼굴인식을 수행함에 있어 서버의 부하를 줄이기 위한 여러 가지 방법들이 구현되고 있다. 본 논문에서는 원격지에 있는 IP 보안 카메라 영상을 얼굴검출기능이 탑재된 DSP 보드를 통해 입력 받아 얼굴검출을 수행 한 후 해당 얼굴영역 이미지를 서버로 전송하여 이를 얼굴인식 분산 처리를 통해 얼굴인식 기능을 수행한다. 결과적으로 전체적인 서버시스템 로드를 상당히 줄이는 성과와 실시간 얼굴 인식처리를 최대 256대의 카메라를 연동하면서 수행할 수 있는 장점을 가지고 있다. 이를 수행할 수 있는 기술은 분산처리 서버기술을 이용하여 한 서버 당 64채널 얼굴인식을 수행하며, 4개 분산처리 서버를 운영할 경우 250여개 카메라 채널을 통한 얼굴검출 결과를 처리하는 성과를 가져올 수 있었다.

객체그룹 기반의 분산환경에서 교육용 VDB 시스템의 설계 및 구현 (Design and Implementation of An Educational VDB System in Distributed Environments Based on Object Groups)

  • 유경택;이현철;주수종
    • 한국정보처리학회논문지
    • /
    • 제6권11호
    • /
    • pp.3034-3045
    • /
    • 1999
  • For efficiently providing multimedia services, distributed computing environments are specified the requirements of various services and distributed object platforms applied an object-oriented technology by TINA Consortium and OMG CORBA. Because multimedia service applications are becoming large and distributing, their servicing managing interfaces among objects are being complicated. In order to solve these defects, it is necessary to suggest a new object grouping model and specify object service/management requirements can be introduced under the object groups. We have been developed the distributed object group platform that can group all individual objects by the relating services and can supply trading functions for interconnecting between distributed objects or object groups. In this paper, we designed and implemented the Virtual Drawing Board for remote equational services on the distributed object group platform we mentioned above. As results, we designed a basic structure and service interfaces, and showed execution procedures of VDB system consisted of distributed objects and objects groups for educational services. For supporting distributed services of VDB system, we used three kinds of tools as follows; IONA orbix 2.2 of CORBA compliance as an object middleware, OrbixTrader 1.0 for interconnection of distributed objects, and the OGTG we developed for interconnection of distributed object groups and checking access rights of objects included in an arbitrary object group.

  • PDF

Java 언어를 이용한 객체이동시스템의 설계 및 구현 (Design and Implementation of an Object Migration System Using the Java Language)

  • 전병국;이근상;최영근
    • 한국정보처리학회논문지
    • /
    • 제6권1호
    • /
    • pp.49-56
    • /
    • 1999
  • Distributed object Computing, owing to the development of distributed computing, has improved the performance of distributed processing conducted between homogeneous and heterogeneous systems in network. However, it has failed to solve fundamental problems such as network overload and enormous requests demands by servers and clients. In this paper, we propose to design and implement an Object Migration system that uses the java language to tackle the mentioned problems. As the first step of the implementation of the system, we justify the characteristics of t도 mobile object model that keeps codes and states of an object. Implemented Object Migration System would accept objects being migrated to a specific node and support the virtual place in which objects could be executed automatically. Therefore, the Object Migration system we suggest could not only solve problems imposed to traditional distributed computing but also offer transparency of object migration between homogeneous and heterogeneous systems.

  • PDF

전력감시제어설비(SCADA)의 open system architecture 적용 (The application of open system architecture in power SCADA system)

  • 이용해;문국연;박장범
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1996년도 한국자동제어학술회의논문집(국내학술편); 포항공과대학교, 포항; 24-26 Oct. 1996
    • /
    • pp.992-995
    • /
    • 1996
  • The major roles of Power SCADA System are continuous monitoring of electrical equipments state, real-time data processing and dispatching. Especially, SCADA system demands fast response time in heavy load condition, high reliability, fault tolerance, expansion capacity for the future. According to developing computer system technology, SCADA system is changing system configuration from centralized processing system to distributed processing system. This paper describes operational benefits, problems and improvement (which is studying in theory) in the application of Open System Architecture SCADA which has been installed since 1994, Seoul regional control center in KEPCO.

  • PDF

분산 상호 배제 카운트 알고리즘을 이용한 클라이언트 사용자 구분 시스템 개발 (Design and Implementation of Distributed Mutual Exclusion Lock Counter Algorithm)

  • 장승주
    • 한국정보처리학회논문지
    • /
    • 제7권4호
    • /
    • pp.1227-1235
    • /
    • 2000
  • In this paper, we propose new concepts that the distributed counter value with the distributed EC system identify each user who users the distributed system. The web user should register his/her own user ID in the cyber shopping mall system. Instead of registration, this paper proposes the proprietary mechanism that is distributing counter. The counter assigns the distinguished number to each client. The distributed lock algorithm is used for mutual assignment of the counter to each client. The proposed algorithm is the best solution in the distributed environment system such as cyber shopping mall. If a user should register his/her own ID in every EC system, he/she may not try to use these uncomfortable systems. The mutual counter is used to identify each client. All of these features are designed and implemented on Windows NT web server. Also these features were experiments with 5 clients for 300 times. According to the experiments, clients have their own mutual counter value. The proposed algorithm will be more efficient in internet application environment. Moreover, it will improve the number of internet users.

  • PDF

분산 트레이더를 지원하는 경량 (lightweight) 객체 모델 설계 및 구현 방안 연구 (A Study on the Design and Implementation of the Lightweight Object Model Supporting Distributed Trader)

  • 진명숙;송병권
    • 한국정보처리학회논문지
    • /
    • 제7권4호
    • /
    • pp.1050-1061
    • /
    • 2000
  • This paper presents a new object model, LOM(Lightweight Object Model) and an implementation method for the distributed trader in heterogeneous distributed computing environment including mobile network. Trader is third party object that enables clients to find suitable servers, which provide the most appropriate services to client in distributed environment including dynamic reconfiguration of services and servers. Trading service requires simpler and more specific object model than genetic object models which provide richer multimedia data types and semantic characteristics with complex data structures. LOM supports a new reference attribute type instead of the relationship, inheritance and composite attribute types of the general object oriented models and so LOM has simple data structures. Also in LOM, the modelling step includes specifying of the information about users and the access right to objects for security in the mobile environment and development of the distributed storage for trading service. Also, we propose and implementation method of the distributed trader, which integrates the LOM-information object model and the OMG (object Management Group) computational object model.

  • PDF

Design of Distributed Cloud System for Managing large-scale Genomic Data

  • Seine Jang;Seok-Jae Moon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • 제16권2호
    • /
    • pp.119-126
    • /
    • 2024
  • The volume of genomic data is constantly increasing in various modern industries and research fields. This growth presents new challenges and opportunities in terms of the quantity and diversity of genetic data. In this paper, we propose a distributed cloud system for integrating and managing large-scale gene databases. By introducing a distributed data storage and processing system based on the Hadoop Distributed File System (HDFS), various formats and sizes of genomic data can be efficiently integrated. Furthermore, by leveraging Spark on YARN, efficient management of distributed cloud computing tasks and optimal resource allocation are achieved. This establishes a foundation for the rapid processing and analysis of large-scale genomic data. Additionally, by utilizing BigQuery ML, machine learning models are developed to support genetic search and prediction, enabling researchers to more effectively utilize data. It is expected that this will contribute to driving innovative advancements in genetic research and applications.