• Title/Summary/Keyword: distributed storage systems

Search Result 207, Processing Time 0.027 seconds

A Digital Convergence Platform based on the MPEG-21 Multimedia Framework (MPEG-21기반 디지털 컨버젼스 플랫폼 기술)

  • Oh, Hwa-Yong;Kim, Dong-Hwan;Lee, Eun-Seo;Chang, Tae-Gyu
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.56 no.5
    • /
    • pp.987-989
    • /
    • 2007
  • This paper describes a digital convergence platform(DCP) which is implemented based on the MPEG-21 multimedia framework. DCP is a newly proposed solution in this research for the convergence service of future home multimedia environment. DCP is a common platform designed to have the feature of reconfigurability, by means of S/W. which supports to run diverse digital multimedia services. A distributed peer to peer service and transaction model is also a new feature realized in DCP using the MPEG-21 multimedia framework. A prototype DCP is implemented to verify its functions of multimedia service and transactions. The developed DCPs are networked with IP clustering storage systems for the distributed service of multimedia. Successful streaming services of the MPEG-2/4 video and audio are verified with the implemented test-bed system of DCP.

A distributed QoS system for cluster based web server systems (클러스터 기반 웹 서버에서의 분산 QoS)

  • 박성우;정규식;김동승
    • Proceedings of the IEEK Conference
    • /
    • 2002.06c
    • /
    • pp.177-180
    • /
    • 2002
  • This paper introduces a new distributed QoS (Quality of Service) control system for clusters of web servers. The proposed system can employ not only network bandwidth but also other metrics such as processor load, memory usage, and storage access load that affect the overall system performance. Moreover, it controls over clustered\ulcorner workstations in of-der to utilize idle resources among workstations. This architecture maximizes overall usage of cluster of web servers while it provides predictable and differentiated performance for each contents volume. We implemented a prototype of introduced system, and the test results showed the proposed method can control QoS in a cluster server system.

  • PDF

Development of the design methodology for large-scale database based on MongoDB

  • Lee, Jun-Ho;Joo, Kyung-Soo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.22 no.11
    • /
    • pp.57-63
    • /
    • 2017
  • The recent sudden increase of big data has characteristics such as continuous generation of data, large amount, and unstructured format. The existing relational database technologies are inadequate to handle such big data due to the limited processing speed and the significant storage expansion cost. Thus, big data processing technologies, which are normally based on distributed file systems, distributed database management, and parallel processing technologies, have arisen as a core technology to implement big data repositories. In this paper, we propose a design methodology for large-scale database based on MongoDB by extending the information engineering methodology based on E-R data model.

Performance Optimization of Big Data Center Processing System - Big Data Analysis Algorithm Based on Location Awareness

  • Zhao, Wen-Xuan;Min, Byung-Won
    • International Journal of Contents
    • /
    • v.17 no.3
    • /
    • pp.74-83
    • /
    • 2021
  • A location-aware algorithm is proposed in this study to optimize the system performance of distributed systems for processing big data with low data reliability and application performance. Compared with previous algorithms, the location-aware data block placement algorithm uses data block placement and node data recovery strategies to improve data application performance and reliability. Simulation and actual cluster tests showed that the location-aware placement algorithm proposed in this study could greatly improve data reliability and shorten the application processing time of I/O interfaces in real-time.

A performance analysis of AS/RS with single and dual commands (단일 및 이중명령을 수행하는 자동창고 시스템의 성능분석)

  • Nam Jin-Gyu;Hur Sun;Jeong Seok-Yun;Kim Jeong-Kee
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.27 no.3
    • /
    • pp.26-30
    • /
    • 2004
  • We consider an AS/RS(Automated Storage/ Retrieval System) which performs both of single and dual commands. The service times of single and dual commands are assumed to be differently distributed. Steady-state probabilities at the service completion epochs are calculated. Then, we transform the arrival rates of storage and retrieval commands into those of single and dual commands. Using this, we propose a non-preemptive queueing model with priority for the performance analysis of an AS/RS, and obtain approximated means of queue lengths and waiting times.

Device Discovery using Feed Forward Neural Network in Mobile P2P Environment

  • Kwon, Ki-Hyeon;Byun, Hyung-Gi;Kim, Nam-Yong;Kim, Sang-Choon;Lee, Hyung-Bong
    • Journal of Digital Contents Society
    • /
    • v.8 no.3
    • /
    • pp.393-401
    • /
    • 2007
  • P2P systems have gained a lot of research interests and popularity over the years and have the capability to unleash and distribute awesome amounts of computing power, storage and bandwidths currently languishing - often underutilized - within corporate enterprises and every Internet connected home in the world. Since there is no central control over resources or devices and no before hand information about the resources or devices, device discovery remains a substantial problem in P2P environment. In this paper, we cover some of the current solutions to this problem and then propose our feed forward neural network (FFNN) based solution for device discovery in mobile P2P environment. We implements feed forward neural network (FFNN) trained with back propagation (BP) algorithm for device discovery and show, how large computation task can be distributed among such devices using agent technology. It also shows the possibility to use our architecture in home networking where devices have less storage capacity.

  • PDF

Construction of [2k-1+k, k, 2k-1+1] Codes Attaining Griesmer Bound and Its Locality (Griesmer 한계식을 만족하는 [2k-1+k, k, 2k-1+1] 부호 설계 및 부분접속수 분석)

  • Kim, Jung-Hyun;Nam, Mi-Young;Park, Ki-Hyeon;Song, Hong-Yeop
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.40 no.3
    • /
    • pp.491-496
    • /
    • 2015
  • In this paper, we introduce two classes of optimal codes, [$2^k-1$, k, $2^{k-1}$] simplex codes and [$2^k-1+k$, k, $2^{k-1}+1$] codes, attaining Griesmer bound with equality. We further present and compare the locality of them. The [$2^k-1+k$, k, $2^{k-1}+1$] codes have good locality property as well as optimal code length with given code dimension and minimum distance. Therefore, we expect that [$2^k-1+k$, k, $2^{k-1}+1$] codes can be applied to various distributed storage systems.

Performance Improvement on RAID System with Parity Declustering (패리티 디틀러스터링 RAID 시스템에서의 성능 개선 방안)

  • Chang, Tae-Mu
    • The Transactions of the Korea Information Processing Society
    • /
    • v.7 no.2
    • /
    • pp.497-506
    • /
    • 2000
  • RAID systems have been used as a mass storage system with high parallelism and availability. Especially RAID systems with parity declustering are widely studied as a technique to provide high fault tolerancy and availability by reducing performance degradation in case of disk fuilures. In this paper, a new organization of parity declustering with distributed spare units is proposed. And in normal mode where there are no failures, it is shown that these organization can improve the performance of RAID systems. By simulation methods, it is proved that the performance of RAID system in normal mode is improved by 5 to 15%.

  • PDF

BeanFS: A Distributed File System for Large-scale E-mail Services (BeanFS: 대규모 이메일 서비스를 위한 분산 파일 시스템)

  • Jung, Wook;Lee, Dae-Woo;Park, Eun-Ji;Lee, Young-Jae;Kim, Sang-Hoon;Kim, Jin-Soo;Kim, Tae-Woong;Jun, Sung-Won
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.36 no.4
    • /
    • pp.247-258
    • /
    • 2009
  • Distributed file systems running on a cluster of inexpensive commodity hardware are being recognized as an effective solution to support the explosive growth of storage demand in large-scale Internet service companies. This paper presents the design and implementation of BeanFS, a distributed file system for large-scale e-mail services. BeanFS is adapted to e-mail services as follows. First, the volume-based replication scheme alleviates the metadata management overhead of the central metadata server in dealing with a very large number of small files. Second, BeanFS employs a light-weighted consistency maintenance protocol tailored to simple access patterns of e-mail message. Third, transient and permanent failures are treated separately and recovering from transient failures is done quickly and has less overhead.

Operation System Design of Distribution Feeder with Distributed Energy Resources (분산전원이 연계된 배전선로의 운영시스템 설계)

  • Kim, Seong-Man;Chang, Young-Hak;Kim, Kyeong-Hun;Kim, Sul-Ki;Moon, Chae-Joo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.16 no.6
    • /
    • pp.1183-1194
    • /
    • 2021
  • Traditionally, electric power systems have been known as the centralized structures, which is organized into placing customers at the end of the supply chain. However, recent decades have witnessed the emergence of distributed energy resources(:DERs) such as rooftop solar, farming PV system, small wind turbines, battery energy storage systems and smart home appliances. With the emergence of distributed energy resources, the role of distributed system operators(:DSOs) will expand. The increasing penetration of DERs could lead to a less predictable and reverse flow of power in the system, which can affect the traditional planning and operation of distribution and transmission networks. This raises the need for a change in the role of the DSOs that have conventionally planned, maintained and managed networks and supply outages. The objective of this research is to designed the future distribution operation system with multi-DERs and the proposed distribution system model is implemented by hardware-in-the-loop simulation(HILS). The test results show the normal operation domain and reduction of distribution line loss.