• 제목/요약/키워드: System RAID

Search Result 90, Processing Time 0.024 seconds

Efficient Update Method for Cloud Storage System

  • Khill, Ki-Jeong;Lee, Sang-Min;Kim, Young-Kyun;Shin, Jaeryong;Song, Seokil
    • International Journal of Contents
    • /
    • v.10 no.1
    • /
    • pp.62-67
    • /
    • 2014
  • Usually, cloud storage systems are developed based on DFS (Distributed File System) for scalability and reliability reasons. DFSs are designed to improve throughput than IO response time, and therefore, they are appropriate for batch processing jobs. Recently, cloud storage systems have been used for update intensive applications such as OLTP and so on. However, in DFSs, in-place update operations are not carefully considered. Therefore, when updates are frequent, I/O performance of DFSs are degraded significantly. DFSs with RAID techniques have been proposed to improve their performance and reliability. Their performance degradation caused by frequent update operations can be more significant. In this paper, we propose an in-place update method for DFS RAID exploiting a differential logging technique. The proposed method reduces the I/O costs, network traffic and XOR operation costs for RAID. We demonstrate the efficiency of our proposed in-place update method through various experiments.

Energy Conservation of RAID by Exploiting SSD Cache (SSD 캐시를 이용한 RAID의 에너지 절감 기법)

  • Lee, Hyo-J.;Kim, Eun-Sam;Noh, Sam-H.
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.16 no.2
    • /
    • pp.237-241
    • /
    • 2010
  • Energy conservation of server systems has become important. Though storage subsystem is one of the biggest power consumers, development of energy conservation techniques is challenging problem due to striping techniques like RAID and physical characteristics of hard disks. According to our observation, the size of footprint for a day or for hours is much smaller compared to the size of whole data set. In this paper, we describe a design of a novel architecture for RAID that uses an SSD as a large cache to conserve energy by holding such a footprint. We incorporate these approaches into a real implementation of a RAID 5 system that consists of four hard disks and an SSD in a Linux environment. Our preliminary results in actual performance measurements using the cello99 and SPC traces show that energy consumption is reduced by a maximum of 14%.

Implementation of Hardware RAID and LVM-based Large Volume Storage on Global Data Center System of International GNSS Service

  • Lee, Dae-Kyu;Cho, Sung-Ki;Park, Jong-Uk;Park, Pil-Ho
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.1553-1557
    • /
    • 2005
  • High performance and reliability of the storage system to handle a very large amount of data has been become very important. Many techniques have been applied on the various application systems to establish very large capacity storage that satisfy the requirement of high I/O speed and physical or logical failure protection. We applied RAID and LVM to construct a storage system for the global data center which needs a very reliable large capacity storage system. The storage system is successfully established and equipped on the latest Linux application server.

  • PDF

Design and Implementation of a Video-On-Demand System using Software RAID Technology (소프트웨어 RAID 기술을 이용한 주문형 비디오 시스템의 설계 및 구현)

  • Kim, Jong-Hoon
    • Journal of The Korean Association of Information Education
    • /
    • v.3 no.1
    • /
    • pp.22-32
    • /
    • 1999
  • In this paper, a von system which is based on current computer technologies is implemented. This von system organizes many personal computers in a local network into a configuration server, storage servers, and clients. To provide reliability, the data is stored using software RAID technology. Also, multimedia services are client-based for efficiency. The software components of this von system are the von configuration software, the von configuration service software, the von management software, and the von service software. Only the von service software runs in the client, while all the others run in the configuration server. The operating system on which the configuration server is run is the Windows NT such that the software executes like the UNIX-daemon process in the Windows NT service manager.

  • PDF

A Study on Efficient Management of RAID Level 5 Cache in OLTP Environment under Linux Operating System (리눅스 운영체제하의 OLTP환경에서 RAID 레벨 5의 효율적인 캐쉬 운영 방안에 대한 연구)

  • 송자영;장태무
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2000.04a
    • /
    • pp.3-5
    • /
    • 2000
  • RAID 레벨 5는 쓰기 시에 패리티 갱신을 위한 4번의 디스크 접근으로 인하여 OLTP와 같이 상대적으로 빈번한 디스크 접근을 가지고 데이터 크기가 작으며 쓰기의 횟수가 많은 작업환경에서 성능이 떨어지게 된다. 데이터와 패리티에 대한 캐싱은 OLTP환경에서의 쓰기에 대한 문제를 해결하기 위한 기법이다. 본 논문에서는 리눅스 운영체제의 파일 데이터 구조에 변화를 주고, 커널에서 얻어진 정보를 디스크 캐쉬의 운영에 이용한다. 스트라입 크기(G)를 가지는 RAID 레벌 5에서 패리티 캐쉬의 크기가 전체 캐쉬 크기의 1/G 이하 일 경우 데이터 패리티 캐쉬 크기 변화에 영향을 받지 않고 캐쉬의 그룹 단위 운영과 그에 따른 패리티의 미리 읽기를 가능하게 하여 패리티에 대한 추가적인 읽기를 최소화하는 기법을 제안한다. 본 논문의 실험 결과는 초당 디스크에 도착하는 평균 디스크 접근 요구 개수에 변화를 주어 시뮬레이션 방법으로 입증하였으며, OLTP 환경에서 데이터와 패리티 캐쉬를 독립적으로 운영하는 일반적인 캐쉬 운영 방법에 비해 평균 응답시간을 단축시킬 수 있음을 알 수 있다.

  • PDF

A Study on Comparison of Massive Data Recording Equipments for VLBI Radio Observation Data (VLBI 전파 관측데이터를 위한 대용량 기록장치 비교에 관한 연구)

  • Oh, Se-Jin;Yeom, Jae-Hwan;Roh, Duk-Gyoo;Jung, Dong-Kyu;Hwang, Ju-Yeon;Oh, Chungsik;Kim, Hyo-Ryoung
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.19 no.3
    • /
    • pp.125-132
    • /
    • 2018
  • KVN(Korean VLBI Network) introduced the Mark6 system of the MIT haystack observatory as a recorder for data recording up to 32 Gbps for VLBI(Very Long Baseline Interferometry) observation. The Mark6 recorder can record data at up to 32Gbps when two systems and 64 HDDs are installed. However, because of the unique recording method that is characteristic of Mark6, we are introducing a large amount of data into a virtual file system, or using a general RAID method, which causes data loss when reading and transferring files at the highest recording speed or file system have. The Flexbuff system, a software recorder developed by JIVE(Joint Institute for VLBI ERIC), can be configured to operate as a data recorder through RAID configuration and network upgrades. In particular, when installed in the Mark6 system, it can record VLBI data at a maximum speed of 32 Gbps with less loss of data compared to the existing Mark6 by utilizing Mark6 resources well. In this paper, we propose that the existing Mark6 system can be operated as Mark6-Flexbuff by installing jive5ab software, and it is verified through experiment that it can be effectively used for VLBI observation operation through data recording test.

The study of striping size according to the amount of storage nodes in the Parallel Media Stream Server (병렬 미디어 스트림 서버에서 저장노드수의 변화에 따른 스트라이핑 크기 결정에 관한 연구)

  • Kim, Seo-Gyun;Nam, Ji-Seung
    • The KIPS Transactions:PartC
    • /
    • v.8C no.6
    • /
    • pp.765-774
    • /
    • 2001
  • In this paper, we proposed the striping policy for the storage nodes in the Linux-based parallel media stream server. We newly developed a storage clustering architecture, and named it as a system RAID architecture. In this system, many storage cluster nodes are grouped to operate as a single server. This system uses unique striping policy to distribute multimedia files into the parallel storage nodes. If a service request occurs, each storage cluster node transmits striped files concurrently to the clients. This scheme can provide the fair distribution of the preprocessing load in all storage cluster nodes. The feature of this system is a relative striping policy based on the file types, service types, and the number of storage nodes to provide the best service.

  • PDF

The SZIT based-mapping method for on-line adding disks in software RAID (소프트웨어 RAID에서 온라인 디스크 부착이 가능한 SZIT 기반 매핑 기법)

  • Bak, Yu-hyeon;Kim, Chang-soo;Kang, Dong-jae;Kim, Young-ho;Shin, Bum-joo
    • The KIPS Transactions:PartA
    • /
    • v.9A no.4
    • /
    • pp.535-546
    • /
    • 2002
  • According as the users can connect to remote hosts at anytime by using internet, the demand of non-stop system is increased. Also, the research about on-line adding/deleting disks and hosts are progressed. This paper suggests that the method of reducing additional operation when we add disks to the stripping system. That method can fast mapping like equation based mapping method because of using so-called SZIT(Striping Zone Information Table) and equations. And that method can reduce the relocation overhead in striping system at adding disks.

Single I/O System Using ENBD on Linux PC Clusters (리눅스 PC 클러스터에서 ENBD를 이용한 SIOS)

  • 김태규;김방현;김종현
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.04a
    • /
    • pp.4-6
    • /
    • 2004
  • 클러스터 컴퓨터에서 접속된 모든 노드들의 디스크들을 통합 사용하기 위한 SIOS의 구현은 사용자 레벨과 파일 시스템 레벨, 그리고 디바이스 드라이버 레벨로 분류할 수 있다. 본 연구에서 제안하는 방법은 현재 공개되어 있는 소프트웨어 라이브러리만을 이용하여 리눅스 클러스터에서 SIOS를 구현하는 방법으로서, 확장 네트워크 블록 디바이스(ENBD: Enhanced Network Block Device)를 이용한 디바이스 드라이버 레벨의 하위 계층과 S/W RAID 및 NFS를 이용한 파일 시스템 레벨의 상위 계층으로 구성된다. 이 방법의 주요 장점은 현재 공개되어 있는 소프트웨어 라이브러리를 이용하기 때문에 구현이 용이하고 비용이 들지 않는다는 점이다. 그리고 하위 계층으로서 디바이스 드라이버 레벨의 ENBD를 이용하기 때문에 파일 시스템을 변경하지 않기 때문에 이전의 응용 프로그램에 대한 호환성이 높다. 또한, 상위 계층에서는 파일 시스템 레벨의 S/W RAID와 NFS를 이용함에 따라 디스크 배열 방식의 조정이 비교적 자유롭다. 또 다른 장점은 하위 계층과 상위 계층이 서로 독립적이기 때문에, 클러스터의 사용 목적에 따라 각 계층을 다양한 방법으로 변경할 수 있다는 것이다. Bonnie 벤치마크를 이용한 성능 측정 결과에 따르면, ENBD를 이용하여 RAID-5로 구성한 경우에 오버헤드가 높은 NFS를 사용했음에도 불구하고 비용이 많이 드는 다른 방법과 대등한 성능을 보였으며, 부분적으로는 더 높은 성능과 확장성을 가지는 것으로 나타났다.

  • PDF

Reliable and Flexible Storage System for NAS Environments (NAS를 위한 신뢰성과 확장성이 있는 저장 장치 시스템)

  • Lee, Tae-Keun;Kang, Yong-Hyeog;Eom, Young-Ik
    • The KIPS Transactions:PartD
    • /
    • v.10D no.7
    • /
    • pp.1085-1092
    • /
    • 2003
  • The rapid growth of high speed multimedia services demands the large capacity of the server's storage that maintains the multimedia contents. Among the server's devices, the low I/O speed and physical or logical failure of storage device decrease the total performance of system. The continuous increase of multimedia contents require the flexibility of storage capacity. In order to solve the these problems, we propose the uses of software RAID and LVM techniques that provide the performance improvement and reliability of storage device and the flexibility of storage device respectively. In the LINUX 2.4 kernel, we implemented the reliable and flexible storage device and evaluated the performance of it.