• Title/Summary/Keyword: distributed storage systems

Search Result 207, Processing Time 0.029 seconds

Symmetric Tree Replication Protocol for Efficient Distributed Storage System (효율적인 분산 저장 시스템을 위한 대칭 트리 복제 프로토콜)

  • 최성춘;윤희용;이강신;이호재
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.31 no.9
    • /
    • pp.503-513
    • /
    • 2004
  • In large distributed systems, replications of data and service are needed to decrease communication cost, increase availability, and avoid single server bottleneck. Tree Quorum protocol is a representative replication protocol, which exploits a logical structure. Tree quorum protocol is one of the replication protocols allowing low read cost only in the best case, while the number of replicas exponentially increases as the level grows. In this paper, thus, we propose a new replication protocol, called symmetric tree protocol which efficiently solves the problem. The proposed symmetric tree protocol also requires much smaller read cost than previous protocols. We conduct cost and availability analysis of the protocols, and the proposed protocol displays comparable read availability to the tree protocol using much smaller number of nodes. Also, the symmetric tree protocol has much smaller response time than the logarithmic protocol.

Performance Analysis of Open Source Based Distributed Deduplication File System (오픈 소스 기반 데이터 분산 중복제거 파일 시스템의 성능 분석)

  • Jung, Sung-Ouk;Choi, Hoon
    • KIISE Transactions on Computing Practices
    • /
    • v.20 no.12
    • /
    • pp.623-631
    • /
    • 2014
  • Comparison of two representative deduplication file systems, LessFS and SDFS, shows that Lessfs is better in execution time and CPU utilization while SDFS is better in storage usage (around 1/8 less than general file systems). In this paper, a new system is proposed where the advantages of SDFS and Lessfs are combined. The new system uses multiple DFEs and one DSE to maintain the integrity and consistency of the data. An evaluation study to compare between Single DFE and Dual DFE indicates that the Dual DFE was better than the Single DFE. The Dual DFE reduced the CPU usage and provided fast deduplication time. This reveals that proposed system can be used to solve the problem of an increase in large data storage and power consumption.

Manometer Scale Mark Formation using Thermal Reaction For Storage Application (열 반응을 이용한 나노사이즈 마크형성)

  • Jung, Moon-Il;Kim, Joo-Ho;Hwang, In-Oh;Kim, Hyun-Ki;Bae, Jae-Cheol;Park, In-Sik;Kuwahara, Masashi;Tominaga, Junji
    • Transactions of the Society of Information Storage Systems
    • /
    • v.1 no.2
    • /
    • pp.127-131
    • /
    • 2005
  • We report a nanometer scale mark formation using a $PtO_x$ thin film or a TbFeCo rare-earth transition metal film and the mechanism. The multi-layer samples($ZnS-SiO_2/PtOx/ZNS-SiO_2,\;ZnS-SiO_2/TbFeCo/ZnS-SiO_2$) were prepared with a magnetron sputtering method on a polycarbonate or a glass substrate. By laser irradiation of approximately a few nanoseconds, nanometer scale marks were fabricated. During the fabrication process, the thin films were thermally reacted or inter-diffused during the laser irradiation. 75 nm bubble marks in the PtOx multi-layer sample by an approximately 4-ns laser irradiation. Inside the bubble mark, Pt particles with a few nanometer sizes are distributed. The $50{\sim}100$ nm bubble marks in the TbFeCo multi-layer sample by a few nanosecond laser irradiations. We will report the detail structure of the samples, the bubble mark formation process and the mechanism.

  • PDF

A Novel Framework for Defining and Submitting Workflows to Service-Oriented Systems

  • Bendoukha, Hayat;Slimani, Yahya;Benyettou, Abdelkader
    • Journal of Information Processing Systems
    • /
    • v.10 no.3
    • /
    • pp.365-383
    • /
    • 2014
  • Service-oriented computing offers efficient solutions for executing complex applications in an acceptable amount of time. These solutions provide important computing and storage resources, but they are too difficult for individual users to handle. In fact, Service-oriented architectures are usually sophisticated in terms of design, specifications, and deployment. On the other hand, workflow management systems provide frameworks that help users to manage cooperative and interdependent processes in a convivial manner. In this paper, we propose a workflow-based approach to fully take advantage of new service-oriented architectures that take the users' skills and the internal complexity of their applications into account. To get to this point, we defined a novel framework named JASMIN, which is responsible for managing service-oriented workflows on distributed systems. JASMIN has two main components: unified modeling language (UML) to specify workflow models and business process execution language (BPEL) to generate and compose Web services. In order to cover both workflow and service concepts, we describe in this paper a refinement of UML activity diagrams and present a set of rules for mapping UML activity diagrams into BPEL specifications.

Technical Advancements Needed for the Introduction of Distributed Water Infrastructure to Urban Wastewater Management Systems (분산형 물 인프라의 도시 하수관리 시스템 도입을 위한 기술적 발전방안)

  • Yongju Choi;Wooram Lee
    • Journal of Korean Society on Water Environment
    • /
    • v.39 no.1
    • /
    • pp.76-86
    • /
    • 2023
  • We are on the verge of paradigm shift for the design and operation of our urban water systems from treatment- and efficiency-based to recirculation- and sustainability-based. One of the most frequently suggested alternatives to embody this paradigm shift is to decentralize the currently highly centralized urban water infrastructure. However, claims for water infrastructure decentralization are often criticized due to poor economic feasibility, unstable performance, and unprofessional operation and maintenance. The current study critically reviews the literature to discuss the technical advancement needs to overcome such challenges. Firstly, decentralized water infrastructure was briefly defined and the rationale for the proposal of its introduction to the next-generation urban water systems was laid down. The main discussion focused on the following water technologies, which require special attention when working with decentralized water infrastructure: i) material collection, storage, and transport; ii) easily scalable water treatment; iii) sensor, information, and communications; and iv) system optimization. The principles, current development status, and challenges were discussed for each of the water technologies. The discussion on the water technologies has enabled the identification of future research needs for their application to the next-generation urban water systems which will be designed following decentralized water infrastructure. This paper will significantly improve the current understanding on water infrastructure decentralization and provides insight on future direction of water technology development.

State of Information Technology and Its Application in Agricultural Meteorology (농업기상활용 정보기술 현황)

  • Byong-Lyol Lee;Dong-Il Lee
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.6 no.2
    • /
    • pp.118-126
    • /
    • 2004
  • Grid is a new Information Technology (IT) concept of "super Internet" for high-performance computing: worldwide collections of high-end resources such as supercomputers, storage, advanced instruments and immerse environments. The Grid is expected to bring together geographically and organizationally dispersed computational resources, such as CPUs, storage systems, communication systems, real-time data sources and instruments, and human collaborators. The term "the Grid" was coined in the mid1990s to denote a proposed distributed computing infrastructure for advanced science and engineering. The term computational Grids refers to infrastructures aimed at allowing users to access and/or aggregate potentially large numbers of powerful and sophisticated resources. More formally, Grids are defined as infrastructure allowing flexible, secure, and coordinated resource sharing among dynamic collections of individuals, institutions and resources referred to as virtual Organizations. GRID is an emerging IT as a kind of next generation Internet technology which will fit very well with agrometeorological services in the future. I believe that it would contribute to the resource sharing in agrometeorology by providing super computing power, virtual storage, and efficient data exchanges, especially for developing countries that are suffering from the lack of resources for their agmet services at national level. Thus, the establishment of CAgM-GRID based on existing RADMINSII is proposed as a part of FWIS of WMO.part of FWIS of WMO.

Performance Optimization in GlusterFS on SSDs (SSD 환경 아래에서 GlusterFS 성능 최적화)

  • Kim, Deoksang;Eom, Hyeonsang;Yeom, Heonyoung
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.2
    • /
    • pp.95-100
    • /
    • 2016
  • In the current era of big data and cloud computing, the amount of data utilized is increasing, and various systems to process this big data rapidly are being developed. A distributed file system is often used to store the data, and glusterFS is one of popular distributed file systems. As computer technology has advanced, NAND flash SSDs (Solid State Drives), which are high performance storage devices, have become cheaper. For this reason, datacenter operators attempt to use SSDs in their systems. They also try to install glusterFS on SSDs. However, since the glusterFS is designed to use HDDs (Hard Disk Drives), when SSDs are used instead of HDDs, the performance is degraded due to structural problems. The problems include the use of I/O-cache, Read-ahead, and Write-behind Translators. By removing these features that do not fit SSDs which are advantageous for random I/O, we have achieved performance improvements, by up to 255% in the case of 4KB random reads, and by up to 50% in the case of 64KB random reads.

A Study on the Improvement of Availability of Distributed Processing Systems Using Edge Computing (엣지컴퓨팅을 활용한 분산처리 시스템의 가용성 향상에 관한 연구)

  • Lee, Kun-Woo;Kim, Young-Gon
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.22 no.1
    • /
    • pp.83-88
    • /
    • 2022
  • Internet of Things (hereinafter referred to as IoT) related technologies are continuously developing in line with the recent development of information and communication technologies. IoT system sends and receives unique data through network based on various sensors. Data generated by IoT systems can be defined as big data in that they occur in real time, and that the amount is proportional to the amount of sensors installed. Until now, IoT systems have applied data storage, processing and computation through centralized processing methods. However, existing centralized processing servers can be under load due to bottlenecks if the deployment grows in size and a large amount of sensors are used. Therefore, in this paper, we propose a distributed processing system for applying a data importance-based algorithm aimed at the high availability of the system to efficiently handle real-time sensor data arising in IoT environments.

A New Network Bandwidth Reduction Method of Distributed Rendering System for Scalable Display (확장형 디스플레이를 위한 분산 렌더링 시스템의 네트워크 대역폭 감소 기법)

  • Park, Woo-Chan;Lee, Won-Jong;Kim, Hyung-Rae;Kim, Jung-Woo;Han, Tack-Don;Yang, Sung-Bong
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.29 no.10
    • /
    • pp.582-588
    • /
    • 2002
  • Scalable displays generate large and high resolution images and provide an immersive environment. Recently, scalable displays are built on the networked clusters of PCs, each of which has a fast graphics accelerator, memory, CPU, and storage. However, the distributed rendering on clusters is a network bound work because of limited network bandwidth. In this paper, we present a new algorithm for reducing the network bandwidth and implement it with a conventional distributed rendering system. This paper describes the algorithm called geometry tracking that avoids the redundant geometry transmission by indexing geometry data. The experimental results show that our algorithm reduces the network bandwidth up to 42%.

Assessment of performance for Output Power Control of Wind Turbine using Energy Storage System (에너지저장장치를 이용한 풍력발전 출력 제어 성능 평가)

  • Hong, Jong-Seok;Choi, Chang-Ho;Lee, Joo-Yeon;Kim, Jae-Chul
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.63 no.4
    • /
    • pp.254-259
    • /
    • 2014
  • In this paper, we describe construction of a wind stabilization demo-site and effects of output power control of wind turbines for suppression of ramp rate using ESS (Energy Storage System). It is difficult to control the output power of distributed generator such as wind turbine which of variation is very large. If the large capacity wind farm be interconnected into power system may cause blackout due to Power Quality. For these reasons, the international standards such as Grid-Code is limited to less than 10 [%/min] of renewable energy ramp rate. The case of Korea, government actively conducts propagating large-scale renewable energy for green growth policy, to interconnecting more renewable energy into power system is necessary for stabilization technology. For these reasons, the POSCO consortium has constructed a wind stabilization demo-site that is configured as 500 [kWh] battery energy storage systems can output up to 3 [C-Rate] and two wind turbines rated 750 [kW]. In POSCO consortium, which implements various methods stabilizing output power of wind turbine such as smoothing, section firming and ramp control, we derive the results of long-term demonstration that can be controlled to satisfy to the international standard about ramp rate [%/kW] of wind turbine output power.