• Title/Summary/Keyword: column storage

Search Result 168, Processing Time 0.021 seconds

Search Performance Improvement of Column-oriented Flash Storages using Segmented Compression Index (분할된 압축 인덱스를 이용한 컬럼-지향 플래시 스토리지의 검색 성능 개선)

  • Byun, Siwoo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.1
    • /
    • pp.393-401
    • /
    • 2013
  • Most traditional databases exploit record-oriented storage model where the attributes of a record are placed contiguously in hard disk to achieve high performance writes. However, for search-mostly datawarehouse systems, column-oriented storage has become a proper model because of its superior read performance. Today, flash memory is largely recognized as the preferred storage media for high-speed database systems. In this paper, we introduce fast column-oriented database model and then propose a new column-aware index management scheme for the high-speed column-oriented datawarehouse system. Our index management scheme which is based on enhanced $B^+$-Tree achieves high search performance by embedded flash index and unused space compression in internal and leaf nodes. Based on the results of the performance evaluation, we conclude that our index management scheme outperforms the traditional scheme in the respect of the search throughput and response time.

Space-Efficient Compressed-Column Management for IoT Collection Servers (IoT 수집 서버를 위한 공간효율적 압축-칼럼 관리)

  • Byun, Siwoo
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.9 no.1
    • /
    • pp.179-187
    • /
    • 2019
  • With the recent development of small computing devices, IoT sensor network can be widely deployed and is now readily available with sensing, calculation and communi-cation functions at low cost. Sensor data management is a major component of the Internet of Things environment. The huge volume of data produced and transmitted from sensing devices can provide a lot of useful information but is often considered the next big data for businesses. New column-wise compression technology is mounted to the large data server because of its superior space efficiency. Since sensor nodes have narrow bandwidth and fault-prone wireless channels, sensor-based storage systems are subject to incomplete data services. In this study, we will bring forth a short overview through providing an analysis on IoT sensor networks, and will propose a new storage management scheme for IoT data. Our management scheme is based on RAID storage model using column-wise segmentation and compression to improve space efficiency without sacrificing I/O performance. We conclude that proposed storage control scheme outperforms the previous RAID control by computer performance simulation.

Formulae for the frequency equations of beam-column system carrying a fluid storage tank

  • El-Sayed, Tamer. A.;Farghaly, Said. H.
    • Structural Engineering and Mechanics
    • /
    • v.73 no.1
    • /
    • pp.83-95
    • /
    • 2020
  • In this work, a mathematical model of beam-column system carrying a double eccentric end mass system is investigated, and solved analytically based on the exact solution analysis. The model considers the case in which the double eccentric end mass is a rigid storage tank containing fluid. Both Timoshenko and Bernoulli-Euler beam bending theories are considered. Equation of motion, general solution and boundary conditions for the present system model are developed and presented in dimensional and non-dimensional format. Several important non-dimensional design parameters are introduced. Symbolic and/or explicit formulae of the frequency and mode shape equations are formulated. To the authors knowledge, the present reduced closed form symbolic and explicit frequency equations have not appeared in literature. For different applications, the results are validated using commercial finite element package, namely ANSYS. The beam-column system investigated in this paper is significant for many engineering applications, especially, in mechanical and structural systems.

A Design of Column-Group based Dynamic Page Storage Model for Mixed Workloads (혼합 워크로드 처리를 위한 컬럼 그룹 기반 동적 페이지 저장 관리 설계)

  • Park, Kyounghyun;Wonk, Hee Sun;Ryu, Keun Ho
    • Journal of Digital Contents Society
    • /
    • v.19 no.2
    • /
    • pp.335-341
    • /
    • 2018
  • There exists a limit in efficient processing of mixed workloads that database markets requires in recent years since existing database systems utilize a static page storage model. In this paper we propose a dynamic page storage model that can reflect the characteristics of mixed workloads. We also describe how to extract optimized column groups from given mixed workloads and how to construct pages dynamically. Finally, we show in our experiments that the proposed model is more efficient than the existing model in processing given mixed workloads.

Shadow Recovery for Column-based Databases (컬럼-기반 데이터베이스를 위한 그림자 복구)

  • Byun, Si-Woo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.16 no.4
    • /
    • pp.2784-2790
    • /
    • 2015
  • The column-oriented database storage is a very advanced model for large-volume data transactions because of its superior I/O performance. Traditional data storages exploit row-oriented storage where the attributes of a record are placed contiguously in hard disk for fast write operations. However, for search-mostly data warehouse systems, column-oriented storage has become a more proper model because of its superior read performance. Recently, solid state drive using flash memory is largely recognized as the preferred storage media for high-speed data analysis systems. In this research, we propose a new transaction recovery scheme for a column-oriented database environment which is based on a flash media file system. We improved traditional shadow paging schemes by reusing old data pages which are supposed to be invalidated in the course of writing a new data page in the flash file system environment. In order to reuse these data pages, we exploit reused shadow list structure in our column-oriented shadow recovery(CoSR) scheme. CoSR scheme minimizes the additional storage overhead for keeping shadow pages and minimizes the I/O performance degradation caused by column data compression of traditional recovery schemes. Based on the results of the performance evaluation, we conclude that CoSR outperforms the traditional schemes by 17%.

Strength upgrading of steel storage rack frames in the down-aisle direction

  • El Kadi, Bassel;Cosgun, Cumhur;Mangir, Atakan;Kiymaz, Guven
    • Steel and Composite Structures
    • /
    • v.23 no.2
    • /
    • pp.143-152
    • /
    • 2017
  • This paper focuses on the seismic performance of pallet-type steel storage rack structures in their down aisle direction. As evidenced by experimental research, the seismic response of storage racks in the down-aisle direction is strongly affected by the nonlinear moment-rotation response of the beam-to-column connections. In their down-aisle direction, rack structures are designed to resist lateral seismic loads with typical moment frames utilizing proprietary beam-to-column moment-resisting connections. These connections are mostly boltless hooked type connections and they exhibit significantly large rotations resulting in large lateral frame displacements when subjected to strong ground motions. In this paper, typical hooked boltless beam-to-column connections are studied experimentally to obtain their non-linear reversed cyclic moment-rotation response. Additionally, a compound type connection involving the standard hooks and additional bolts were also tested under similar conditions. The simple introduction of the additional bolts within the hooked connection is considered to be a practical way of structural upgrade in the connection. The experimentally evaluated characteristics of the connections are compared in terms of some important performance indicators such as maximum moment and rotation capacity, change in stiffness and accumulated energy levels within the cyclic loading protocol. Finally, the obtained characteristics were used to carry out seismic performance assessment of rack frames incorporating the tested beam-to-column connections. The assessment involves a displacement based approach that utilizes a simple analytical model that captures the seismic behavior of racks in their down-aisle direction. The results of the study indicate that the proposed method of upgrading appears to be a very practical and effective way of increasing the seismic performance of hooked connections and hence the rack frames in their down-aisle direction.

Systems to prevent the load resistance loss of pallet racks exposed to cyclic external force

  • Heo, Gwanghee;Kim, Chunggil;Baek, Eunrim;Jeon, Seunggon
    • Structural Engineering and Mechanics
    • /
    • v.83 no.6
    • /
    • pp.745-756
    • /
    • 2022
  • This study aims to determine the cause of the load resistance loss in storage racks that can be attributed to external forces such as earthquakes and to improve safety by developing reinforcement systems that can prevent load resistance loss. To this end, a static cyclic loading test was performed on pallet racks commonly used in logistics warehouses. The test results indicated that a pallet rack exposed to an external force loses more than 50% of its load resistance owing to the damage caused to column-beam joints. Three reinforcement systems were developed for preventing load resistance loss in storage racks exposed to an external force and for performing differentiated target functions: column reinforcement device, seismic damper, and viscoelastic damper. Shake table testing was performed to evaluate the earthquake response and verify the performance of these reinforcement systems. The results confirmed that, the maximum displacement, which causes the loss of load resistance and the permanent deformation of racks under external force, is reduced using the developed reinforcement devices. Thus, the appropriate selection of the developed reinforcement devices by users can help secure the safety of the storage racks.

Analytical Study on Strength Safety of LPG Mini Tank with Column for Level Gauge (레벨게이지용 컬럼을 설치한 LPG 미니탱크의 강도안전성에 관한 해석적 연구)

  • Kim, Chung Kyun
    • Journal of the Korean Institute of Gas
    • /
    • v.23 no.3
    • /
    • pp.46-50
    • /
    • 2019
  • In this study, the strength stability of an LPG mini tank with a storage capacity of about 250 kg was analyzed by FEM. According to the results of the FEM analysis, it is preferable that the corner radius of the LPG mini tank having a storage capacity of 250 kg is designed to be 175 to 205 mm. Generally, the larger the corner radius of the end plate of the gas storage tank, the higher the safety of the strength, but the volume or capacity of the tank is reduced. Therefore, it is important to derive the optimum design data. Further, in order to securely design the strength of the gas tank, the thickness of the tank is designed to be thick. However, when the thick steel sheet is used, the material and the transportation costs are increased. The result shows that it is preferable to select the optimum thickness of the steel sheet from 4.5 to 5.5 mm. Using the level gauge type of column on the central axis of the gas tank, the safety strength of the LPG tank can be enhanced as much as twice, compared with the tank of the existing level gauge to measure the liquid level by piercing the side wall of the tank.

On the Occurrence and Distribution of Storage Proteins During the Metamorphosis of Bombyx mori L (누에의 變態에 따른 貯藏蛋白質의 出現과 分布에 관하여)

  • Eul Won Seo;Hak Ryul Kim
    • The Korean Journal of Zoology
    • /
    • v.29 no.1
    • /
    • pp.1-12
    • /
    • 1986
  • Electrophoretic, immunological, and column chromatography methods were used to determine the appearance and distribution of storage proteins in various organs during the metamorphosis of Bombyx mori L. Two storage proteins start to appear in haemolymph in early 5th instar stage and show the identical mobility with fat body proteins. These proteins show the high concentration in haemolymph in last instar stage but accumulate in fat body after pupation. Storage protein-2 shows the distinct pattern for general storage proteins in both male and females. This protein is involved with the formation of cuticle protein in late last instar stage and appears to be temperally deposited in midgut during the pupal stage. Also SP-2 shows the identity with vitellogenin electrophoretically and immunologically and especially the positive reaction with antibody against yolk protein during the pupal stage, demonstrating that the storage protein is closely related to the formation of yolk protein.

  • PDF

A Novel Redundant Data Storage Algorithm Based on Minimum Spanning Tree and Quasi-randomized Matrix

  • Wang, Jun;Yi, Qiong;Chen, Yunfei;Wang, Yue
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.1
    • /
    • pp.227-247
    • /
    • 2018
  • For intermittently connected wireless sensor networks deployed in hash environments, sensor nodes may fail due to internal or external reasons at any time. In the process of data collection and recovery, we need to speed up as much as possible so that all the sensory data can be restored by accessing as few survivors as possible. In this paper a novel redundant data storage algorithm based on minimum spanning tree and quasi-randomized matrix-QRNCDS is proposed. QRNCDS disseminates k source data packets to n sensor nodes in the network (n>k) according to the minimum spanning tree traversal mechanism. Every node stores only one encoded data packet in its storage which is the XOR result of the received source data packets in accordance with the quasi-randomized matrix theory. The algorithm adopts the minimum spanning tree traversal rule to reduce the complexity of the traversal message of the source packets. In order to solve the problem that some source packets cannot be restored if the random matrix is not full column rank, the semi-randomized network coding method is used in QRNCDS. Each source node only needs to store its own source data packet, and the storage nodes choose to receive or not. In the decoding phase, Gaussian Elimination and Belief Propagation are combined to improve the probability and efficiency of data decoding. As a result, part of the source data can be recovered in the case of semi-random matrix without full column rank. The simulation results show that QRNCDS has lower energy consumption, higher data collection efficiency, higher decoding efficiency, smaller data storage redundancy and larger network fault tolerance.