• Title/Summary/Keyword: Cloud storage system

Search Result 188, Processing Time 0.032 seconds

The Study on the Design and Optimization of Storage for the Recording of High Speed Astronomical Data (초고속 관측 데이터 수신 및 저장을 위한 기록 시스템 설계 및 성능 최적화 연구)

  • Song, Min-Gyu;Kang, Yong-Woo;Kim, Hyo-Ryoung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.12 no.1
    • /
    • pp.75-84
    • /
    • 2017
  • It becomes more and more more important for the storage that supports high speed recording and stable access from network environment. As one field of basic science which produces massive astronomical data, VLBI(: Very Long Baseline Interferometer) is now demanding more data writing performance and which is directly related to astronomical observation with high resolution and sensitivity. But most of existing storage are cloud model based for the high throughput of general IT, finance, and administrative service, and therefore it not the best choice for recording of big stream data. Therefore, in this study, we design storage system optimized for high performance of I/O and concurrency. To solve this problem, we implement packet read and writing module through the use of libpcap and pf_ring API on the multi core CPU environment, and build a scalable storage based on software RAID(: Redundant Array of Inexpensive Disks) for the efficient process of incoming data from external network.

Version-Aware Cooperative Caching for Multi-Node Rendering

  • Cho, Kyungwoon;Bahn, Hyokyung
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.14 no.2
    • /
    • pp.30-35
    • /
    • 2022
  • Rendering is widely used for visual effects in animations and movies. Although rendering is computing-intensive, we observe that it accompanies heavy I/O because of large input data. This becomes technical hurdles for multi-node rendering performed on public cloud nodes. To reduce the overhead of data transmission in multi-node rendering, this paper analyzes the characteristics of rendering workloads, and presents the cooperative caching scheme for multi-node rendering. Our caching scheme has the function of synchronization between original data in local storage and cached data in rendering nodes, and the cached data are shared between multiple rendering nodes. We perform measurement experiments in real system environments and show that the proposed cooperative caching scheme improves the conventional caching scheme used in the network file system by 27% on average.

A Study on ESS-based Clean Energy, Smart Home IoT Platform (ESS기반 클린에너지, 스마트홈 IoT 플랫폼 연구)

  • Kim, Hee-Chul
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.13 no.1
    • /
    • pp.147-152
    • /
    • 2018
  • This study investigates the demand management and energy saving plan of the apartment house based on the ESS (: Energy Storage System), which is the main equipment in the field of electric power energy efficiency, and suggests standardization for various technical factors and operation. It contributes to the spread of ESS industry. In addition, to create ESS market for apartment houses and smart homes, housing IoT technology is used to integrate apartment houses with smart home-based ESS and it is possible to achieve use efficiency and economic feasibility of power users, We will study a business model that can reconsider the acceptability of power users.

Design and Evaluation of an Efficient Flushing Scheme for key-value Store (키-값 저장소를 위한 효율적인 로그 처리 기법 설계 및 평가)

  • Han, Hyuck
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.5
    • /
    • pp.187-193
    • /
    • 2019
  • Key-value storage engines are an essential component of growing demand in many computing environments, including social networks, online e-commerce, and cloud services. Recent key-value storage engines offer many features such as transaction, versioning, and replication. In a key-value storage engine, transaction processing provides atomicity through Write-Ahead-Logging (WAL), and a synchronous commit method for transaction processing flushes log data before the transaction completes. According to our observation, flushing log data to persistent storage is a performance bottleneck for key-value storage engines due to the significant overhead of fsync() calls despite the various optimizations of existing systems. In this article, we propose a group synchronization method to improve the performance of the key-value storage engine. We also design and implement a transaction scheduling method to perform other transactions while the system processes fsync() calls. The proposed method is an efficient way to reduce the number of frequent fsync() calls in the synchronous commit while supporting the same level of transaction provided by the existing system. We implement our scheme on the WiredTiger storage engine and our experimental results show that the proposed system improves the performance of key-value workloads over existing systems.

Service Platform Technology of Dynamic Contents Collaboration of Clouds (클라우드 간의 콘텐츠 동적협업 서비스 플랫폼 기술)

  • Hong, YoHoon;Kusmawan, Putu;Rho, Jungkyu
    • Journal of Satellite, Information and Communications
    • /
    • v.11 no.2
    • /
    • pp.1-7
    • /
    • 2016
  • In this paper, we propose contents authoring, management, and distribution technologies where the contents registered in secure storage through a content acquisition and authoring tool can be used as a common experience in smartphones, smart pads, and PCs. Currently, many people are producing and consuming various types of contents in bulk, and it is expected that real-time contents and old contents coexist as IoT(Internet of Things) technology is commonly deployed in the future. Therefore, we need to develop a differentiated service that can compete with global services in contents authoring and collaboration systems to create new markets. Accordingly, we implemented an authoring service platform to occupy cloud markets with high quality contents produced through collaboration.

Variation Characteristics of Hourly Atmospheric Temperature Throughout a Winter (동계 시각별 외기온의 변동 특성에 관한 연구)

  • Lee, Seung-Eon;Shon, Jang-Yeul
    • Solar Energy
    • /
    • v.12 no.2
    • /
    • pp.1-8
    • /
    • 1992
  • Identifying characteristics of heating and cooling systems requires estimation of thermal load of specific time interval, especially in cases that its system is operated intermittently, by using thermal storage, of in a partial load condition. Estimating the thermal load, however, needs to forecast hourly weather data variation. Hence, this paper attempts to examine characteristics of hourly ourdoor temperature variation as a preliminary research for the mathematical modeling of the hourly weather variation. Speculating characteristics of daily minimum and maximum temperature occurances, hourly outdoor temperature variation, and daily temperature differences in the increasing range ($07h{\sim}15h$) and decreasing range($15h{\sim}07h$), we were able to analyze changing patterns of daily temperature differences in each range in terms of daily solar amount, cloud ratio, and other weather data. Results from the multiple regression analysis enables us to conclude that daily differences in the increasing range are strongly affected last night temperature itself while the other range's differences are influenced by many weather data, which are solar amount, the variation of cloud, and the maximum temperature of the previous day.

  • PDF

cMac : A Context-aware Mobile Apps-on-a-Cloud Architecture Empowering smart devices by leveraging Platform as a Service (PaaS) (클라우드 아키텍처 기반 상황인지 모바일 애플리케이션)

  • Amin, Muhammad Bilal;Lee, Sung-Young;Lee, Young-Koo
    • Annual Conference of KIPS
    • /
    • 2011.04a
    • /
    • pp.40-42
    • /
    • 2011
  • Smart hand-held devices like iPhone, iPad, Andriod and other mobile-OS machines are becoming a well known part of our daily lives. Utilization of these devices has gone beyond the expectations of their inventors. Evolution of Apple's iOS from a mobile phone Operating System to a wholesome platform for Portable Gaming is an adequate proof. Using these smart devices people are downloading applications from numerous online App Stores. Utilizing remote storage facilities and confining themselves to computing power far below than an entry level laptop, netbooks have emerged. Google's idea of Chrome OS coupled with Google's AppEngine is an eye-opener for researchers and developers. Keeping all these industry-proven innovations in mind we are proposing a Context-Driven Cloud-Oriented Application Architecture for smart devices. This architecture enables our smart devices to behave smarter by utilizing very less of local resources.

Performance Analysis of NVMe SSDs and Design of Direct Access Engine on Virtualized Environment (가상화 환경에서 NVMe SSD 성능 분석 및 직접 접근 엔진 개발)

  • Kim, Sewoog;Choi, Jongmoo
    • KIISE Transactions on Computing Practices
    • /
    • v.24 no.3
    • /
    • pp.129-137
    • /
    • 2018
  • NVMe(Non-Volatile Memory Express) SSD(Solid State Drive) is a high-performance storage that makes use of flash memory as a storage cell, PCIe as an interface and NVMe as a protocol on the interface. It supports multiple I/O queues which makes it feasible to process parallel-I/Os on multi-core environments and to provide higher bandwidth than SATA SSDs. Hence, NVMe SSD is considered as a next generation-storage for data-center and cloud computing system. However, in the virtualization system, the performance of NVMe SSD is not fully utilized due to the bottleneck of the software I/O stack. Especially, when it uses I/O stack of the hypervisor or the host operating system like Xen and KVM, I/O performance degrades seriously due to doubled-I/O stack between host and virtual machine. In this paper, we propose a new I/O engine, called Direct-AIO (Direct-Asynchronous I/O) engine, that can access NVMe SSD directly for I/O performance improvements on QEMU emulator. We develop our proposed I/O engine and analyze I/O performance differences between the existed I/O engine and Direct-AIO engine.

Development of a Driver-Oriented Engine Control Unit (ECU)-Mapping System With BigData Analysis (빅데이터 분석을 통한 운전자 맞춤형 엔진 제어 장치 시스템의 개발)

  • Kim, Shik;Kim, Junghwan
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.12 no.4
    • /
    • pp.247-258
    • /
    • 2017
  • Since 2016 when the regulations related to vehicle structure and device modification were drastically revised, the car tuning market has been growing rapidly. Particularly, many drivers are showing interest in changing the interior and exterior according to their preference, or improving the specifications of their cars by changing the engine and powertrain, among others. Also, as the initial engine settings such as horse power and torque of the vehicle are made for stable driving of the vehicle, it is possible to change the engine performance, via Engine Control Unit (ECU) mapping, to the driver's preference. However, traditionally, ECU mapping could be only performed by professional car engineers and the settings were also decided by them. Therefore, this study proposed a system that collects data related to the driver's driving habits for a certain period and sends them to a cloud server in order to analyze them and recommend ECU mapping values. The traditional mapping method only aimed to improve the car's performance and, therefore, if the changes were not compatible with the driver's driving habits, could cause problems such as incomplete combustion or low fuel efficiency. However, the proposed system allows drivers to set legally permitted ECU mapping based on analysis of their driving habits, and, therefore, different drivers can set it differently according to the vehicle specifications and driving habits. As a result, the system can optimize the car performance by improving output, fuel efficiency, etc. within the range that is legally permitted.

Dynamic Bandwidth Distribution Method for High Performance Non-volatile Memory in Cloud Computing Environment (클라우드 환경에서 고성능 저장장치를 위한 동적 대역폭 분배 기법)

  • Kwon, Piljin;Ahn, Sungyong
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.3
    • /
    • pp.97-103
    • /
    • 2020
  • Linux Cgroups takes a fundamental role for sharing system resources among multiple containers on container-based cloud computing environment. Especially for I/O resource, Linux Cgroups supports a mechanism for sharing I/O bandwidth in proportion to I/O weight. However, the current mechanism of Linux Cgroups using BFQ I/O scheduler seriously degrades the I/O performance with high bandwidth storage device such as NVMe SSDs. In this paper, we proposed a new feedback based I/O bandwidth sharing scheme for Linux Cgroups which allocates I/O credits to containers according to I/O weights and adjusts the amount of credits to performance fluctuation of NVMe SSDs. The proposed scheme is implemented on Linux kernel 5.3 and evaluated. The evaluation results show that it can share the I/O bandwidth among multiple containers proportionally to I/O weights while improving I/O performance more than twice as high as the existing scheme.