• Title/Summary/Keyword: Cloud amount

Search Result 391, Processing Time 0.032 seconds

Data Deduplication Method using PRAM Cache in SSD Storage System (SSD 스토리지 시스템에서 PRAM 캐시를 이용한 데이터 중복제거 기법)

  • Kim, Ju-Kyeong;Lee, Seung-Kyu;Kim, Deok-Hwan
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.4
    • /
    • pp.117-123
    • /
    • 2013
  • In the recent cloud storage environment, the amount of SSD (Solid-State Drive) replacing with the traditional hard disk drive is increasing. Management of SSD for its space efficiency has become important since SSD provides fast IO performance due to no mechanical movement whereas it has wearable characteristics and does not provide in place update. In order to manage space efficiency of SSD, data de-duplication technique is frequently used. However, this technique occurs much overhead because it consists of data chunking, hasing and hash matching operations. In this paper, we propose new data de-duplication method using PRAM cache. The proposed method uses hierarchical hash tables and LRU(Least Recently Used) for data replacement in PRAM. First hash table in DRAM is used to store hash values of data cached in the PRAM and second hash table in PRAM is used to store hash values of data in SSD storage. The method also enhance data reliability against power failure by maintaining backup of first hash table into PRAM. Experimental results show that average writing frequency and operation time of the proposed method are 44.2% and 38.8% less than those of existing data de-depulication method, respectively, when three workloads are used.

Big Data Based Dynamic Flow Aggregation over 5G Network Slicing

  • Sun, Guolin;Mareri, Bruce;Liu, Guisong;Fang, Xiufen;Jiang, Wei
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.10
    • /
    • pp.4717-4737
    • /
    • 2017
  • Today, smart grids, smart homes, smart water networks, and intelligent transportation, are infrastructure systems that connect our world more than we ever thought possible and are associated with a single concept, the Internet of Things (IoT). The number of devices connected to the IoT and hence the number of traffic flow increases continuously, as well as the emergence of new applications. Although cutting-edge hardware technology can be employed to achieve a fast implementation to handle this huge data streams, there will always be a limit on size of traffic supported by a given architecture. However, recent cloud-based big data technologies fortunately offer an ideal environment to handle this issue. Moreover, the ever-increasing high volume of traffic created on demand presents great challenges for flow management. As a solution, flow aggregation decreases the number of flows needed to be processed by the network. The previous works in the literature prove that most of aggregation strategies designed for smart grids aim at optimizing system operation performance. They consider a common identifier to aggregate traffic on each device, having its independent static aggregation policy. In this paper, we propose a dynamic approach to aggregate flows based on traffic characteristics and device preferences. Our algorithm runs on a big data platform to provide an end-to-end network visibility of flows, which performs high-speed and high-volume computations to identify the clusters of similar flows and aggregate massive number of mice flows into a few meta-flows. Compared with existing solutions, our approach dynamically aggregates large number of such small flows into fewer flows, based on traffic characteristics and access node preferences. Using this approach, we alleviate the problem of processing a large amount of micro flows, and also significantly improve the accuracy of meeting the access node QoS demands. We conducted experiments, using a dataset of up to 100,000 flows, and studied the performance of our algorithm analytically. The experimental results are presented to show the promising effectiveness and scalability of our proposed approach.

Robust Semi-auto Calibration Method for Various Cameras and Illumination Changes (다양한 카메라와 조명의 변화에 강건한 반자동 카메라 캘리브레이션 방법)

  • Shin, Dong-Won;Ho, Yo-Sung
    • Journal of Broadcast Engineering
    • /
    • v.21 no.1
    • /
    • pp.36-42
    • /
    • 2016
  • Recently, many 3D contents have been produced through the multiview camera system. In this system, since a difference of the viewpoint between color and depth cameras is inevitable, the camera parameter plays the important role to adjust the viewpoint as a preprocessing step. The conventional camera calibration method is inconvenient to users since we need to choose pattern features manually after capturing a planar chessboard with various poses. Therefore, we propose a semi-auto camera calibration method using a circular sampling and an homography estimation. Firstly, The proposed method extracts the candidates of the pattern features from the images by FAST corner detector. Next, we reduce the amount of the candidates by the circular sampling and obtain the complete point cloud by the homography estimation. Lastly, we compute the accurate position having the sub-pixel accuracy of the pattern features by the approximation of the hyper parabola surface. We investigated which factor affects the result of the pattern feature detection at each step. Compared to the conventional method, we found the proposed method released the inconvenience of the manual operation but maintained the accuracy of the camera parameters.

A Study on the Geometric Correction Accuracy Evaluation of Satellite Images Using Daum Map API (Daum Map API를 이용한 위성영상의 기하보정 정확도 평가)

  • Lee, Seong-Geun;Lee, Ho-Jin;Kim, Tae-Geun;Cho, Gi-Sung
    • Journal of Cadastre & Land InformatiX
    • /
    • v.46 no.2
    • /
    • pp.183-196
    • /
    • 2016
  • Ground control points are needed for precision geometric correction of satellite images, and the coordinates of a high-quality ground control point can be obtained from the GPS measurement. However, considering the GPS measurement requires an excessive amount o f t ime a nd e fforts, there is a need for coming up with an alternative solution to replace it. Therefore, we examined the possibility of replacing the existing GPS measurement with coordinates available at online maps to acquire the coordinates of ground control points. To this end, we examined error amounts between the coordinates of ground control points obtained through Daum Map API, and them compared the accuracies between three types of coordinate transformation equations which were used for geometric correction of satellite images. In addition, we used the coordinate transformation equation with the highest accuracy, the coordinates of ground control point obtained through the GPS measurement and those acquired through D aum M ap A PI, and conducted geometric correction on them to compare their accuracy and evaluate their effectiveness. According to the results, the 3rd order polynomial transformation equation showed the highest accuracy among three types of coordinates transformation equations. In the case of using mid-resolution satellite images such as those taken by Landsat-8, it seems that it is possible to use geometrically corrected images that have been obtained after acquiring the coordinates of ground control points through Daum Map API.

A Design and Analysis of Pressure Predictive Model for Oscillating Water Column Wave Energy Converters Based on Machine Learning (진동수주 파력발전장치를 위한 머신러닝 기반 압력 예측모델 설계 및 분석)

  • Seo, Dong-Woo;Huh, Taesang;Kim, Myungil;Oh, Jae-Won;Cho, Su-Gil
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.11
    • /
    • pp.672-682
    • /
    • 2020
  • The Korea Nowadays, which is research on digital twin technology for efficient operation in various industrial/manufacturing sites, is being actively conducted, and gradual depletion of fossil fuels and environmental pollution issues require new renewable/eco-friendly power generation methods, such as wave power plants. In wave power generation, however, which generates electricity from the energy of waves, it is very important to understand and predict the amount of power generation and operational efficiency factors, such as breakdown, because these are closely related by wave energy with high variability. Therefore, it is necessary to derive a meaningful correlation between highly volatile data, such as wave height data and sensor data in an oscillating water column (OWC) chamber. Secondly, the methodological study, which can predict the desired information, should be conducted by learning the prediction situation with the extracted data based on the derived correlation. This study designed a workflow-based training model using a machine learning framework to predict the pressure of the OWC. In addition, the validity of the pressure prediction analysis was verified through a verification and evaluation dataset using an IoT sensor data to enable smart operation and maintenance with the digital twin of the wave generation system.

A Comparative Analysis of Cognitive Change about Big Data Using Social Media Data Analysis (소셜 미디어 데이터 분석을 활용한 빅데이터에 대한 인식 변화 비교 분석)

  • Yun, Youdong;Jo, Jaechoon;Hur, Yuna;Lim, Heuiseok
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.6 no.7
    • /
    • pp.371-378
    • /
    • 2017
  • Recently, with the spread of smart device and the introduction of web services, the data is rapidly increasing online, and it is utilized in various fields. In particular, the emergence of social media in the big data field has led to a rapid increase in the amount of unstructured data. In order to extract meaningful information from such unstructured data, interest in big data technology has increased in various fields. Big data is becoming a key resource in many areas. Big data's prospects for the future are positive, but concerns about data breaches and privacy are constantly being addressed. On this subject of big data, where positive and negative views coexist, the research of analyzing people's opinions currently lack. In this study, we compared the changes in peoples perception on big data based on unstructured data collected from the social media using a text mining. As a results, yearly keywords for domestic big data, declining positive opinions, and increasing negative opinions were observed. Based on these results, we could predict the flow of domestic big data.

An Agroclimatic Data Retrieval and Analysis System for Microcomputer Users(CLIDAS) (퍼스컴을 이용한 농업기후자료 검색 및 분석시스템)

  • 윤진일;김영찬
    • KOREAN JOURNAL OF CROP SCIENCE
    • /
    • v.38 no.3
    • /
    • pp.253-263
    • /
    • 1993
  • Climatological informations have not been fully utilized by agricultural research and extension workers in Korea due mainly to inaccessbilty to the archived climate data. This study was initiated to improve access to historical climate data gathered from 72 weather stations of Korea Meteorological Administration for agricultural applications by using a microcomputer-based methodology. The climatological elements include daily values of average, maximum and minimum temperature, relative humidity, average and maximum wind speed, wind direction, evaporation, precipitation, sunshine duration and cloud amount. The menu-driven, user-friendly data retrieval system(CLIDAS) provides quick summaries of the data values on a daily, weekly and monthly basis and selective retrieval of weather records meeting certain user specified critical conditions. Growing degree days and potential evapotranspiration data are derived from the daily climatic data, too. Data reports can be output to the computer screen, a printer or ASCII data files. CLIDAS can be run on any IBM compatible machines with Video Graphics Array card. To run the system with the whole database, more than 50 Mb hard disk space should be available. The system can be easily upgraded for further expansion of functions due to the module-structured design.

  • PDF

Design of Integrated Management System for Electronic Library Based on SaaS and Web Standard

  • Lee, Jong-Hoon;Min, Byung-Won;Oh, Yong-Sun
    • International Journal of Contents
    • /
    • v.11 no.1
    • /
    • pp.41-51
    • /
    • 2015
  • Management systems for electronic library have been developed on the basis of Client/Server or ASP framework in domestic market for a long time. Therefore, both service provider and user suffer from their high cost and effort in management, maintenance, and repairing of software as well as hardware. Recently in addition, mobile devices like smartphone and tablet PC are frequently used as terminal devices to access computers through the Internet or other networks, sophisticatedly customized or personalized interface for n-screen service became more important issue these days. In this paper, we propose a new scheme of integrated management system for electronic library based on SaaS and Web Standard. We design and implement the proposed scheme applying Electronic Cabinet Guidelines for Web Standard and Universal Code System. Hosted application management style and software on demand style service models based on SaaS are basically applied to develop the management system. Moreover, a newly improved concept of duplication check algorithm in a hierarchical evaluation process is presented and a personalized interface based on web standard is applied to implement the system. Algorithms of duplication check for journal, volume/number, and paper are hierarchically presented with their logic flows. Total framework of our development obeys the standard feature of Electronic Cabinet Guidelines offered by Korea government so that we can accomplish standard of application software, quality improvement of total software, and reusability extension. Scope of our development includes core services of library automation system such as acquisition, list-up, loan-and-return, and their related services. We focus on interoperation compatibility between elementary sub-systems throughout complex network and structural features. Reanalyzing and standardizing each part of the system under the concept on the cloud of service, we construct an integrated development environment for generating, test, operation, and maintenance. Finally, performance analyses are performed about resource usability of server, memory amount used, and response time of server etc. As a result of measurements fulfilled over 5 times at different test points and using different data, the average response time is about 62.9 seconds for 100 clients, which takes about 0.629 seconds per client on the average. We can expect this result makes it possible to operate the system in real-time level proof. Resource usability and memory occupation are also good and moderate comparing to the conventional systems. As total verification tests, we present a simple proof to obey Electronic Cabinet Guidelines and a record of TTA authentication test for topics about SaaS maturity, performance, and application program features.

Analysis of Building Energy by the Typical Meteorological Data (표준기상데이터(부산지역) 적용에 따른 건축물에너지 분석)

  • Park, So-Hee;Yoo, Ho-Chun
    • 한국태양에너지학회:학술대회논문집
    • /
    • 2008.11a
    • /
    • pp.202-207
    • /
    • 2008
  • Measures for coping with energy shortage are being sought all over the world. Following such a phenomenon, effort to use less energy in the design of buildings and equipment are being conducted. In particular, a program to evaluate the performance of a building comes into the spotlight. However. indispensable standard wether data to estimate the exact energy consumption of a building is currently unprepared. Thus, after appling standard weather data for four weather factors which were used in previous researches to Visual DOE 4.0, we compared it with the result of the existing data and evaluated them. For the monthly cooling and heating load of our target building, we used revised data for June, July, August, and September during which cooling load is applied. When not the existing data but the revised data was used, the research shows that an average of 14.9% increased in June, August, and September except for July. Also, in a case of heating load, the result by the revised data shows a reduction of an average of 11.9% from October to April during which heating load is applied. In particular, the heating loads of all months for which the revised data was used were more low than those of the existing data. In the maximum cooling and heating load according to load factors, the loads by residents and illumination for which the revised data was used were the same as those of the existing data, but the maximum cooling loads used by the two data have a difference in structures such as walls and roofs. Through the above results, the research cannot clearly grasp which weather data influences the cooling and heating load of a building. However, in the maximum loads by the change of weather data in four factors (dry-bulb temperature, web-bulb temperature, cloud amount, and wind speed) among 14 weather factors, the research shows that 5.95% in cooling load and 27.56% in heating load increased, and these results cannot be ignored. In order to make weather data for Performing energy performance evaluation for future buildings, the flow of weather data for the Present and past should be obviously grasped.

  • PDF

Current and Future Changes in the Type of Wintertime Precipitation in South Korea (현재와 미래 우리나라 겨울철 강수형태 변화)

  • Choi, Gwang-Yong;Kwon, Won-Tae
    • Journal of the Korean Geographical Society
    • /
    • v.43 no.1
    • /
    • pp.1-19
    • /
    • 2008
  • This study intends to clarify the characteristics and causes of current changes in wintertime precipitation in Korea and to predict the future directions based on surface observational $(1973/04\sim2006/07)$ and modeled (GFDL 2.1) climate data. Analyses of surface observation data demonstrate that without changes in the total amount of precipitation, snowfall in winter (November-April) has reduced by 4.3cm/decade over the $1973\sim2007$ period. Moreover, the frequency and intensity of snowfall have decreased; the duration of snow season has shortened; and the snow-to-rain day ratio (STDR) has decreased. These patterns indicate that the type of wintertime precipitation has changed from snow to rain in recent decades. The snow-to-rain change in winter is associated with the increases of air temperature (AT) over South Korea. Analyses of synoptic charts reveal that the warming pattern is associated with the formation of a positive pressure anomaly core over northeast Asia by a hemispheric positive winter Arctic Oscillation (AO) mode. Moreover, the differentiated warming of AT versus sea surface temperature (SST) under the high pressure anomaly core reduces the air-sea temperature gradient, and subsequently it increases the atmospheric stability above oceans, which is associated with less formation of snow cloud. Comparisons of modeled data between torrent $(1981\sim2000)$ and future $(2081\sim2100)$ periods suggest that the intensified warming with larger anthropogenic greenhouse gas emission in the $21^{st}$ century will amplify the magnitude of these changes. More reduction of snow impossible days as well as more abbreviation of snow seasons is predicted in the $21^{st}$ century.