• Title/Summary/Keyword: ITs Performance Index

Search Result 676, Processing Time 0.027 seconds

A Benchmark Test of Spatial Big Data Processing Tools and a MapReduce Application

  • Nguyen, Minh Hieu;Ju, Sungha;Ma, Jong Won;Heo, Joon
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.35 no.5
    • /
    • pp.405-414
    • /
    • 2017
  • Spatial data processing often poses challenges due to the unique characteristics of spatial data and this becomes more complex in spatial big data processing. Some tools have been developed and provided to users; however, they are not common for a regular user. This paper presents a benchmark test between two notable tools of spatial big data processing: GIS Tools for Hadoop and SpatialHadoop. At the same time, a MapReduce application is introduced to be used as a baseline to evaluate the effectiveness of two tools and to derive the impact of number of maps/reduces on the performance. By using these tools and New York taxi trajectory data, we perform a spatial data processing related to filtering the drop-off locations within Manhattan area. Thereby, the performance of these tools is observed with respect to increasing of data size and changing number of worker nodes. The results of this study are as follows 1) GIS Tools for Hadoop automatically creates a Quadtree index in each spatial processing. Therefore, the performance is improved significantly. However, users should be familiar with Java to handle this tool conveniently. 2) SpatialHadoop does not automatically create a spatial index for the data. As a result, its performance is much lower than GIS Tool for Hadoop on a same spatial processing. However, SpatialHadoop achieved the best result in terms of performing a range query. 3) The performance of our MapReduce application has increased four times after changing the number of reduces from 1 to 12.

Quantitative Evaluation on Surveillance Performance of CCTV Systems Based on Camera Modeling and 3D Spatial Analysis (카메라 모델링과 3차원 공간 분석에 기반한 CCTV 시스템 감시 성능의 정량적 평가)

  • Choi, Kyoungah;Lee, Impyeong
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.32 no.2
    • /
    • pp.153-162
    • /
    • 2014
  • As CCTVs are widely utilized in diverse fields, many researchers have continuously studied to improve the surveillance performances of a CCTV system. However, an quantitative evaluation approach about the surveillance performance has rarely been researched. Therefore, we set up the research for suggesting a quantitative evaluation approach to determine the effectiveness of CCTV coverages. We firstly defined the surveillance resolution as that varies according to object's positions and orientations. Based on the definition, we computed surveillance resolution values at all three-dimensional positions with the orientations of interests in the specified space. By comparing these values to the required reasonable resolution, we determined the surveillance performance index indicating how well a CCTV system monitor a target space for specific surveillance objectives. This proposed approach evaluates the surveillance performance of a CCTV system quantitatively, so as examines the CCTV system design before its installation based on precise 3D spatial analysis.

Development of Bridge Maintenance Method based on Life-Cycle Performance and Cost (생애주기 성능 및 비용에 기초한 교량 유지관리기법 개발)

  • Park, Kyung Hoon;Kong, Jung Sik;Hwang, Yoon Koog;Cho, Hyo Nam
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.26 no.6A
    • /
    • pp.1023-1032
    • /
    • 2006
  • In this paper, a new method for the bridge maintenance is proposed to overcome the limit of the existing methods and to implement the preventive bridge maintenance system. The proposed method can establish the lifetime optimum maintenance strategy of the deteriorating bridges considering the life-cycle performance as well as the life-cycle cost. The lifetime performance of the deteriorating bridges is evaluated by the safety index based on the structural reliability and the condition index detailing the condition state. The life-cycle cost is estimated by considering not only the direct maintenance cost but also the user and failure cost. The genetic algorithm is applied to generate a set of maintenance scenarios which is the multi-objective combinatorial optimization problem related to the life-cycle cost and performance. The study examined the proposed method by establishing a maintenance strategy for the existing bridge and its advantages. The result shows that the proposed method can be effectively applied to deciding the bridge maintenance strategy.

Design of an Efficient Parallel High-Dimensional Index Structure (효율적인 병렬 고차원 색인구조 설계)

  • Park, Chun-Seo;Song, Seok-Il;Sin, Jae-Ryong;Yu, Jae-Su
    • Journal of KIISE:Databases
    • /
    • v.29 no.1
    • /
    • pp.58-71
    • /
    • 2002
  • Generally, multi-dimensional data such as image and spatial data require large amount of storage space. There is a limit to store and manage those large amount of data in single workstation. If we manage the data on parallel computing environment which is being actively researched these days, we can get highly improved performance. In this paper, we propose a parallel high-dimensional index structure that exploits the parallelism of the parallel computing environment. The proposed index structure is nP(processor)-n$\times$mD(disk) architecture which is the hybrid type of nP-nD and lP-nD. Its node structure increases fan-out and reduces the height of a index tree. Also, A range search algorithm that maximizes I/O parallelism is devised, and it is applied to K-nearest neighbor queries. Through various experiments, it is shown that the proposed method outperforms other parallel index structures.

A Path Combining Strategy for Efficient Storing of XML Documents (XML 문서의 효율적인 저장을 위한 경로 통합 기법)

  • Lee, Bum-Suk;Hwang, Byung-Yeon
    • Journal of Korea Multimedia Society
    • /
    • v.9 no.10
    • /
    • pp.1257-1265
    • /
    • 2006
  • As XML is increasingly used, the need of researches which are related with XML in various fields is also augmented. Many XML document management systems have been actively developed especially for the storage, processing and retrieval of XML documents. The BitCube is a three dimensional bitmap index system that could be manipulated efficiently and improves the performance of document retrieval. However, the site of index is increase rapidly, when a new bit is added to the axis. This problem is caused by its three dimensional memory structure with document, path and word. We suggest a path combining strategy of XML documents in this paper to solve the problem of BitCube that mentioned above. To reduce the size of index, our approach combines sibling nodes that has same ancestor paths, and transforms word axis into value axis. The method reduces the size of index, when the system com poses the three dimensional bitmap index. It also improves the speed of retrieving, and takes efficiency in storage space.

  • PDF

Developing a Dynamic Materialized View Index for Efficiently Discovering Usable Views for Progressive Queries

  • Zhu, Chao;Zhu, Qiang;Zuzarte, Calisto;Ma, Wenbin
    • Journal of Information Processing Systems
    • /
    • v.9 no.4
    • /
    • pp.511-537
    • /
    • 2013
  • Numerous data intensive applications demand the efficient processing of a new type of query, which is called a progressive query (PQ). A PQ consists of a set of unpredictable but inter-related step-queries (SQ) that are specified by its user in a sequence of steps. A conventional DBMS was not designed to efficiently process such PQs. In our earlier work, we introduced a materialized view based approach for efficiently processing PQs, where the focus was on selecting promising views for materialization. The problem of how to efficiently find usable views from the materialized set in order to answer the SQs for a PQ remains open. In this paper, we present a new index technique, called the Dynamic Materialized View Index (DMVI), to rapidly discover usable views for answering a given SQ. The structure of the proposed index is a special ordered tree where the SQ domain tables are used as search keys and some bitmaps are kept at the leaf nodes for refined filtering. A two-level priority rule is adopted to order domain tables in the tree, which facilitates the efficient maintenance of the tree by taking into account the dynamic characteristics of various types of materialized views for PQs. The bitmap encoding methods and the strategies/algorithms to construct, search, and maintain the DMVI are suggested. The extensive experimental results demonstrate that our index technique is quite promising in improving the performance of the materialized view based query processing approach for PQs.

(Theoretical Analysis and Performance Prediction for PSN Filter Tracking) (PSN 픽터의 해석 및 추적성능 예측)

  • Jeong, Yeong-Heon;Kim, Dong-Hyeon;Hong, Sun-Mok
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.39 no.2
    • /
    • pp.166-175
    • /
    • 2002
  • In this paper. we predict tracking performance of the probabilistic strongest neighbor filter (PSNF). The PSNF is known to be consistent and superior to the probabilistic data association filter (PDAF) in both performance and computation. The PSNF takes into account the probability that the measurement with the strongest intensity in the neighborhood of the predicted target measurement location is not target-originated. The tracking performance of the PSNF is quantified in terms of its estimation error covariance matrix. The estimation error covariance matrix is approximately evaluated by using the hybrid conditional average approach (HYCA). We performed numerical experiments to show the validity of our performance prediction.

Quality assessment of high performance concrete using digitized image elements

  • Peng, Sheng-Szu;Wang, Edward H.;Wang, Her-Yung;Chou, Yu-Te
    • Computers and Concrete
    • /
    • v.10 no.4
    • /
    • pp.409-417
    • /
    • 2012
  • The quality of high performance concrete largely depends on water cement ratio, porosity, material composition and mix methods. The uniformity of color, texture and compressive strengths are quality indicators commonly used to assess the overall characteristics of concrete mixes. The homogeneity and share of coarse aggregates play a key role in concrete quality and must be analyzed in a microscopic point of view. This research studies the quality of high performance concrete by taking drilled cores in both horizontal and vertical directions from a 1.0 $m^3$ specimen. The coarse aggregate, expressed in digitized $100{\times}116$ dpi resolution images are processed based on brightness in colors through commercial software converted into text files. With the image converting to text format, the share of coarse aggregate is quantified leading to a satisfactory assessment of homogeneity - a quality index of high performance concrete. The compressive strengths of concrete and the shares of coarse aggregate of the samples are also compared in this research study to illustrate its correlation in concrete quality. It is concluded that a higher homogeneity of aggregate exists in the vertical plane than that of the horizontal planes of the high performance concrete. In addition, the concrete specimen showing denser particle packing has relatively higher compressive strengths. The research methodology provides an easy-to-use, direct measurement of high performance concrete when conducting quality assessment in the construction site.

Multicity Seasonal Air Quality Index Forecasting using Soft Computing Techniques

  • Tikhe, Shruti S.;Khare, K.C.;Londhe, S.N.
    • Advances in environmental research
    • /
    • v.4 no.2
    • /
    • pp.83-104
    • /
    • 2015
  • Air Quality Index (AQI) is a pointer to broadcast short term air quality. This paper presents one day ahead AQI forecasting on seasonal basis for three major cities in Maharashtra State, India by using Artificial Neural Networks (ANN) and Genetic Programming (GP). The meteorological observations & previous AQI from 2005-2008 are used to predict next day's AQI. It was observed that GP captures the phenomenon better than ANN and could also follow the peak values better than ANN. The overall performance of GP seems better as compared to ANN. Stochastic nature of the input parameters and the possibility of auto-correlation might have introduced time lag and subsequent errors in predictions. Spectral Analysis (SA) was used for characterization of the error introduced. Correlational dependency (serial dependency) was calculated for all 24 models prepared on seasonal basis. Particular lags (k) in all the models were removed by differencing the series, that is converting each i'th element of the series into its difference from the (i-k)"th element. New time series is generated for all seasonal models in synchronization with the original time line & evaluated using ANN and GP. The statistical analysis and comparison of GP and ANN models has been done. We have proposed a promising approach of use of GP coupled with SA for real time prediction of seasonal multicity AQI.

On the performance of the hash based indexes for storing the position information of moving objects (이동체의 위치 정보를 저장하기 위한 해쉬 기반 색인의 성능 분석)

  • Jun, Bong-Gi
    • Journal of the Korea Society of Computer and Information
    • /
    • v.11 no.6 s.44
    • /
    • pp.9-17
    • /
    • 2006
  • Moving objects database systems manage a set of moving objects which changes its locations and directions continuously. The traditional spatial indexing scheme is not suitable for the moving objects because it aimed to manage static spatial data. Because the location of moving object changes continuously, there is problem that expense that the existent spatial index structure reconstructs index dynamically is overladen. In this paper, we analyzed the insertion/deletion costs for processing the movement of objects. The results of our extensive experiments show that the Dynamic Hashing Index outperforms the original R-tree and the fixed grid typically by a big margin.

  • PDF