• Title/Summary/Keyword: Distributed Data Analysis

Search Result 2,350, Processing Time 0.034 seconds

Interoperability of OpenGIS Component and Spatial Analysis Component (개방형 GIS 컴포넌트에서의 공간분석 컴포넌트 연동)

  • Min, Kyoung-Wook;Jang, In-Sung;Lee, Jong-Hun
    • Journal of Korea Spatial Information System Society
    • /
    • v.3 no.1 s.5
    • /
    • pp.49-62
    • /
    • 2001
  • Recently, component-based software has become main trends in designing and developing computer software products. This component-based software has advantage of the interoperability on distributed computing environment and the reusability of pre-developed components. Also, GIS is designed and implemented with this component-based methodology, called Open GIS Component. OGC(OpenGIS Consortium) have announced various implementation and design specification and topic in GIS. In GIS, Spatial analysis functions like network analysis, TIN analysis are very important function and basically, estimate system functionality and performance using this analysis methods. The simple feature geometry specification is announced by OGC to increase the full interoperability of various spatial data. This specification includes just geometry spatial data model. However, in GIS which manages spatial data, not only geometric data but also topological data and various analysis functions have been used. The performance of GIS depends on how this geometric and topological data is managed well and how various spatial analyses are executed efficiently. So it requires integrated spatial data model between geometry and topology and extended data model of topology for spatial analysis, in case network analysis and TIN analysis in open GIS component. In this paper, we design analysis component like network analysis component and TIN analysis component. To manage topological information for spatial analysis in open GIS component, we design extended data model of simple feature geometry for spatial analysis. In addition to, we design the overall system architecture of open GIS component contained this topology model for spatial analysis.

  • PDF

Design of a Platform for Collecting and Analyzing Agricultural Big Data (농업 빅데이터 수집 및 분석을 위한 플랫폼 설계)

  • Nguyen, Van-Quyet;Nguyen, Sinh Ngoc;Kim, Kyungbaek
    • Journal of Digital Contents Society
    • /
    • v.18 no.1
    • /
    • pp.149-158
    • /
    • 2017
  • Big data have been presenting us with exciting opportunities and challenges in economic development. For instance, in the agriculture sector, mixing up of various agricultural data (e.g., weather data, soil data, etc.), and subsequently analyzing these data deliver valuable and helpful information to farmers and agribusinesses. However, massive data in agriculture are generated in every minute through multiple kinds of devices and services such as sensors and agricultural web markets. It leads to the challenges of big data problem including data collection, data storage, and data analysis. Although some systems have been proposed to address this problem, they are still restricted either in the type of data, the type of storage, or the size of data they can handle. In this paper, we propose a novel design of a platform for collecting and analyzing agricultural big data. The proposed platform supports (1) multiple methods of collecting data from various data sources using Flume and MapReduce; (2) multiple choices of data storage including HDFS, HBase, and Hive; and (3) big data analysis modules with Spark and Hadoop.

Application of K-DRUM Model for Pakistan Kunhar River Basin Considering Long-term Snow Melt and Cover (장기 융·적설을 고려한 파키스탄 Kunhar강 유역 K-DRUM모형 구축 및 적용)

  • Park, Jin Hyeog;Hur, Young Teck;Noh, Joon Woo;Kim, Seo-Won
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.33 no.6
    • /
    • pp.2237-2244
    • /
    • 2013
  • In this study, physics based K-DRUM(K-water Distributed RUnoff Model) using GIS spatial hydrologic data as input data was developed to account for the temperature variation according to the altitude change considering snow melt and cover. The model was applied for Pakistan Kunhar River Basin($2,500km^2$) to calculate long-term discharge considering snow melt and cover. Time series analysis of the temperature and rainfall data reveals that temperature and rainfall of the river basin differs significantly according to altitude change compared to domestic basin. Thus, applying temperature and altitude lapse rate during generate input data generation. As a result, calculated discharge shows good agreement with observed ones considering snow melt and accumulation characteristic which has the difference of 4,000 meter elevation above sea level. In addition, the simulated discharge strongly showed snow melting effect associated with temperature rise during the summer season.

Analysis on Orbital Dynamics Operation Results of KOMPSAT-3 during Early Phase after Launch (다목적실용위성 3호 발사 후 초기 궤도 운영결과 분석)

  • Jung, Ok-Chul;Yim, Hyeonjeong;Chung, Dae-Won;Kim, Eun-Kyou;Kim, Hak-Jung
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.41 no.4
    • /
    • pp.319-326
    • /
    • 2013
  • This paper describes the orbital dynamics operation results for the launch and early operations phase (LEOP) of KOMPSAT-3, which was successfully launched on May 18, 2012. At the initial phase, operational orbit determination was carried out using ground tracking data and GPS navigation solution. And, both in-plane and out-of plane maneuvers were executed in order to change the orbit from the injection orbit to the mission orbit. In addition, the accuracy of precise orbit determination was indirectly evaluated by overlapping method using GPS raw data of KOMPSAT-3 and international GNSS service data from worldwide-distributed ground stations. Currently, KOMPSAT-3 is operated in pre-defined mission orbit, and its various kinds of orbit data are generated and distributed to support the normal mission operations.

Model Analysis of Plate using by Digital Test System (디지털 실험장치를 이용한 판의 모우드 해석)

  • Hong, Bong-Ki;Bae, Dong-Myung;Bae, Seong-Yoeng
    • Journal of the Korean Society of Fisheries and Ocean Technology
    • /
    • v.29 no.1
    • /
    • pp.39-55
    • /
    • 1993
  • Modal Analysis is the process of characterizing the dynamic properties of an elastic structure by identifying its modes of vibration. A mode of vibration is a global property of an elastic structure. That is, a mode has a specific natural frequency and damping factor which can be identified from response data at practically any point on a structure, and it has a characteristic mode shape which identifies the mode spatially over the entire structure. Modal testing is able to be performed on structural and mechanical structure in an effort to learn more about their elastic behavior. Once the dynamic properties of a structure are known its behavior can be predicted and therefore controlled or corrected. Resonant frequencies, damping factors and mode shape data can be used directly by a mechanical designer to pin point weak spots in a structure design, or this data can also be used to confirm or synthesize equations of motion for the elastic structure. These differential equations can be used to simulate structural response to know input forces and to examine the effects of pertubations in the distributed mass, stiffness and damping properties of the structure in more detail. In this paper the measurement of transfer functions in digital form, and the application of digital parameter identification techniques to identify modal parameters from the measured transfer function data are discussed. It is first shown that the transfer matrix, which is a complete dynamic model of an elastic plate structure can be written in terms of the structural modes of vibration. This special mathematical form allows one to identify the complete dynamics of the structure from a much reduced set of test data, and is the essence of the modal approach to identifying the dynamics of a structure. Finally, the application of transfer function models and identification techniques for obtaining modal parameters from the transfer function data are discussed. Characteristics on vibration response of elastic plate structure obtained from the dynamic analysis by Finite Element Method are compared with results of modal analysis.

  • PDF

Integrated Database for Economic, Social, and Cultural Data of Local Governments (지방자치단체의 경제, 사회, 문화 통합 DB 구축 방안)

  • Im, Kwang Hyuk
    • The Journal of the Korea Contents Association
    • /
    • v.16 no.6
    • /
    • pp.441-449
    • /
    • 2016
  • The integrated data is an essential in the analysis for the balanced development of the local governments, but economic, social and cultural data in local governments is not being made with integrated management. A variety of information is being published according to the Government 3.0 era, but the researchers has great difficulty in integrating the analysis for one topic because related information is scattered in various sites. This paper proposes an integrated database(DB) of local governments to support the research activities. It has to contains total information of economic, social and cultural activities of local governments, and accommodate the distributed and heterogeneous data. It has the schema designed to integrate the entire data for considering the differences between local governments or data components. We should focus to build a framework for the multifaceted research to enable the cross analysis over common elements.

The GARCH-GPD in market risks modeling: An empirical exposition on KOSPI

  • Atsmegiorgis, Cheru;Kim, Jongtae;Yoon, Sanghoo
    • Journal of the Korean Data and Information Science Society
    • /
    • v.27 no.6
    • /
    • pp.1661-1671
    • /
    • 2016
  • Risk analysis is a systematic study of uncertainties and risks we encounter in business, engineering, public policy, and many other areas. Value at Risk (VaR) is one of the most widely used risk measurements in risk management. In this paper, the Korean Composite Stock Price Index data has been utilized to model the VaR employing the classical ARMA (1,1)-GARCH (1,1) models with normal, t, generalized hyperbolic, and generalized pareto distributed errors. The aim of this paper is to compare the performance of each model in estimating the VaR. The performance of models were compared in terms of the number of VaR violations and Kupiec exceedance test. The GARCH-GPD likelihood ratio unconditional test statistic has been found to have the smallest value among the models.

Household Over-indebtedness and Financial Vulnerability in Korea: Evidence from Credit Bureau Data

  • KIM, YOUNG IL;KIM, HYOUNG CHAN;YOO, JOO HEE
    • KDI Journal of Economic Policy
    • /
    • v.38 no.3
    • /
    • pp.53-77
    • /
    • 2016
  • Financial soundness in the household sector matters for financial stability and for the real economy. The level of household debt in Korea raises concern about the financial soundness of the household sector due to its size, growth rate and quality. Against this backdrop, we assess the financial vulnerability of borrowers based on an analysis of credit bureau (CB) data, in which the actual credit activities of most individuals are recorded at a high frequency in Korea. We construct over-indebtedness indicators from the CB data and then assess the predictability of forthcoming defaults. Based on the over-indebtedness indicators, we show how borrowers are distributed in terms of over-indebtedness and how the over-indebted differ from average borrowers in terms of their characteristics. Furthermore, we show how the aggregate credit risk in the household sector would change under macroeconomic distress by analyzing how each borrower's credit quality would be affected by adverse shocks. The findings of this paper may contribute to assessing household debt vulnerability and to enhancing regulatory and supervisory practices for financial stability.

  • PDF

Charted Depth Interpolation: Neuron Network Approaches

  • Shi, Chaojian
    • Journal of Navigation and Port Research
    • /
    • v.28 no.7
    • /
    • pp.629-634
    • /
    • 2004
  • Continuous depth data are often required in applications of both onboard systems and maritime simulation. But data available are usually discrete and irregularly distributed. Based on the neuron network technique, methods of interpolation to the charted depth are suggested in this paper. Two algorithms based on Levenberg-Marquardt back-propaganda and radial-basis function networks are investigated respectively. A dynamic neuron network system is developed which satisfies both real time and mass processing applications. Using hyperbolic paraboloid and typical chart area, effectiveness of the algorithms is tested and error analysis presented. Special process in practical applications such as partition of lager areas, normalization and selection of depth contour data are also illustrated.

Charted Depth Interpolation: Neuron Network Approaches

  • Chaojian, Shi
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2004.08a
    • /
    • pp.37-44
    • /
    • 2004
  • Continuous depth data are often required in applications of both onboard systems and maritime simulation. But data available are usually discrete and irregularly distributed. Based on the neuron network technique, methods of interpolation to the charted depth are suggested in this paper. Two algorithms based on Levenberg-Marquardt back-propaganda and radial-basis function networks are investigated respectively. A dynamic neuron network system is developed which satisfies both real time and mass processing applications. Using hyperbolic paraboloid and typical chart area, effectiveness of the algorithms is tested and error analysis presented. Special process in practical applications such as partition of lager areas, normalization and selection of depth contour data are also illustrated.

  • PDF