• Title/Summary/Keyword: Probabilistic Statistics

Search Result 103, Processing Time 0.025 seconds

A study on the probabilistic record linkage and its application (확률적 자료연계의 이론과 적용에 관한 연구)

  • Choi, Yeonok;Lee, Sangin
    • The Korean Journal of Applied Statistics
    • /
    • v.34 no.5
    • /
    • pp.849-861
    • /
    • 2021
  • This paper aims to introduce the basic concept of probabilistic record linkage and its statistical framework, and describe the specific process and principle of performing it using a real example from Statistics Korea. First, we briefly describe the deterministic record linkage and compare it with probabilistic record linkage. We introduce the Fellegi-Sunter model framework for record linkage and the related paprameters: m-probability, u-probability, matched weight and decision rule. Finally, we show the detailed process of record linkage under Fellegi-Sunter model framework and evaluate the record linkage results, using sample data from the registered-based census and Population and Housing Census survey in Statistics Korea.

Probabilistic determination of initial cable forces of cable-stayed bridges under dead loads

  • Cheng, Jin;Xiao, Ru-Cheng;Jiang, Jian-Jing
    • Structural Engineering and Mechanics
    • /
    • v.17 no.2
    • /
    • pp.267-279
    • /
    • 2004
  • This paper presents an improved Monte Carlo simulation for the probabilistic determination of initial cable forces of cable-stayed bridges under dead loads using the response surfaces method. A response surface (i.e. a quadratic response surface without cross-terms) is used to approximate structural response. The use of the response surface eliminates the need to perform a deterministic analysis in each simulation loop. In addition, use of the response surface requires fewer simulation loops than conventional Monte Carlo simulation. Thereby, the computation time is saved significantly. The statistics (e.g. mean value, standard deviation) of the structural response are calculated through conventional Monte Carlo simulation method. By using Monte Carlo simulation, it is possible to use the existing deterministic finite element code without modifying it. Probabilistic analysis of a truss demonstrates the proposed method' efficiency and accuracy; probabilistic determination of initial cable forces of a cable-stayed bridge under dead loads verifies the method's applicability.

Leave-one-out Bayesian model averaging for probabilistic ensemble forecasting

  • Kim, Yongdai;Kim, Woosung;Ohn, Ilsang;Kim, Young-Oh
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.1
    • /
    • pp.67-80
    • /
    • 2017
  • Over the last few decades, ensemble forecasts based on global climate models have become an important part of climate forecast due to the ability to reduce uncertainty in prediction. Moreover in ensemble forecast, assessing the prediction uncertainty is as important as estimating the optimal weights, and this is achieved through a probabilistic forecast which is based on the predictive distribution of future climate. The Bayesian model averaging has received much attention as a tool of probabilistic forecasting due to its simplicity and superior prediction. In this paper, we propose a new Bayesian model averaging method for probabilistic ensemble forecasting. The proposed method combines a deterministic ensemble forecast based on a multivariate regression approach with Bayesian model averaging. We demonstrate that the proposed method is better in prediction than the standard Bayesian model averaging approach by analyzing monthly average precipitations and temperatures for ten cities in Korea.

Evaluation of Probabilistic Finite Element Method in Comparison with Monte Carlo Simulation

  • 이재영;고홍석
    • Magazine of the Korean Society of Agricultural Engineers
    • /
    • v.32 no.E
    • /
    • pp.59-66
    • /
    • 1990
  • Abstract The formulation of the probabilistic finite element method was briefly reviewed. The method was implemented into a computer program for frame analysis which has the same analogy as finite element analysis. Another program for Monte Carlo simulation of finite element analysis was written. Two sample structures were assumed and analized. The characteristics of the second moment statistics obtained by the probabilistic finite element method was examined through numerical studies. The applicability and limitation of the method were also evaluated in comparison with the data generated by Monte Carlo simulation.

  • PDF

A Penalized Principal Components using Probabilistic PCA

  • Park, Chong-Sun;Wang, Morgan
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2003.05a
    • /
    • pp.151-156
    • /
    • 2003
  • Variable selection algorithm for principal component analysis using penalized likelihood method is proposed. We will adopt a probabilistic principal component idea to utilize likelihood function for the problem and use HARD penalty function to force coefficients of any irrelevant variables for each component to zero. Consistency and sparsity of coefficient estimates will be provided with results of small simulated and illustrative real examples.

  • PDF

Asymptotic Test for Dimensionality in Probabilistic Principal Component Analysis with Missing Values

  • Park, Chong-sun
    • Communications for Statistical Applications and Methods
    • /
    • v.11 no.1
    • /
    • pp.49-58
    • /
    • 2004
  • In this talk we proposed an asymptotic test for dimensionality in the latent variable model for probabilistic principal component analysis with missing values at random. Proposed algorithm is a sequential likelihood ratio test for an appropriate Normal latent variable model for the principal component analysis. Modified EM-algorithm is used to find MLE for the model parameters. Results from simulations and real data sets give us promising evidences that the proposed method is useful in finding necessary number of components in the principal component analysis with missing values at random.

Probabilistic penalized principal component analysis

  • Park, Chongsun;Wang, Morgan C.;Mo, Eun Bi
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.2
    • /
    • pp.143-154
    • /
    • 2017
  • A variable selection method based on probabilistic principal component analysis (PCA) using penalized likelihood method is proposed. The proposed method is a two-step variable reduction method. The first step is based on the probabilistic principal component idea to identify principle components. The penalty function is used to identify important variables in each component. We then build a model on the original data space instead of building on the rotated data space through latent variables (principal components) because the proposed method achieves the goal of dimension reduction through identifying important observed variables. Consequently, the proposed method is of more practical use. The proposed estimators perform as the oracle procedure and are root-n consistent with a proper choice of regularization parameters. The proposed method can be successfully applied to high-dimensional PCA problems with a relatively large portion of irrelevant variables included in the data set. It is straightforward to extend our likelihood method in handling problems with missing observations using EM algorithms. Further, it could be effectively applied in cases where some data vectors exhibit one or more missing values at random.

Evaluation of Spatial Consolidation Settlement by Probabilistic Method (확률론적 방법을 이용한 공간적 압밀침하량 평가)

  • Kim, Dong-Hee;Choi, Young-Min;Ko, Seong-Kwon;Lee, Woo-Jin
    • Proceedings of the Korean Geotechical Society Conference
    • /
    • 2010.03a
    • /
    • pp.475-479
    • /
    • 2010
  • For a rational evaluation of the spatial distribution of consolidation settlement, it is necessary to adopt probabilistic method. In this study, mean and standard deviation of consolidation settlement of whole analysis region are evaluated by using the spatial distribution of consolidation layer which is estimated from kriging and statistics of soil properties. Using these results and probabilistic method, the area need to be raised the ground level for balancing the final design ground level are determined.

  • PDF

Synthetic data generation by probabilistic PCA (주성분 분석을 활용한 재현자료 생성)

  • Min-Jeong Park
    • The Korean Journal of Applied Statistics
    • /
    • v.36 no.4
    • /
    • pp.279-294
    • /
    • 2023
  • It is well known to generate synthetic data sets by the sequential regression multiple imputation (SRMI) method. The R-package synthpop are widely used for generating synthetic data by the SRMI approaches. In this paper, I suggest generating synthetic data based on the probabilistic principal component analysis (PPCA) method. Two simple data sets are used for a simulation study to compare the SRMI and PPCA approaches. Simulation results demonstrate that pairwise coefficients in synthetic data sets by PPCA can be closer to original ones than by SRMI. Furthermore, for the various data types that PPCA applications are well established, such as time series data, the PPCA approach can be extended to generate synthetic data sets.

Multi-target Data Association Filter Based on Order Statistics for Millimeter-wave Automotive Radar (밀리미터파 대역 차량용 레이더를 위한 순서통계 기법을 이용한 다중표적의 데이터 연관 필터)

  • Lee, Moon-Sik;Kim, Yong-Hoon
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.37 no.5
    • /
    • pp.94-104
    • /
    • 2000
  • The accuracy and reliability of the target tracking is very critical issue in the design of automotive collision warning radar A significant problem in multi-target tracking (MTT) is the target-to-measurement data association If an incorrect measurement is associated with a target, the target could diverge the track and be prematurely terminated or cause other targets to also diverge the track. Most methods for target-to-measurement data association tend to coalesce neighboring targets Therefore, many algorithms have been developed to solve this data association problem. In this paper, a new multi-target data association method based on order statistics is described The new approaches. called the order statistics probabilistic data association (OSPDA) and the order statistics joint probabilistic data association (OSJPDA), are formulated using the association probabilities of the probabilistic data association (PDA) and the joint probabilistic data association (JPDA) filters, respectively Using the decision logic. an optimal or near optimal target-to-measurement data association is made A computer simulation of the proposed method in a heavy cluttered condition is given, including a comparison With the nearest-neighbor CNN). the PDA, and the JPDA filters, Simulation results show that the performances of the OSPDA filter and the OSJPDA filter are superior to those of the PDA filter and the JPDA filter in terms of tracking accuracy about 18% and 19%, respectively In addition, the proposed method is implemented using a developed digital signal processing (DSP) board which can be interfaced with the engine control unit (ECU) of car engine and with the d?xer through the controller area network (CAN)

  • PDF