• Title/Summary/Keyword: Laplace prior

Search Result 18, Processing Time 0.019 seconds

Comparison of Laplace and Double Pareto Penalty: LASSO and Elastic Net (라플라스와 이중 파레토 벌점의 비교: LASSO와 Elastic Net)

  • Kyung, Minjung
    • The Korean Journal of Applied Statistics
    • /
    • v.27 no.6
    • /
    • pp.975-989
    • /
    • 2014
  • Lasso (Tibshirani, 1996) and Elastic Net (Zou and Hastie, 2005) have been widely used in various fields for simultaneous variable selection and coefficient estimation. Bayesian methods using a conditional Laplace and a double Pareto prior specification have been discussed in the form of hierarchical specification. Full conditional posterior distributions with each priors have been derived. We compare the performance of Bayesian lassos with Laplace prior and the performance with double Pareto prior using simulations. We also apply the proposed Bayesian hierarchical models to real data sets to predict the collapse of governments in Asia.

Bayesian analysis of random partition models with Laplace distribution

  • Kyung, Minjung
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.5
    • /
    • pp.457-480
    • /
    • 2017
  • We develop a random partition procedure based on a Dirichlet process prior with Laplace distribution. Gibbs sampling of a Laplace mixture of linear mixed regressions with a Dirichlet process is implemented as a random partition model when the number of clusters is unknown. Our approach provides simultaneous partitioning and parameter estimation with the computation of classification probabilities, unlike its counterparts. A full Gibbs-sampling algorithm is developed for an efficient Markov chain Monte Carlo posterior computation. The proposed method is illustrated with simulated data and one real data of the energy efficiency of Tsanas and Xifara (Energy and Buildings, 49, 560-567, 2012).

Bayesian Mode1 Selection and Diagnostics for Nonlinear Regression Model (베이지안 비선형회귀모형의 선택과 진단)

  • 나종화;김정숙
    • The Korean Journal of Applied Statistics
    • /
    • v.15 no.1
    • /
    • pp.139-151
    • /
    • 2002
  • This study is concerned with model selection and diagnostics for nonlinear regression model through Bayes factor. In this paper, we use informative prior and simulate observations from the posterior distribution via Markov chain Monte Carlo. We propose the Laplace approximation method and apply the Laplace-Metropolis estimator to solve the computational difficulty of Bayes factor.

Bayesian Typhoon Track Prediction Using Wind Vector Data

  • Han, Minkyu;Lee, Jaeyong
    • Communications for Statistical Applications and Methods
    • /
    • v.22 no.3
    • /
    • pp.241-253
    • /
    • 2015
  • In this paper we predict the track of typhoons using a Bayesian principal component regression model based on wind field data. Data is obtained at each time point and we applied the Bayesian principal component regression model to conduct the track prediction based on the time point. Based on regression model, we applied to variable selection prior and two kinds of prior distribution; normal and Laplace distribution. We show prediction results based on Bayesian Model Averaging (BMA) estimator and Median Probability Model (MPM) estimator. We analysis 8 typhoons in 2006 using data obtained from previous 6 years (2000-2005). We compare our prediction results with a moving-nest typhoon model (MTM) proposed by the Korea Meteorological Administration. We posit that is possible to predict the track of a typhoon accurately using only a statistical model and without a dynamical model.

New Inference for a Multiclass Gaussian Process Classification Model using a Variational Bayesian EM Algorithm and Laplace Approximation

  • Cho, Wanhyun;Kim, Sangkyoon;Park, Soonyoung
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.4 no.4
    • /
    • pp.202-208
    • /
    • 2015
  • In this study, we propose a new inference algorithm for a multiclass Gaussian process classification model using a variational EM framework and the Laplace approximation (LA) technique. This is performed in two steps, called expectation and maximization. First, in the expectation step (E-step), using Bayes' theorem and the LA technique, we derive the approximate posterior distribution of the latent function, indicating the possibility that each observation belongs to a certain class in the Gaussian process classification model. In the maximization step, we compute the maximum likelihood estimators for hyper-parameters of a covariance matrix necessary to define the prior distribution of the latent function by using the posterior distribution derived in the E-step. These steps iteratively repeat until a convergence condition is satisfied. Moreover, we conducted the experiments by using synthetic data and Iris data in order to verify the performance of the proposed algorithm. Experimental results reveal that the proposed algorithm shows good performance on these datasets.

A Study on the Posterior Density under the Bayes-empirical Bayes Models

  • Sohn, Joong-K.Sohn;Kim, Heon-Joo-Kim
    • Communications for Statistical Applications and Methods
    • /
    • v.3 no.3
    • /
    • pp.215-223
    • /
    • 1996
  • By using Tukey's generalized lambda distribution, appoximate posterior density is derived under the Bayes-empirical Bayes model. The sensitivity of posterior distribution to the hyperprior distribution is examined by using Tukey's generalized lambda distriburion which approximate many well-knmown distributions. Based upon Monte Varlo simulation studies it can be said that posterior distribution is sensitive to the cariance of the prior distribution and to the symmetry of the hyperprior distribution. Also posterior distribution is approximately obtained by using the following methods : Lindley method, Laplace method and Gibbs sampler method.

  • PDF

The Comparative Study based on Gompertz Software Reliability Model of Shape Parameter (곰페르츠형 형상모수에 근거한 소프트웨어 신뢰성모형에 대한 비교연구)

  • Shin, Hyun Cheul;Kim, Hee Cheul
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.10 no.2
    • /
    • pp.29-36
    • /
    • 2014
  • Finite failure NHPP software reliability models presented in the literature exhibit either constant, monotonic increasing or monotonic decreasing failure occurrence rates per fault. In this paper, proposes the Gompertz distribution reliability model, which made out efficiency application for software reliability. Algorithm to estimate the parameters used to maximum likelihood estimator and bisection method, model selection based on mean square error (MSE) and coefficient of determination$(R^2)$, for the sake of efficient model, was employed. Analysis of failure using real data set for the sake of proposing fixed shape parameter of the Gompertz distribution was employed. This analysis of failure data compared with the Gompertz distribution model of shape parameter. In order to insurance for the reliability of data, Laplace trend test was employed. In this study, the proposed Gompertz model is more efficient in terms of reliability in this area. Thus, Gompertz model can also be used as an alternative model. From this paper, software developers have to consider the growth model by prior knowledge of the software to identify failure modes which can was helped.

A Comparative Study of Software finite Fault NHPP Model Considering Inverse Rayleigh and Rayleigh Distribution Property (역-레일리와 레일리 분포 특성을 이용한 유한고장 NHPP모형에 근거한 소프트웨어 신뢰성장 모형에 관한 비교연구)

  • Shin, Hyun Cheul;Kim, Hee Cheul
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.10 no.3
    • /
    • pp.1-9
    • /
    • 2014
  • The inverse Rayleigh model distribution and Rayleigh distribution model were widely used in the field of reliability station. In this paper applied using the finite failure NHPP models in order to growth model. In other words, a large change in the course of the software is modified, and the occurrence of defects is almost inevitable reality. Finite failure NHPP software reliability models can have, in the literature, exhibit either constant, monotonic increasing or monotonic decreasing failure occurrence rates per fault. In this paper, proposes the inverse Rayleigh and Rayleigh software reliability growth model, which made out efficiency application for software reliability. Algorithm to estimate the parameters used to maximum likelihood estimator and bisection method, model selection based on mean square error (MSE) and coefficient of determination($R^2$), for the sake of efficient model, were employed. In order to insurance for the reliability of data, Laplace trend test was employed. In many aspects, Rayleigh distribution model is more efficient than the reverse-Rayleigh distribution model was proved. From this paper, software developers have to consider the growth model by prior knowledge of the software to identify failure modes which can helped.

AWGN Removal using Laplace Distribution and Weighted Mask (라플라스 분포와 가중치 마스크를 이용한 AWGN 제거)

  • Park, Hwa-Jung;Kim, Nam-Ho
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.12
    • /
    • pp.1846-1852
    • /
    • 2021
  • In modern society, various digital devices are being distributed in a wide range of fields due to the fourth industrial revolution and the development of IoT technology. However, noise is generated in the process of acquiring or transmitting an image, and not only damages the information, but also affects the system, causing errors and incorrect operation. AWGN is a representative noise among image noise. As a method for removing noise, prior research has been conducted, and among them, AF, A-TMF, and MF are the representative methods. Existing filters have a disadvantage that smoothing occurs in areas with high frequency components because it is difficult to consider the characteristics of images. Therefore, the proposed algorithm calculates the standard deviation distribution to effectively eliminate noise even in the high frequency domain, and then calculates the final output by applying the probability density function weight of the Laplace distribution using the curve fitting method.

The Bayesian Inference for Software Reliability Models Based on NHPP (NHPP에 기초한 소프트웨어 신뢰도 모형에 대한 베이지안 추론에 관한 연구)

  • Lee, Sang-Sik;Kim, Hui-Cheol;Song, Yeong-Jae
    • The KIPS Transactions:PartD
    • /
    • v.9D no.3
    • /
    • pp.389-398
    • /
    • 2002
  • Software reliability growth models are used in testing stages of software development to model the error content and time intervals between software failures. This paper presents a stochastic model for the software failure phenomenon based on a nonhomogeneous Poisson process(NHPP) and performs Bayesian inference using prior information. The failure process is analyzed to develop a suitable mean value function for the NHPP ; expressions are given for several performance measure. Actual software failure data are compared with several model on the constant reflecting the quality of testing. The performance measures and parametric inferences of the suggested models using Rayleigh distribution and Laplace distribution are discussed. The results of the suggested models are applied to real software failure data and compared with Goel model. Tools of parameter point inference and 95% credible intereval was used method of Gibbs sampling. In this paper, model selection using the sum of the squared errors was employed. The numerical example by NTDS data was illustrated.