• Journal of the Korean Statistical Society
• /
• 제26권1호
• /
• pp.23-30
• /
• 1997

We show that the Maximum Penalized Likelihood Estimate uniquely exits in a Sobolve spece which consists of bivariate density functions. The Maximum Penalized Likehood Estimate is represented as the square of the sum of the solutions of the Modified Helmholtz's equation on the compact subset of R$^{2}$.

• Journal of the Korean Data and Information Science Society
• /
• 제20권5호
• /
• pp.895-903
• /
• 2009

The penalized partial likelihood based on restricted maximum likelihood method has been widely used for the inference of frailty models. However, the standard-error estimate for frailty parameter estimator can be downwardly biased. In this paper we show that such underestimation can be corrected by using hierarchical likelihood. In particular, the hierarchical likelihood gives a statistically efficient procedure for various random-effect models including frailty models. The proposed method is illustrated via a numerical example and simulation study. The simulation results demonstrate that the corrected standard-error estimate largely improves such bias.

• Communications for Statistical Applications and Methods
• /
• 제25권4호
• /
• pp.355-371
• /
• 2018

The two parameter negative exponential distribution has many practical applications in queuing theory such as the service times of agents in system, the time it takes before your next telephone call, the time until a radioactive practical decays, the distance between mutations on a DNA strand, and the extreme values of annual snowfall or rainfall; consequently, has many applications in reliability systems. This paper considers an estimation problem of stress-strength model with two parameter negative parameter exponential distribution. We introduce a maximum penalized likelihood method, Bayes estimator using Lindley approximation to estimate stress-strength model and compare the proposed estimators with regular maximum likelihood estimator for complete data. We also introduce a maximum penalized likelihood method, Bayes estimator using a Markov chain Mote Carlo technique for incomplete data. A Monte Carlo simulation study is performed to compare stress-strength model estimates. Real data is used as a practical application of the proposed model.

• Communications for Statistical Applications and Methods
• /
• 제29권6호
• /
• pp.641-653
• /
• 2022

Penalized least squares methods are important tools to simultaneously select variables and estimate parameters in linear regression. The penalized maximum likelihood can also be used for the same purpose assuming that the error distribution falls in a certain parametric family of distributions. However, the use of a certain parametric family can suffer a misspecification problem which undermines the estimation accuracy. To give sufficient flexibility to the error distribution, we propose to use the symmetric log-concave error distribution with LASSO penalty. A feasible algorithm to estimate both nonparametric and parametric components in the proposed model is provided. Some numerical studies are also presented showing that the proposed method produces more efficient estimators than some existing methods with similar variable selection performance.

• 한국전산구조공학회논문집
• /
• 제36권6호
• /
• pp.391-398
• /
• 2023

본 논문에서는 기저 스크리닝 기반 크리깅 모델(BSKM: Basis Screening based Kriging Model) 생성의 정확도를 높이기 위해 페널티를 적용한 최대 우도 평가 방법(PMLE : Penalized Maximum Likelihood Estimation)에 대해서 소개한다. BSKM에서 사용하는 기저함수의 최대 차수와 종류는 그 중요도에 따라서 결정하게 되며, 이때 중요도의 지표는 기저함수에 대한 교차 검증 오차(CVE : Cross Validation Error)로 택한다. 크리깅 모델(KM : Kriging Model) 구성시 최적의 기저함수 조합은 우선 최대 기저함수 차수를 선택하고 개별 기저함수의 중요도를 평가를 하게 된다. 최적 기저함수 조합은 크리깅 모델의 CVE가 최소가 될 때까지 개별 기저함수의 중요도가 높은 순으로 기저함수를 하나씩 추가하며 찾는다. 이 과정에서 KM은 반복적으로 생성해야 하며, 동시에 데이터 사이의 상관관계를 나타내는 하이퍼 매개변수(Hyper-parameters)도 최대 우도 평가방법을 통해 계산하여야 한다. 하이퍼 매개변수의 값에 따라 선택되는 최적의 기저함수 조합이 달라지기 때문에 KM의 정확도에 막대한 영향을 미치게 된다. 정확한 하이퍼 매개변수를 계산하기 위해서 PMLE 방법을 적용하였으며, Branin-Hoo 함수 문제에 적용하여 BSKM 의 정확성이 개선될 수 있음을 확인하였다.

• Communications for Statistical Applications and Methods
• /
• 제16권4호
• /
• pp.573-578
• /
• 2009

본 논문에서는 과대적합모형을 가정하여 성분의 수에 대한 벌점항목을 추가한 Ahn (2001)의 벌점가능도에 의한 추정치가 일치성을 달성하는 것에 대한 증명을 제시하였다. Wald (1949)의 조건을 만족하는 지를 보이기 위하여 과대적합모형를 활용하였다. 또한 모수가 한계점으로 수렴할 경우 우도값이 무한대로 간다는 문제점을 해결하였다.

• Communications for Statistical Applications and Methods
• /
• 제27권3호
• /
• pp.349-363
• /
• 2020

Penalized spline is a suitable nonparametric approach in estimating mean model in small area. However, application of the approach in informative sampling in a published article is uncommon. We propose a semiparametric mixed-model using penalized spline under informative sampling to estimate mean of small area. The response variable is explained in terms of mean model, informative sample effect, area random effect and unit error. We approach the mean model by penalized spline and utilize a penalized spline function of the inclusion probability to account for the informative sample effect. We determine the best and unbiased estimators for coefficient model and derive the restricted maximum likelihood estimators for the variance components. A simulation study shows a decrease in the average absolute bias produced by the proposed model. A decrease in the root mean square error also occurred except in some quadratic cases. The use of linear and quadratic penalized spline to approach the function of the inclusion probability provides no significant difference distribution of root mean square error, except for few smaller samples.

• Communications for Statistical Applications and Methods
• /
• 제24권5호
• /
• pp.493-505
• /
• 2017

Maximum likelihood estimation (MLE) of the generalized extreme value distribution (GEVD) is known to sometimes over-estimate the positive value of the shape parameter for the small sample size. The maximum penalized likelihood estimation (MPLE) with Beta penalty function was proposed by some researchers to overcome this problem. But the determination of the hyperparameters (HP) in Beta penalty function is still an issue. This paper presents some data adaptive methods to select the HP of Beta penalty function in the MPLE framework. The idea is to let the data tell us what HP to use. For given data, the optimal HP is obtained from the minimum distance between the MLE and MPLE. A bootstrap-based method is also proposed. These methods are compared with existing approaches. The performance evaluation experiments for GEVD by Monte Carlo simulation show that the proposed methods work well for bias and mean squared error. The methods are applied to Blackstone river data and Korean heavy rainfall data to show better performance over MLE, the method of L-moments estimator, and existing MPLEs.

• 응용통계연구
• /
• 제28권2호
• /
• pp.281-288
• /
• 2015

본 연구에서는 혼합모형의 추론을 위한 벌점-최대우도추정량의 빠른 계산절차를 제안하다. 제안된 절차는 벌점-최대우도추정량을 위한 추정방정식에서 헷시안 행렬을 화살촉형태를 지닌 희소행렬을 통하여 근사 시킴으로써 계산속도의 향상을 가져왔다. 두 가지 가상실험을 통하여 제안된 근사식을 사용함으로써 얻게되는 계산시간의 감소와 동시에 이를 위하여 지불하여야 하는 근사오차에 대하여 살펴보았다.

• 한국멀티미디어학회논문지
• /
• 제8권12호
• /
• pp.1565-1571
• /
• 2005

Images reconstructed with Maximum-Likelihood Expectation-Maximization (MLEM) algorithm have been observed to have checkerboard effects and have noise artifacts near edges as iterations proceed. To compensate this ill-posed nature, numerous penalized maximum-likelihood methods have been proposed. We suggest a simple algorithm of applying edge detecting process to the MLEM and Bayesian Expectation-Maximization (BEM) to reduce the noise artifacts near edges and remove checkerboard effects. We have shown by simulation that this algorithm removes checkerboard effects and improves the clarity of the reconstructed image and has good properties based on root mean square error (RMS).