• Title/Summary/Keyword: Akaike Information Criterion

Search Result 117, Processing Time 0.023 seconds

A CONSISTENT AND BIAS CORRECTED EXTENSION OF AKAIKE'S INFORMATION CRITERION(AIC) : AICbc(k)

  • Kwon, Soon H.;Ueno, M.;Sugeno, M.
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.2 no.1
    • /
    • pp.41-60
    • /
    • 1998
  • This paper derives a consistent and bias corrected extension of Akaike's Information Criterion (AIC), $AIC_{bc}$, based on Kullback-Leibler information. This criterion has terms that penalize the overparametrization more strongly for small and large samples than that of AIC. The overfitting problem of the asymptotically efficient model selection criteria for small and large samples will be overcome. The $AIC_{bc}$ also provides a consistent model order selection. Thus, it is widely applicable to data with small and/or large sample sizes, and to cases where the number of free parameters is a relatively large fraction of the sample size. Relationships with other model selection criteria such as $AIC_c$ of Hurvich, CAICF of Bozdogan and etc. are discussed. Empirical performances of the $AIC_{bc}$ are studied and discussed in better model order choices of a linear regression model using a Monte Carlo experiment.

  • PDF

Study on the Reliability Evaluation Method of Components when Operating in Different Environments (이종 환경에서 운용되는 부품의 신뢰도 평가 방법 연구)

  • Hwang, Jeong Taek;Kim, Jong Hak;Jeon, Ju Yeon;Han, Jae Hyeon
    • Journal of the Korean Society of Safety
    • /
    • v.32 no.5
    • /
    • pp.115-121
    • /
    • 2017
  • This paper is to introduce the main modeling assumptions and data structures associated with right-censored data to describe the successful methodological ideas for analyzing such a field-failure-data when components operating in different environments. The Kaplan - Meier method is the most popular method used for survival analysis. Together with the log-rank test, it may provide us with an opportunity to estimate survival probabilities and to compare survival between groups. An important advantage of the Kaplan - Meier curve is that the method can take into account some types of censored data, particularly right-censoring. The above non-parametric method was used to verify the equality of parts life used in different environments. After that, we performed the life distribution analysis using the parametric method. We simulated data from three distributions: exponential, normal, and Weibull. This allowed us to compare the results of the estimates to the known true values and to quantify the reliability indices. Here we used the Akaike information criterion to find a suitable life time distribution. If the Akaike information criterion is the smallest, the best model of failure data is presented. In this paper, no-nparametrics and parametrics methods are analyzed using R program which is a popular statistical program.

Repetitive model refinement for structural health monitoring using efficient Akaike information criterion

  • Lin, Jeng-Wen
    • Smart Structures and Systems
    • /
    • v.15 no.5
    • /
    • pp.1329-1344
    • /
    • 2015
  • The stiffness of a structure is one of several structural signals that are useful indicators of the amount of damage that has been done to the structure. To accurately estimate the stiffness, an equation of motion containing a stiffness parameter must first be established by expansion as a linear series model, a Taylor series model, or a power series model. The model is then used in multivariate autoregressive modeling to estimate the structural stiffness and compare it to the theoretical value. Stiffness assessment for modeling purposes typically involves the use of one of three statistical model refinement approaches, one of which is the efficient Akaike information criterion (AIC) proposed in this paper. If a newly added component of the model results in a decrease in the AIC value, compared to the value obtained with the previously added component(s), it is statistically justifiable to retain this new component; otherwise, it should be removed. This model refinement process is repeated until all of the components of the model are shown to be statistically justifiable. In this study, this model refinement approach was compared with the two other commonly used refinement approaches: principal component analysis (PCA) and principal component regression (PCR) combined with the AIC. The results indicate that the proposed AIC approach produces more accurate structural stiffness estimates than the other two approaches.

Generalized Linear Model with Time Series Data (비정규 시계열 자료의 회귀모형 연구)

  • 최윤하;이성임;이상열
    • The Korean Journal of Applied Statistics
    • /
    • v.16 no.2
    • /
    • pp.365-376
    • /
    • 2003
  • In this paper we reviewed a variety of non-Gaussian time series models, and studied the model selection criteria such as AIC and BIC to select proper models. We also considered the likelihood ratio test and applied it to analysis of Polio data set.

On Information Criteria in Linear Regression Model

  • Park, Man-Sik
    • The Korean Journal of Applied Statistics
    • /
    • v.22 no.1
    • /
    • pp.197-204
    • /
    • 2009
  • In the model selection problem, the main objective is to choose the true model from a manageable set of candidate models. An information criterion gauges the validity of a statistical model and judges the balance between goodness-of-fit and parsimony; "how well observed values ran approximate to the true values" and "how much information can be explained by the lower dimensional model" In this study, we introduce some information criteria modified from the Akaike Information Criterion (AIC) and the Bayesian Information Criterion(BIC). The information criteria considered in this study are compared via simulation studies and real application.

Robust varying coefficient model using L1 regularization

  • Hwang, Changha;Bae, Jongsik;Shim, Jooyong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.27 no.4
    • /
    • pp.1059-1066
    • /
    • 2016
  • In this paper we propose a robust version of varying coefficient models, which is based on the regularized regression with L1 regularization. We use the iteratively reweighted least squares procedure to solve L1 regularized objective function of varying coefficient model in locally weighted regression form. It provides the efficient computation of coefficient function estimates and the variable selection for given value of smoothing variable. We present the generalized cross validation function and Akaike information type criterion for the model selection. Applications of the proposed model are illustrated through the artificial examples and the real example of predicting the effect of the input variables and the smoothing variable on the output.

Forecasting Internet Traffic by Using Seasonal GARCH Models

  • Kim, Sahm
    • Journal of Communications and Networks
    • /
    • v.13 no.6
    • /
    • pp.621-624
    • /
    • 2011
  • With the rapid growth of internet traffic, accurate and reliable prediction of internet traffic has been a key issue in network management and planning. This paper proposes an autoregressive-generalized autoregressive conditional heteroscedasticity (AR-GARCH) error model for forecasting internet traffic and evaluates its performance by comparing it with seasonal autoregressive integrated moving average (ARIMA) models in terms of root mean square error (RMSE) criterion. The results indicated that the seasonal AR-GARCH models outperformed the seasonal ARIMA models in terms of forecasting accuracy with respect to the RMSE criterion.

B-spline polynomials models for analyzing growth patterns of Guzerat young bulls in field performance tests

  • Ricardo Costa Sousa;Fernando dos Santos Magaco;Daiane Cristina Becker Scalez;Jose Elivalto Guimaraes Campelo;Clelia Soares de Assis;Idalmo Garcia Pereira
    • Animal Bioscience
    • /
    • v.37 no.5
    • /
    • pp.817-825
    • /
    • 2024
  • Objective: The aim of this study was to identify suitable polynomial regression for modeling the average growth trajectory and to estimate the relative development of the rib eye area, scrotal circumference, and morphometric measurements of Guzerat young bulls. Methods: A total of 45 recently weaned males, aged 325.8±28.0 days and weighing 219.9±38.05 kg, were evaluated. The animals were kept on Brachiaria brizantha pastures, received multiple supplementations, and were managed under uniform conditions for 294 days, with evaluations conducted every 56 days. The average growth trajectory was adjusted using ordinary polynomials, Legendre polynomials, and quadratic B-splines. The coefficient of determination, mean absolute deviation, mean square error, the value of the restricted likelihood function, Akaike information criteria, and consistent Akaike information criteria were applied to assess the quality of the fits. For the study of allometric growth, the power model was applied. Results: Ordinary polynomial and Legendre polynomial models of the fifth order provided the best fits. B-splines yielded the best fits in comparing models with the same number of parameters. Based on the restricted likelihood function, Akaike's information criterion, and consistent Akaike's information criterion, the B-splines model with six intervals described the growth trajectory of evaluated animals more smoothly and consistently. In the study of allometric growth, the evaluated traits exhibited negative heterogeneity (b<1) relative to the animals' weight (p<0.01), indicating the precocity of Guzerat cattle for weight gain on pasture. Conclusion: Complementary studies of growth trajectory and allometry can help identify when an animal's weight changes and thus assist in decision-making regarding management practices, nutritional requirements, and genetic selection strategies to optimize growth and animal performance.

Short-Term Load Forecasting Using Multiple Time-Series Model Including Dummy Variables (더미변수(Dummy Variable)를 포함하는 다변수 시계열 모델을 이용한 단기부하예측)

  • 이경훈;김진오
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.52 no.8
    • /
    • pp.450-456
    • /
    • 2003
  • This paper proposes a multiple time-series model with dummy variables for one-hour ahead load forecasting. We used 11 dummy variables that were classified by day characteristics such as day of the week, holiday, and special holiday. Also, model specification and selection of input variables including dummy variables were made by test statistics such as AIC(Akaike Information Criterion) and t-test statistics of each coefficient. OLS (Ordinary Least Squares) method was used for estimation and forecasting. We found out that model specifications for each hour are not identical usually at 30% of optimal significance level, and dummy variables reduce the forecasting error if they are classified properly. The proposed model has much more accurate estimates in forecasting with less MAPE (Mean Absolute Percentage Error).

Discrimination of rival isotherm equations for aqueous contaminant removal systems

  • Chu, Khim Hoong
    • Advances in environmental research
    • /
    • v.3 no.2
    • /
    • pp.131-149
    • /
    • 2014
  • Two different model selection indices, the Akaike information criterion (AIC) and the coefficient of determination ($R^2$), are used to discriminate competing isotherm equations for aqueous pollutant removal systems. The former takes into account model accuracy and complexity while the latter considers model accuracy only. The five types of isotherm shape in the Brunauer-Deming-Deming-Teller (BDDT) classification are considered. Sorption equilibrium data taken from the literature were correlated using isotherm equations with fitting parameters ranging from two to five. For the isotherm shapes of types I (favorable) and III (unfavorable), the AIC favors two-parameter equations which can easily track these simple isotherm shapes with high accuracy. The $R^2$ indicator by contrast recommends isotherm equations with more than two parameters which can provide marginally better fits than two-parameter equations. To correlate the more intricate shapes of types II (multilayer), IV (two-plateau) and V (S-shaped) isotherms, both indices favor isotherm equations with more than two parameters.