• Title/Summary/Keyword: Variance and Mean Squared Error

Search Result 49, Processing Time 0.022 seconds

Admissible Hierarchical Bayes Estimators of a Multivariate Normal Mean Shrinking towards a Regression Surface

  • Cho, Byung-Yup;Choi, Kuey-Chung;Chang, In-Hong
    • Communications for Statistical Applications and Methods
    • /
    • v.3 no.2
    • /
    • pp.205-216
    • /
    • 1996
  • Consider the problem of estimating a multivariate normal mean with an unknown covarience matrix under a weighted sum of squared error losses. We first provide hierarchical Bayes estimators which shrink the usual (maximum liklihood, uniformly minimum variance unbiased) estimator towards a regression surface and then prove the admissibility of these estimators using Blyth's (1951) method.

  • PDF

Determining the Relative Weights of Bias and Variance in Dual Response Surface Optimization (쌍대반응표면 최적화에서 편차와 분산의 가중치 결정에 관한 연구)

  • Jeong, In-Jun;Kim, Gwang-Jae;Jang, Su-Yeong;Lin, Dennis K.J.
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2004.05a
    • /
    • pp.294-297
    • /
    • 2004
  • Mean squared error (MSE) is an effective criterion to combine the mean and the standard deviation responses in dual response surface optimization. The bias and variance components of MSE need to be weighted properly in the given problem situation. This paper proposes a systematic method to determine the relative weights of bias and variance in accordance with a decision maker's prior and posterior preference structure.

  • PDF

An Improved Adaptive Weighted Filter for Image Restoration in Gaussian Noise Environment (가우시안 잡음환경에서 영상복원을 위한 개선된 적응 가중치 필터)

  • Yinyu, Gao;Hwang, Yeong-Yeun;Kim, Nam-Ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2012.05a
    • /
    • pp.623-625
    • /
    • 2012
  • The restoration of an image corrupted by Gaussian noise is an important task in image processing. There are many kinds of filters are proposed to remove Gaussian noise such as Gaussian filter, mean filter, weighted filter, etc. However, they perform not good enough for denoising and edge preservation. Hence, in this paper we proposed an adaptive weighted filter which considers spatial distance and the estimated variance of noise. We also compared the proposed method with existing methods through the simulation and used MSE(mean squared error) as the standard of judgement of improvement effect.

  • PDF

Three-Way Balanced Multi-level Semi Rotation Sampling Designs

  • Park, You-Sung;Choi, Jai-Won;Kim, Kee-Whan
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2002.05a
    • /
    • pp.19-24
    • /
    • 2002
  • The two-way balanced one-level rotation design has been discussed (Park, Kim and Choi, 2001), where the two-way balancing is done on interview time in monthly sample and rotation group. We extend it to three-way balanced multi-level design under the most general rotation system. The three-way balancing is accomplished on interview time not only in monthly sample and rotation group but also in recall time. We present the necessary condition and rotation algorithm which guarantee the three-way balancing. We propose multi-level composite estimators (MCE) from this design and derive their variances and mean squared errors (MSE), assuming the correlation from the measurements of the same sample unit and three types of biases in monthly sample.

  • PDF

Performance Analysis of Electrical MMSE Linear Equalizers in Optically Amplified OOK Systems

  • Park, Jang-Woo;Chung, Won-Zoo
    • Journal of the Optical Society of Korea
    • /
    • v.15 no.3
    • /
    • pp.232-236
    • /
    • 2011
  • We analyze the linear equalizers used in optically amplified on-off-keyed (OOK) systems to combat chromatic dispersion (CD) and polarization mode dispersion (PMD), and we derive the mathematical minimum mean squared error (MMSE) performance of these equalizers. Currently, the MMSE linear equalizer for optical OOK systems is obtained by simulations using adaptive approaches such as least mean squared (LMS) or constant modulus algorithm (CMA), but no theoretical studies on the optimal solutions for these equalizers have been performed. We model the optical OOK systems as square-law nonlinear channels and compute the MMSE equalizer coefficients directly from the estimated optical channel, signal power, and optical noise variance. The accuracy of the calculated MMSE equalizer coefficients and MMSE performance has been verified by simulations using adaptive algorithms.

Bayesian Estimation of the Nakagami-m Fading Parameter

  • Son, Young-Sook;Oh, Mi-Ra
    • Communications for Statistical Applications and Methods
    • /
    • v.14 no.2
    • /
    • pp.345-353
    • /
    • 2007
  • A Bayesian estimation of the Nakagami-m fading parameter is developed. Bayesian estimation is performed by Gibbs sampling, including adaptive rejection sampling. A Monte Carlo study shows that the Bayesian estimators proposed outperform any other estimators reported elsewhere in the sense of bias, variance, and root mean squared error.

Efficiency of Aggregate Data in Non-linear Regression

  • Huh, Jib
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.2
    • /
    • pp.327-336
    • /
    • 2001
  • This work concerns estimating a regression function, which is not linear, using aggregate data. In much of the empirical research, data are aggregated for various reasons before statistical analysis. In a traditional parametric approach, a linear estimation of the non-linear function with aggregate data can result in unstable estimators of the parameters. More serious consequence is the bias in the estimation of the non-linear function. The approach we employ is the kernel regression smoothing. We describe the conditions when the aggregate data can be used to estimate the regression function efficiently. Numerical examples will illustrate our findings.

  • PDF

Mean-Variance-Validation Technique for Sequential Kriging Metamodels (순차적 크리깅모델의 평균-분산 정확도 검증기법)

  • Lee, Tae-Hee;Kim, Ho-Sung
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.34 no.5
    • /
    • pp.541-547
    • /
    • 2010
  • The rigorous validation of the accuracy of metamodels is an important topic in research on metamodel techniques. Although a leave-k-out cross-validation technique involves a considerably high computational cost, it cannot be used to measure the fidelity of metamodels. Recently, the mean$_0$ validation technique has been proposed to quantitatively determine the accuracy of metamodels. However, the use of mean$_0$ validation criterion may lead to premature termination of a sampling process even if the kriging model is inaccurate. In this study, we propose a new validation technique based on the mean and variance of the response evaluated when sequential sampling method, such as maximum entropy sampling, is used. The proposed validation technique is more efficient and accurate than the leave-k-out cross-validation technique, because instead of performing numerical integration, the kriging model is explicitly integrated to accurately evaluate the mean and variance of the response evaluated. The error in the proposed validation technique resembles a root mean squared error, thus it can be used to determine a stop criterion for sequential sampling of metamodels.

A Robust Design of Response Surface Methods (반응표면방법론에서의 강건한 실험계획)

  • 임용빈;오만숙
    • The Korean Journal of Applied Statistics
    • /
    • v.15 no.2
    • /
    • pp.395-403
    • /
    • 2002
  • In the third phase of the response surface methods, the first-order model is assumed and the curvature of the response surface is checked with a fractional factorial design augmented by centre runs. We further assume that a true model is a quadratic polynomial. To choose an optimal design, Box and Draper(1959) suggested the use of an average mean squared error (AMSE), an average of MSE of y(x) over the region of interest R. The AMSE can be partitioned into the average prediction variance (APV) and average squared bias (ASB). Since AMSE is a function of design moments, region moments and a standardized vector of parameters, it is not possible to select the design that minimizes AMSE. As a practical alternative, Box and Draper(1959) proposed minimum bias design which minimize ASB and showed that factorial design points are shrunk toward the origin for a minimum bias design. In this paper we propose a robust AMSE design which maximizes the minimum efficiency of the design with respect to a standardized vector of parameters.

On the Support of Minimum Mean-Square Error Scalar Quantizers for a Laplacian Source (라플라스 신호원에 대한 최소평균제곱오차 홑 양자기의 지지역에 관하여)

  • Kim, Seong-Min;Na, Sang-Sin
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.10C
    • /
    • pp.991-999
    • /
    • 2006
  • This paper shows that the support growth of an optimum (minimum mean square-error) scalar quantizer for a Laplacian density is logarithmic with the number of quantization points. Specifically, it is shown that, for a unit-variance Laplacian density, the ratio of the support-determining threshold of an optimum quantizer to $\frac 3{\sqrt{2}}1n\frac N 2$ converges to 1, as the number of quantization points grows. Also derived is a limiting upper bound that says that the optimum support cannot exceed the logarithmic growth by more than a constant. These results confirm the logarithmic growth of the optimum support that has previously been derived heuristically.