• Title/Summary/Keyword: variance component

Search Result 502, Processing Time 0.03 seconds

A STOCHASTIC VARIANCE REDUCTION METHOD FOR PCA BY AN EXACT PENALTY APPROACH

  • Jung, Yoon Mo;Lee, Jae Hwa;Yun, Sangwoon
    • Bulletin of the Korean Mathematical Society
    • /
    • v.55 no.4
    • /
    • pp.1303-1315
    • /
    • 2018
  • For principal component analysis (PCA) to efficiently analyze large scale matrices, it is crucial to find a few singular vectors in cheaper computational cost and under lower memory requirement. To compute those in a fast and robust way, we propose a new stochastic method. Especially, we adopt the stochastic variance reduced gradient (SVRG) method [11] to avoid asymptotically slow convergence in stochastic gradient descent methods. For that purpose, we reformulate the PCA problem as a unconstrained optimization problem using a quadratic penalty. In general, increasing the penalty parameter to infinity is needed for the equivalence of the two problems. However, in this case, exact penalization is guaranteed by applying the analysis in [24]. We establish the convergence rate of the proposed method to a stationary point and numerical experiments illustrate the validity and efficiency of the proposed method.

Two Scale Fusion Method of Infrared and Visible Images Using Saliency and Variance (현저성과 분산을 이용한 적외선과 가시영상의 2단계 스케일 융합방법)

  • Kim, Young Choon;Ahn, Sang Ho
    • Journal of Korea Multimedia Society
    • /
    • v.19 no.12
    • /
    • pp.1951-1959
    • /
    • 2016
  • In this paper, we propose a two-scale fusion method for infrared and visible images using saliency and variance. The images are separated into two scales respectively: a base layer of low frequency component and a detailed layer of high frequency component. Then, these are synthesized using weight. The saliencies and the variances of the images are used as the fusion weights for the two-scale images. The proposed method is tested on several image pairs, and its performance is evaluated quantitatively by using objective fusion metrics.

A Note on Disturbance Variance Estimator in Panel Data with Equicorrelated Error Components

  • Seuck Heun Song
    • Communications for Statistical Applications and Methods
    • /
    • v.2 no.2
    • /
    • pp.129-134
    • /
    • 1995
  • The ordinary least square estimator of the disturbance variance in the pooled cross-sectional and time series regression model is shown to be asymptotically unbiased without any restrictions on the regressor matrix when the disturbances follow an equicorrelated error component models.

  • PDF

Data Visualization using Linear and Non-linear Dimensionality Reduction Methods

  • Kim, Junsuk;Youn, Joosang
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.12
    • /
    • pp.21-26
    • /
    • 2018
  • As the large amount of data can be efficiently stored, the methods extracting meaningful features from big data has become important. Especially, the techniques of converting high- to low-dimensional data are crucial for the 'Data visualization'. In this study, principal component analysis (PCA; linear dimensionality reduction technique) and Isomap (non-linear dimensionality reduction technique) are introduced and applied to neural big data obtained by the functional magnetic resonance imaging (fMRI). First, we investigate how much the physical properties of stimuli are maintained after the dimensionality reduction processes. We moreover compared the amount of residual variance to quantitatively compare the amount of information that was not explained. As result, the dimensionality reduction using Isomap contains more information than the principal component analysis. Our results demonstrate that it is necessary to consider not only linear but also nonlinear characteristics in the big data analysis.

The Distributions of Variance Components in Two Stage Regression Model

  • Park, Dong-Joon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.7 no.1
    • /
    • pp.87-92
    • /
    • 1996
  • A regression model with nested erroe structure is considered. The regression model includes two error terms that are independent and normally distributed with zero means and constant variances. This error structure of the model gives correlated response variables. The distributions of variance components in the regression model with nested error structure are dervied by using theorems for quadratic forms.

  • PDF

Noise reduction method using a variance map of the phase differences in digital holographic microscopy

  • Hyun-Woo Kim;Myungjin Cho;Min-Chul Lee
    • ETRI Journal
    • /
    • v.45 no.1
    • /
    • pp.131-137
    • /
    • 2023
  • The phase reconstruction process in digital holographic microscopy involves a trade-off between the phase error and the high-spatial-frequency components. In this reconstruction process, if the narrow region of the sideband is windowed in the Fourier domain, the phase error from the DC component will be reduced, but the high-spatial-frequency components will be lost. However, if the wide region is windowed, the 3D profile will include the high-spatial-frequency components, but the phase error will increase. To solve this trade-off, we propose the high-variance pixel averaging method, which uses the variance map of the reconstructed depth profiles of the windowed sidebands of different sizes in the Fourier domain to classify the phase error and the high-spatial-frequency components. Our proposed method calculates the average of the high-variance pixels because they include the noise from the DC component. In addition, for the nonaveraged pixels, the reconstructed phase data created by the spatial frequency components of the widest window are used to include the high-spatialfrequency components. We explain the mathematical algorithm of our proposed method and compare it with conventional methods to verify its advantages.

Design and efficiency of the variance component model control chart (분산성분모형 관리도의 설계와 효율)

  • Cho, Chan Yang;Park, Changsoon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.28 no.5
    • /
    • pp.981-999
    • /
    • 2017
  • In the standard control chart assuming a simple random model, we estimate the process variance without considering the between-sample variance. If the between-sample exists in the process, the process variance is under-estimated. When the process variance is under-estimated, the narrower control limits result in the excessive false alarm rate although the sensitivity of the control chart is improved. In this paper, using the variance component model to incorporate the between-sample variance, we set the control limits using both the within- and between-sample variances, and evaluate the efficiency of the control chart in terms of the average run length (ARL). Considering the most widely used control chart types such as ${\bar{X}}$, EWMA and CUSUM control charts, we compared the differences between two cases, Case I and Case II, where the between-sample variance is ignored and considered, respectively. We also considered the two cases when the process parameters are given and estimated. The results showed that the false alarm rate of Case I increased sharply as the between-sample variance increases, while that of Case II remains the same regardless of the size of the between-sample variance, as expected.

Sensory Profiling of Commercial Korean Distilled Soju (시판 증류식 소주의 관능특성 분석)

  • Lee, Seung-Joo;Park, Cheon-Soo;Kim, Ho-Kyung
    • Korean Journal of Food Science and Technology
    • /
    • v.44 no.5
    • /
    • pp.648-652
    • /
    • 2012
  • The sensory characteristics of nine commercially distilled soju samples were determined by sensory descriptive analysis. Eight aroma attributes, as well as four flavor/taste attributes, and six mouth-feel related attributes were evaluated by 9 judges. The descriptive data set was initially analyzed for a significant overall product effect by employing a three-way mixed model analysis of variance (judges, samples, and replications) as well as two-way interactions, with judges treated as random. In addition, correlations between mean attribute ratings were calculated, and a principal component analysis (PCA) of the mean attribute ratings employing the covariance matrix was conducted. Based on the PCA, distilled soju samples were primarily separated along the first principal component, which accounted for 66% of the total variance between the samples, with high intensities of 'alcohol taste' and 'alcohol aroma' versus 'yeast aroma'. The second principal component accounted for 14% of the total variance. Soju containing high alcohol showed stronger intensities of 'bitterness', 'alcohol taste', 'alcohol aroma', as well as all mouth-feel attributes.

Generalizability of Polygraph Test Procedures using Backster ZCT: Changes in reliability as a function of the number of relevant questions, the number of repeated tests, and the number of raters (Backster ZCT를 사용한 폴리그라프 검사절차의 일반화가능도: 관련 질문의 개수, 반복측정 횟수, 채점자의 수에 따른 신뢰도의 변화)

  • Eom, Jin-Sup;Han, Yu-Hwa;Ji, Hyung-Ki;Park, Kwang-Bai
    • Science of Emotion and Sensibility
    • /
    • v.11 no.4
    • /
    • pp.553-564
    • /
    • 2008
  • Generalizability theory was employed to examine how the reliability of polygraph test is affected by the number of relevant questions, the number of repeated tests (the number of of charts), and the number of raters(scorers). The data consisted of the results of the polygraph tests administered to 31 crime suspects. The sample was drawn from the real polygraph tests based on Backster ZCT and archived by the Prosecutor's Office of the Republic of Korea. The numerical scores assigned by thirteen raters to the test charts were analyzed to determine the generalizability of the scores. The largest variance component was accounted for by the examinee factor(43.97%) and the residual variance component was 16.84% of the total variance. The variance component due to the interaction between the examinee and the chart factors was 12.17% and the variance component due to the three way interaction of the examinee, the repeated test, and the relevant question factors was 10.31%. The generalizability coefficient for the current measurement procedure as practiced by the Korean Prosecutor's Office was 0.74 which suggests that the current procedure is acceptable. However, measurement procedures with the combination of more than two relevant questions, more than three repeated tests, and more than two raters were generally found to yield generalizability coefficients larger than 0.80. Therefore, such procedures need to be considered seriously in order to significantly improve the reliability of polygraph test.

  • PDF