• Title/Summary/Keyword: Least mean squares

Search Result 250, Processing Time 0.021 seconds

Limiting Distributions of Trimmed Least Squares Estimators in Unstable AR(1) Models

  • Lee, Sangyeol
    • Journal of the Korean Statistical Society
    • /
    • v.28 no.2
    • /
    • pp.151-165
    • /
    • 1999
  • This paper considers the trimmed least squares estimator of the autoregression parameter in the unstable AR(1) model: X\ulcorner=ØX\ulcorner+$\varepsilon$\ulcorner, where $\varepsilon$\ulcorner are iid random variables with mean 0 and variance $\sigma$$^2$> 0, and Ø is the real number with │Ø│=1. The trimmed least squares estimator for Ø is defined in analogy of that of Welsh(1987). The limiting distribution of the trimmed least squares estimator is derived under certain regularity conditions.

  • PDF

Resistant GPA algorithms based on the M and LMS estimation

  • Hyun, Geehong;Lee, Bo-Hui;Choi, Yong-Seok
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.6
    • /
    • pp.673-685
    • /
    • 2018
  • Procrustes analysis is a useful technique useful to measure, compare shape differences and estimate a mean shape for objects; however it is based on a least squares criterion and is affected by some outliers. Therefore, we propose two generalized Procrustes analysis methods based on M-estimation and least median of squares estimation that are resistant to object outliers. In addition, two algorithms are given for practical implementation. A simulation study and some examples are used to examine and compared the performances of the algorithms with the least square method. Moreover since these resistant GPA methods are available for higher dimensions, we need some methods to visualize the objects and mean shape effectively. Also since we have concentrated on resistant fitting methods without considering shape distributions, we wish to shape analysis not be sensitive to particular model.

Error in Variable FIR Typed System Identification Using Combining Total Least Mean Squares Estimation with Least Mean Squares Estimation (입출력 변수에 부가 잡음이 있는 FIR형 시스템 인식을 위한 견실한 추정법에 관한 연구)

  • Lim, Jun-Seok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.29 no.2
    • /
    • pp.97-101
    • /
    • 2010
  • FIR type system identification with noisy input and output data can be solved by a total least squares (TLS) estimation. However, the performance of the TLS estimation is very sensitive to the ratio between the variances of the input and output noises. In this paper, we propose an iterative convex combination algorithm between TLS and least squares (LS). This combined algorithm shows robustness against the noise variance ratio. Consequently, the practical workability of the TLS method with noisy data has been significantly broadened.

Mixture Filtering Approaches to Blind Equalization Based on Estimation of Time-Varying and Multi-Path Channels

  • Lim, Jaechan
    • Journal of Communications and Networks
    • /
    • v.18 no.1
    • /
    • pp.8-18
    • /
    • 2016
  • In this paper, we propose a number of blind equalization approaches for time-varying andmulti-path channels. The approaches employ cost reference particle filter (CRPF) as the symbol estimator, and additionally employ either least mean squares algorithm, recursive least squares algorithm, or $H{\infty}$ filter (HF) as a channel estimator such that they are jointly employed for the strategy of "Rao-Blackwellization," or equally called "mixture filtering." The novel feature of the proposed approaches is that the blind equalization is performed based on direct channel estimation with unknown noise statistics of the received signals and channel state system while the channel is not directly estimated in the conventional method, and the noise information if known in similar Kalman mixture filtering approach. Simulation results show that the proposed approaches estimate the transmitted symbols and time-varying channel very effectively, and outperform the previously proposed approach which requires the noise information in its application.

A modified partial least squares regression for the analysis of gene expression data with survival information

  • Lee, So-Yoon;Huh, Myung-Hoe;Park, Mira
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.5
    • /
    • pp.1151-1160
    • /
    • 2014
  • In DNA microarray studies, the number of genes far exceeds the number of samples and the gene expression measures are highly correlated. Partial least squares regression (PLSR) is one of the popular methods for dimensional reduction and known to be useful for the classifications of microarray data by several studies. In this study, we suggest a modified version of the partial least squares regression to analyze gene expression data with survival information. The method is designed as a new gene selection method using PLSR with an iterative procedure of imputing censored survival time. Mean square error of prediction criterion is used to determine the dimension of the model. To visualize the data, plot for variables superimposed with samples are used. The method is applied to two microarray data sets, both containing survival time. The results show that the proposed method works well for interpreting gene expression microarray data.

Alternative robust estimation methods for parameters of Gumbel distribution: an application to wind speed data with outliers

  • Aydin, Demet
    • Wind and Structures
    • /
    • v.26 no.6
    • /
    • pp.383-395
    • /
    • 2018
  • An accurate determination of wind speed distribution is the basis for an evaluation of the wind energy potential required to design a wind turbine, so it is important to estimate unknown parameters of wind speed distribution. In this paper, Gumbel distribution is used in modelling wind speed data, and alternative robust estimation methods to estimate its parameters are considered. The methodologies used to obtain the estimators of the parameters are least absolute deviation, weighted least absolute deviation, median/MAD and least median of squares. The performances of the estimators are compared with traditional estimation methods (i.e., maximum likelihood and least squares) according to bias, mean square deviation and total mean square deviation criteria using a Monte-Carlo simulation study for the data with and without outliers. The simulation results show that least median of squares and median/MAD estimators are more efficient than others for data with outliers in many cases. However, median/MAD estimator is not consistent for location parameter of Gumbel distribution in all cases. In real data application, it is firstly demonstrated that Gumbel distribution fits the daily mean wind speed data well and is also better one to model the data than Weibull distribution with respect to the root mean square error and coefficient of determination criteria. Next, the wind data modified by outliers is analysed to show the performance of the proposed estimators by using numerical and graphical methods.

Adaptive Inverse Modelling of Noisy System by Total Least Squares (완전최소자승법을 이용한 잡음환경하에서 시스템의 적응 역 모델링)

  • 황재섭
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1991.06a
    • /
    • pp.23-27
    • /
    • 1991
  • RLS(Recursive Least Squares)나 LMS(Least mean square)등은 알고리듬 고유의 성질상 잡음이 섞인 시스템에 있어서는 올바른 역 모델링을 할 수 없다. 따라서, 잡음의 영향을 받지않는 견실한(robust) 모델 추정 알고리듬이 필요하다. 본 논문에서는 잡음환경하에 있는 시스템을역 모델링하는데 있어서, 잡음의 영향을 줄이기위해 완전최소자승법을 도입하고 기존의 최소자승법과 비교 실험하였다. 그리고, 이 방법의 적응 알고리듬을 제안하였으며, RLS(Recursive least squares)와 그 성능을 비교하여 타당성을 검토하였다.

  • PDF

Determination of Design Width for Medium Streams in the Han River Basin (한강유역의 중소하천에 대한 계획하폭 산정)

  • Jeon, Se-Jin;An, Tae-Jin;Park, Jeong-Eung
    • Journal of Korea Water Resources Association
    • /
    • v.31 no.6
    • /
    • pp.675-684
    • /
    • 1998
  • This paper presents the empirical formulas for determining the design-width for medium rivers in the Han river basin. The design flood, the watershed ares, and the channel slope of 216 medium rivers in the Han river basin are collected. the design width formulas are then determined by 1) the least squares (LS) method, 2)the least median squares (LMS) method, and 3) the reweighted least squares method based on the LMS (RLS). The six types of formulas are considered to determine the acceptable type for medium streams in the Han river basin. The root mean squared errors (RMSE), the absolute mean (AME) errors, and the mean errors (ME) are computed to test the formulas derived by three regression methods. It si found that the equation related stream width to the watershed area and the channel slope is acceptable for determining the design width for medium streams in the Han river basin. It is expected that the equations proposed by this study be used an index for determining the design-width for medium streams in the Han river basin.

  • PDF

Study on Genetic Variation of 4 Microsatellite DNA Markers and Their Relationship with Somatic Cell Counts in Cow Milk

  • Jin, Hai-Guo;Zhou, Guo-li;Yang, Cao;Chu, Ming-Xing
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.16 no.10
    • /
    • pp.1535-1539
    • /
    • 2003
  • Four microsatellite DNA loci BM1818, BM1258, BM1443 and BM1905 associated with the somatic cell counts (SCC) in cow milk were analyzed for genetic variation in 240 Beijing Holstein cows. The PCR amplified products of microsatellites DNA were detected by non-denatured polyacrylamide gel electrophoresis. The number of alleles for BM1818, BM1258, BM1443 and BM1905 were 4, 5, 8 and 6 in Beijing Holstein cows, respectively. The allele size ranges for BM1818, BM1258, BM1443 and BM1905 were 274 bp to 286 bp, 92 bp to 106 bp, 154 bp to 170 bp and 187 bp to 201 bp, respectively. The polymorphism information content/effective number of alleles/heterozygosity for BM1818, BM1258, BM1443 and BM1905 were 0.3869/1.7693/0.4348, 0.5923/2.9121/0.6566, 0.7114/3.9012/0.7437 and 0.5921/2.8244/0.6459. These data showed the microsatellite DNA locus BM1443 has the highest variability, followed by BM1258, BM1905 and BM1818. The results of the least squares means analysis showed as follows: the least squares mean of SCC for BM1818 284 bp/284 bp was significantly lower than that for BM1818 286 bp/286 bp (p<0.05). The least squares mean of SCC for BM1258 100 bp/100 bp was significantly lower than that for BM1258 102 bp/102 bp, 106 bp/106 bp, 106 bp/104 bp, 106 bp/102 bp, 106 bp/100 bp, 104 bp/100 bp (p<0.05). The least squares mean of SCC for BM1443 166 bp/160 bp and 166 bp/166 bp was significantly lower than that for BM1443 170 bp/160 bp, 160 bp/157 bp, 165 bp/160 bp (p<0.05). The least squares mean of SCC for BM1905 187 bp/187 bp was significantly lower than that for BM1905 197 bp/195 bp, 193 bp/187 bp (p<0.05).

Interference Cancellation Based on Adaptive Signal Processing for MIMO RF Repeaters (MIMO RF 중계기를 위한 적응 신호처리 기반의 간섭 제거)

  • Lee, Kyu-Bum;Choi, Ji-Hoon
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.9C
    • /
    • pp.735-742
    • /
    • 2010
  • In this paper, we propose adaptive algorithms for interference cancellation in RF repeaters with multiple transmit and receive antennas. When multiple antennas are used in a repeater, the imperfect isolation between transmit and receive antennas causes the feedback interference which is modeled as multi-input multi-output (MIMO) channel. To remove the feedback interference, we derive the least mean square (LMS) algorithm and the recursive least squares (RLS) algorithm for interference cancellation based on adaptive signal processing techniques. Through computer simulations for the proposed algorithms, we analyze the convergence characteristics and compare the steady-state performance for interference cancellation.