• Journal of the Korean Society for Industrial and Applied Mathematics
• /
• v.25 no.4
• /
• pp.162-172
• /
• 2021

This paper proposes stochastic methods to find an approximate solution for the L²-Wasserstein least squares problem of Gaussian measures. The variable for the problem is in a set of positive definite matrices. The first proposed stochastic method is a type of classical stochastic gradient methods combined with projection and the second one is a type of variance reduced methods with projection. Their global convergence are analyzed by using the framework of proximal stochastic gradient methods. The convergence of the classical stochastic gradient method combined with projection is established by using diminishing learning rate rule in which the learning rate decreases as the epoch increases but that of the variance reduced method with projection can be established by using constant learning rate. The numerical results show that the present algorithms with a proper learning rate outperforms a gradient projection method.

• Journal of applied mathematics & informatics
• /
• v.27 no.1_2
• /
• pp.1-12
• /
• 2009

Iterative algorithms are proposed for the least-squares symmetric solution of AXB = E with a submatrix constraint. We characterize the linear mappings from their independent element space to the constrained solution sets, study their properties and use these properties to propose two matrix iterative algorithms that can find the minimum and quasi-minimum norm solution based on the classical LSQR algorithm for solving the unconstrained LS problem. Numerical results are provided that show the efficiency of the proposed methods.

• Communications for Statistical Applications and Methods
• /
• v.15 no.6
• /
• pp.799-813
• /
• 2008

This paper deals with the properties of the fuzzy least squares estimators for fuzzy linear regression model. Especially fuzzy triangular input-output model including error term is proposed. The error term is considered as a fuzzy random variable. The asymptotic unbiasedness and the consistency of the estimators are proved using a suitable metric.

• Journal of the Korean Data and Information Science Society
• /
• v.17 no.4
• /
• pp.1169-1180
• /
• 2006

Partial least squares regression (PLS) is a biased, non-least squares regression method and is an alternative to the ordinary least squares regression (OLS) when predictors are highly collinear or predictors outnumber observations. One way to understand the properties of biased regression methods is to know how the estimators shrink the OLS estimator. In this paper, we introduce an expression for the shrinkage factor of PLS and develop a new shrinkage expression, and then prove the equivalence of the two representations. We use two near-infrared (NIR) data sets to show general behavior of the shrinkage and in particular for what eigendirections PLS expands the OLS coefficients.

• Communications for Statistical Applications and Methods
• /
• v.8 no.3
• /
• pp.651-659
• /
• 2001

Preference map is a widely used graphical method for the preference data set which is frequently encountered in the field of marketing research. This provides joint configuration usually in two dimensional space between "products" and their "attributes". Whereas the classical preference map adopts the ordinary least squares method in deriving map, the present article suggests the weighted least squares approach providing the better graphical display and interpretation compared to the classical one. Internet search engine data in Korea are analysed for illustration.

• Communications for Statistical Applications and Methods
• /
• v.12 no.2
• /
• pp.539-544
• /
• 2005

In this paper, we propose the one-step least squares method based on the squared differences to estimate the parameters of the variogram used for spatial data modelling, and discuss its asymptotic efficiency. The proposed method does not require to specify lags of interest and partition lags, so that we can delete the subjectiveness and ambiguity originated from the lag selection in estimating spatial dependence.

• Wind and Structures
• /
• v.26 no.6
• /
• pp.383-395
• /
• 2018

An accurate determination of wind speed distribution is the basis for an evaluation of the wind energy potential required to design a wind turbine, so it is important to estimate unknown parameters of wind speed distribution. In this paper, Gumbel distribution is used in modelling wind speed data, and alternative robust estimation methods to estimate its parameters are considered. The methodologies used to obtain the estimators of the parameters are least absolute deviation, weighted least absolute deviation, median/MAD and least median of squares. The performances of the estimators are compared with traditional estimation methods (i.e., maximum likelihood and least squares) according to bias, mean square deviation and total mean square deviation criteria using a Monte-Carlo simulation study for the data with and without outliers. The simulation results show that least median of squares and median/MAD estimators are more efficient than others for data with outliers in many cases. However, median/MAD estimator is not consistent for location parameter of Gumbel distribution in all cases. In real data application, it is firstly demonstrated that Gumbel distribution fits the daily mean wind speed data well and is also better one to model the data than Weibull distribution with respect to the root mean square error and coefficient of determination criteria. Next, the wind data modified by outliers is analysed to show the performance of the proposed estimators by using numerical and graphical methods.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.11 no.4
• /
• pp.267-274
• /
• 2011

Recently, actor-critic methods have drawn significant interests in the area of reinforcement learning, and several algorithms have been studied along the line of the actor-critic strategy. In this paper, we consider a new type of actor-critic algorithms employing the kernel methods, which have recently shown to be very effective tools in the various fields of machine learning, and have performed investigations on combining the actor-critic strategy together with kernel methods. More specifically, this paper studies actor-critic algorithms utilizing the kernel-based least-squares estimation and policy gradient, and in its critic's part, the study uses a sliding-window-based kernel least-squares method, which leads to a fast and efficient value-function-estimation in a nonparametric setting. The applicability of the considered algorithms is illustrated via a robot locomotion problem and a tunnel ventilation control problem.

• Near Infrared Analysis
• /
• v.1 no.2
• /
• pp.1-8
• /
• 2000

Using the net analyte signal, hybrid linear analysis was proposed to predict chemical concentration. In this paper, we select a sample from training set and apply orthogonal signal correction to obtain an improved pseudo unit spectrum for hybrid least analysis. using the mean spectrum of a calibration training set, we first show the calibration by hybrid least analysis is effective to the prediction of not only chemical concentrations but also physical property variables. Then, a pseudo unit spectrum from a training set is also tested with and without orthogonal signal correction. We use two data sets, one including five chemical concentrations and the other including ten physical property variables, to compare the performance of partial least squares and modified hybrid least analysis calibration methods. The results show that the hybrid least analysis with a selected training spectrum instead of well-measured pure spectrum still gives good performances, which is a little better than partial least squares.

• Journal of the Korean Society for Industrial and Applied Mathematics
• /
• v.21 no.3
• /
• pp.155-165
• /
• 2017

The Hansel-Spittel constitutive model requires a total of nine parameters for flow stress prediction. Typically, the parameters are estimated by least squares methods for given tensile test measurements from a deterministic perspective. In this research we took a different approach, a probabilistic viewpoint, to see through the development of the Hansel-Spittel constitutive model. This perspective change showed that deterministic least squares methods are closely related to statistical maximum likelihood methods via Gaussian noise assumption. More intriguingly, this perspective shift revealed that the Hansel-Spittel constitutive model may leave out deterministic trends in residuals despite nearly perfect agreement with measurements. With tensile test measurements of AA1070 aluminum alloy, we demonstrated this deficiency of the Hansel-Spittel constitutive model, suggesting room for improvement.