• Title/Summary/Keyword: least squares problem

Search Result 347, Processing Time 0.025 seconds

REGRESSION WITH CENSORED DATA BY LEAST SQUARES SUPPORT VECTOR MACHINE

  • Kim, Dae-Hak;Shim, Joo-Yong;Oh, Kwang-Sik
    • Journal of the Korean Statistical Society
    • /
    • v.33 no.1
    • /
    • pp.25-34
    • /
    • 2004
  • In this paper we propose a prediction method on the regression model with randomly censored observations of the training data set. The least squares support vector machine regression is applied for the regression function prediction by incorporating the weights assessed upon each observation in the optimization problem. Numerical examples are given to show the performance of the proposed prediction method.

Adaptive Identification of a Time-varying Volterra system using the FWLS (filtered weighted least squares) Algorithm (FWLS 적응 알고리듬을 이용한 시변 볼테라 시스템 식별)

  • Ahn, K.Y.;Jeong, I.S.;Nam, S.W.
    • Proceedings of the KIEE Conference
    • /
    • 2004.05a
    • /
    • pp.3-6
    • /
    • 2004
  • In this paper, the problem of identifying a time-varying nonlinear system in an adaptive way was considered, whereby the time-varying second-order Volterra series was employed to model the system and the filtered weighted least squares (FWLS) algorithm was utilized for the fast parameter tracking capability with low computational burden. Finally, the performance of the proposed approach was demonstrated by providing some computer simulation results.

  • PDF

APPROXIMATE SOLUTIONS TO ONE-DIMENSIONAL BACKWARD HEAT CONDUCTION PROBLEM USING LEAST SQUARES SUPPORT VECTOR MACHINES

  • Wu, Ziku;Li, Fule;Kwak, Do Young
    • Journal of the Chungcheong Mathematical Society
    • /
    • v.29 no.4
    • /
    • pp.631-642
    • /
    • 2016
  • This article deals with one-dimension backward heat conduction problem (BHCP). A new approach based on least squares support vector machines (LS-SVM) is proposed for obtaining their approximate solutions. The approximate solution is presented in closed form by means of LS-SVM, whose parameters are adjusted to minimize an appropriate error function. The approximate solution consists of two parts. The first part is a known function that satisfies initial and boundary conditions. The other is a product of two terms. One term is known function which has zero boundary and initial conditions, another term is unknown which is related to kernel functions. This method has been successfully tested on practical examples and has yielded higher accuracy and stable solutions.

An Algorithm for One-Sided Generalized Least Squares Estimation and Its Application

  • Park, Chul-Gyu
    • Journal of the Korean Statistical Society
    • /
    • v.29 no.3
    • /
    • pp.361-373
    • /
    • 2000
  • A simple and efficient algorithm is introduced for generalized least squares estimation under nonnegativity constraints in the components of the parameter vector. This algorithm gives the exact solution to the estimation problem within a finite number of pivot operations. Besides an illustrative example, an empirical study is conducted for investigating the performance of the proposed algorithm. This study indicates that most of problems are solved in a few iterations, and the number of iterations required for optimal solution increases linearly to the size of the problem. Finally, we will discuss the applicability of the proposed algorithm extensively to the estimation problem having a more general set of linear inequality constraints.

  • PDF

Navigation of a Mobile Robot Using Nonlinear Least Squares Optimization (비선형 최적화 방법을 이용한 이동로봇의 주행)

  • Kim, Gon-Woo;Cha, Young-Youp
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.60 no.7
    • /
    • pp.1404-1409
    • /
    • 2011
  • The fundamental research for the mobile robot navigation using the numerical optimization method is presented. We define the mobile robot navigation problem as an unconstrained optimization problem to minimize the cost function with the pose error between the goal position and the position of a mobile robot. Using the nonlinear least squares optimization method, the optimal speeds of the left and right wheels can be found as the solution of the optimization problem. Especially, the rotational speed of wheels of a mobile robot can be directly related to the overall speed of a mobile robot using the Jacobian derived from the kinematic model. It will be very useful for applying to the mobile robot navigation. The performance was evaluated using the simulation.

FINDING EXPLICIT SOLUTIONS FOR LINEAR REGRESSION WITHOUT CORRESPONDENCES BASED ON REARRANGEMENT INEQUALITY

  • MIJIN KIM;HYUNGU LEE;HAYOUNG CHOI
    • Journal of applied mathematics & informatics
    • /
    • v.42 no.1
    • /
    • pp.149-158
    • /
    • 2024
  • A least squares problem without correspondences is expressed as the following optimization: Π∈Pminm, x∈ℝn ║Ax-Πy║, where A ∈ ℝm×n and y ∈ ℝm are given. In general, solving such an optimization problem is highly challenging. In this paper we use the rearrangement inequalities to find the closed form of solutions for certain cases. Moreover, despite the stringent constraints, we successfully tackle the nonlinear least squares problem without correspondences by leveraging rearrangement inequalities.

MULTIGRID METHODS FOR THE PURE TRACTION PROBLEM OF LINEAR ELASTICITY: FOSLS FORMULATION

  • Lee, Chang-Ock
    • Communications of the Korean Mathematical Society
    • /
    • v.12 no.3
    • /
    • pp.813-827
    • /
    • 1997
  • Multigrid methods for two first-order system least squares (FOSLS) using bilinear finite elements are developed for the pure traction problem of planar linear elasticity. They are two-stage algorithms that first solve for the gradients of displacement, then for the displacement itself. In this paper, concentration is given on solving for the gradients of displacement only. Numerical results show that the convergences are uniform even as the material becomes nearly incompressible. Computations for convergence rates are included.

  • PDF

Inversion of Geophysical Data with Robust Estimation (로버스트추정에 의한 지구물리자료의 역산)

  • Kim, Hee Joon
    • Economic and Environmental Geology
    • /
    • v.28 no.4
    • /
    • pp.433-438
    • /
    • 1995
  • The most popular minimization method is based on the least-squares criterion, which uses the $L_2$ norm to quantify the misfit between observed and synthetic data. The solution of the least-squares problem is the maximum likelihood point of a probability density containing data with Gaussian uncertainties. The distribution of errors in the geophysical data is, however, seldom Gaussian. Using the $L_2$ norm, large and sparsely distributed errors adversely affect the solution, and the estimated model parameters may even be completely unphysical. On the other hand, the least-absolute-deviation optimization, which is based on the $L_1$ norm, has much more robust statistical properties in the presence of noise. The solution of the $L_1$ problem is the maximum likelihood point of a probability density containing data with longer-tailed errors than the Gaussian distribution. Thus, the $L_1$ norm gives more reliable estimates when a small number of large errors contaminate the data. The effect of outliers is further reduced by M-fitting method with Cauchy error criterion, which can be performed by iteratively reweighted least-squares method.

  • PDF

THE (R,S)-SYMMETRIC SOLUTIONS TO THE LEAST-SQUARES PROBLEM OF MATRIX EQUATION AXB = C

  • Liang, Mao-Lin;Dai, Li-Fang;Wang, San-Fu
    • Journal of applied mathematics & informatics
    • /
    • v.27 no.5_6
    • /
    • pp.1061-1071
    • /
    • 2009
  • For real generalized reflexive matrices R, S, i.e., $R^T$ = R, $R^2$ = I, $S^T$ = S, $S^2$ = I, we say that real matrix X is (R,S)-symmetric, if RXS = X. In this paper, an iterative algorithm is proposed to solve the least-squares problem of matrix equation AXB = C with (R,S)-symmetric X. Furthermore, the optimal approximation solution to given matrix $X_0$ is also derived by this iterative algorithm. Finally, given numerical example and its convergent curve show that this method is feasible and efficient.

  • PDF

Statistical Estimation and Algorithm in Nonlinear Functions

  • Jea-Young Lee
    • Communications for Statistical Applications and Methods
    • /
    • v.2 no.2
    • /
    • pp.135-145
    • /
    • 1995
  • A new algorithm was given to successively fit the multiexponential function/nonlinear function to data by a weighted least squares method, using Gauss-Newton, Marquardt, gradient and DUD methods for convergence. This study also considers the problem of linear-nonlimear weighted least squares estimation which is based upon the usual Taylor's formula process.

  • PDF