• Title/Summary/Keyword: superlinear convergence

Search Result 17, Processing Time 0.018 seconds

AFFINE INVARIANT LOCAL CONVERGENCE THEOREMS FOR INEXACT NEWTON-LIKE METHODS

  • Argyros, Ioannis K.
    • Journal of applied mathematics & informatics
    • /
    • v.6 no.2
    • /
    • pp.393-406
    • /
    • 1999
  • Affine invariant sufficient conditions are given for two local convergence theorems involving inexact Newton-like methods. The first uses conditions on the first Frechet-derivative whereas the second theorem employs hypotheses on the second. Radius of con-vergence as well as rate of convergence results are derived. Results involving superlinear convergence and known to be true for inexact Newton methods are extended here. Moreover we show that under hypotheses on the second Frechet-derivation our radius of convergence results are derived. Results involving superlinear convergence and known to be true or inexact Newton methods are extended here. Moreover we show that under hypotheses on the second Frechet-derivative our radius of conver-gence is larger than the corresponding one in [10]. This allows a wider choice for the initial guess. A numerical example is also pro-vided to show that our radius of convergence is larger then the one in [10].

INEXACT-NEWTON METHOD FOR SOLVING OPERATOR EQUATIONS IN INFINITE-DIMENSIONAL SPACES

  • Liu Jing;Gao Yan
    • Journal of applied mathematics & informatics
    • /
    • v.22 no.1_2
    • /
    • pp.351-360
    • /
    • 2006
  • In this paper, we develop an inexact-Newton method for solving nonsmooth operator equations in infinite-dimensional spaces. The linear convergence and superlinear convergence of inexact-Newton method under some conditions are shown. Then, we characterize the order of convergence in terms of the rate of convergence of the relative residuals. The present inexact-Newton method could be viewed as the extensions of previous ones with same convergent results in finite-dimensional spaces.

LOCAL CONVERGENCE THEOREMS FOR NEWTON METHODS

  • Argyros, Ioannis K.
    • Journal of applied mathematics & informatics
    • /
    • v.8 no.2
    • /
    • pp.345-360
    • /
    • 2001
  • Affine invariant sufficient conditions are given for two local convergence theorems involving inexact Newton-like methods. The first uses conditions on the first Frechet-derivative whereas the second theorem employs hypotheses on the mth(m≥2 an integer). Radius of convergence as well as rate of convergence results are derived. Results involving superlinear convergence and known to be true for inexact Newton methods are extended here. Moreover, we show that under hypotheses on the mth Frechet-derivative our radius of convergence can sometimes be larger than the corresponding one in [10]. This allows a wider choice for the initial guess. A numerical example is also provided to show that our radius of convergence is larger than the one in [10].

A SUPERLINEAR $\mathcal{VU}$ SPACE-DECOMPOSITION ALGORITHM FOR SEMI-INFINITE CONSTRAINED PROGRAMMING

  • Huang, Ming;Pang, Li-Ping;Lu, Yuan;Xia, Zun-Quan
    • Journal of applied mathematics & informatics
    • /
    • v.30 no.5_6
    • /
    • pp.759-772
    • /
    • 2012
  • In this paper, semi-infinite constrained programming, a class of constrained nonsmooth optimization problems, are transformed into unconstrained nonsmooth convex programs under the help of exact penalty function. The unconstrained objective function which owns the primal-dual gradient structure has connection with $\mathcal{VU}$-space decomposition. Then a $\mathcal{VU}$-space decomposition method can be applied for solving this unconstrained programs. Finally, the superlinear convergence algorithm is proved under certain assumption.

A DUAL ALGORITHM FOR MINIMAX PROBLEMS

  • HE SUXIANG
    • Journal of applied mathematics & informatics
    • /
    • v.17 no.1_2_3
    • /
    • pp.401-418
    • /
    • 2005
  • In this paper, a dual algorithm, based on a smoothing function of Bertsekas (1982), is established for solving unconstrained minimax problems. It is proven that a sequence of points, generated by solving a sequence of unconstrained minimizers of the smoothing function with changing parameter t, converges with Q-superlinear rate to a Kuhn-Thcker point locally under some mild conditions. The relationship between the condition number of the Hessian matrix of the smoothing function and the parameter is studied, which also validates the convergence theory. Finally the numerical results are reported to show the effectiveness of this algorithm.

A TYPE OF MODIFIED BFGS ALGORITHM WITH ANY RANK DEFECTS AND THE LOCAL Q-SUPERLINEAR CONVERGENCE PROPERTIES

  • Ge Ren-Dong;Xia Zun-Quan;Qiang Guo
    • Journal of applied mathematics & informatics
    • /
    • v.22 no.1_2
    • /
    • pp.193-208
    • /
    • 2006
  • A modified BFGS algorithm for solving the unconstrained optimization, whose Hessian matrix at the minimum point of the convex function is of rank defects, is presented in this paper. The main idea of the algorithm is first to add a modified term to the convex function for obtain an equivalent model, then simply the model to get the modified BFGS algorithm. The superlinear convergence property of the algorithm is proved in this paper. To compared with the Tensor algorithms presented by R. B. Schnabel (seing [4],[5]), this method is more efficient for solving singular unconstrained optimization in computing amount and complication.

A KANTOROVICH-TYPE CONVERGENCE ANALYSIS FOR THE QUASI-GAUSS-NEWTON METHOD

  • Kim, S.
    • Journal of the Korean Mathematical Society
    • /
    • v.33 no.4
    • /
    • pp.865-878
    • /
    • 1996
  • We consider numerical methods for finding a solution to a nonlinear system of algebraic equations $$ (1) f(x) = 0, $$ where the function $f : R^n \to R^n$ is ain $x \in R^n$. In [10], a quasi-Gauss-Newton method is proposed and shown the computational efficiency over SQRT algorithm by numerical experiments. The convergence rate of the method has not been proved theoretically. In this paper, we show theoretically that the iterate $x_k$ obtained from the quasi-Gauss-Newton method for the problem (1) actually converges to a root by Kantorovich-type convergence analysis. We also show the rate of convergence of the method is superlinear.

  • PDF

BROYDEN'S METHOD FOR OPERATORS WITH REGULARLY CONTINUOUS DIVIDED DIFFERENCES

  • Galperin, Anatoly M.
    • Journal of the Korean Mathematical Society
    • /
    • v.52 no.1
    • /
    • pp.43-65
    • /
    • 2015
  • We present a new convergence analysis of popular Broyden's method in the Banach/Hilbert space setting which is applicable to non-smooth operators. Moreover, we do not assume a priori solvability of the equation under consideration. Nevertheless, without these simplifying assumptions our convergence theorem implies existence of a solution and superlinear convergence of Broyden's iterations. To demonstrate practical merits of Broyden's method, we use it for numerical solution of three nontrivial infinite-dimensional problems.

AN ADAPTIVE APPROACH OF CONIC TRUST-REGION METHOD FOR UNCONSTRAINED OPTIMIZATION PROBLEMS

  • FU JINHUA;SUN WENYU;SAMPAIO RAIMUNDO J. B. DE
    • Journal of applied mathematics & informatics
    • /
    • v.19 no.1_2
    • /
    • pp.165-177
    • /
    • 2005
  • In this paper, an adaptive trust region method based on the conic model for unconstrained optimization problems is proposed and analyzed. We establish the global and super linear convergence results of the method. Numerical tests are reported that confirm the efficiency of the new method.

A Study for Spectral Properties of Preconditioner of Symmetric Toeplitz Systems (대칭 토플리츠 시스템의 선행조건에 대한 특정성질 연구)

  • Baik, Ran
    • Journal of Digital Contents Society
    • /
    • v.10 no.4
    • /
    • pp.579-585
    • /
    • 2009
  • In [9], Tyrtshnikov proposed a preconditioned approach to derive a general solution from a Toeplitz linear system. Furthermore, the process of selecting a preconditioner matrix from symmetric Toeplitz matrix, which has been used in previous studies, is introduced. This research introduces a new method for finding the preconditioner in a Toeplitz system. Also, through analyzing these preconditioners, it is derived that eigenvalues of a symmetric Toeplitz are very close to eigenvalues of a new preconditioner for T. It is shown that if the spectrum of the preconditioned system $C_0^{-1}T$ is clustered around 1, then the convergence rate of the preconditioned system is superlinear. From these results, it is determined to get the superliner at the convergence rate by our good preconditioner $C_0$. Moreover, an advantage is driven by increasing various applications i. e. image processing, signal processing, etc. in this study from the proposed preconditioners for Toeplitz matrices. Another characteristic, which this research holds, is that the preconditioner retains the properties of the Toeplitz matrix.

  • PDF