• Title/Summary/Keyword: Gradient-based algorithm

Search Result 626, Processing Time 0.028 seconds

Large-Scale Phase Retrieval via Stochastic Reweighted Amplitude Flow

  • Xiao, Zhuolei;Zhang, Yerong;Yang, Jie
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.11
    • /
    • pp.4355-4371
    • /
    • 2020
  • Phase retrieval, recovering a signal from phaseless measurements, is generally considered to be an NP-hard problem. This paper adopts an amplitude-based nonconvex optimization cost function to develop a new stochastic gradient algorithm, named stochastic reweighted phase retrieval (SRPR). SRPR is a stochastic gradient iteration algorithm, which runs in two stages: First, we use a truncated sample stochastic variance reduction algorithm to initialize the objective function. The second stage is the gradient refinement stage, which uses continuous updating of the amplitude-based stochastic weighted gradient algorithm to improve the initial estimate. Because of the stochastic method, each iteration of the two stages of SRPR involves only one equation. Therefore, SRPR is simple, scalable, and fast. Compared with the state-of-the-art phase retrieval algorithm, simulation results show that SRPR has a faster convergence speed and fewer magnitude-only measurements required to reconstruct the signal, under the real- or complex- cases.

Dynamic GBFCM(Gradient Based FCM) Algorithm (동적 GBFCM(Gradient Based FCM) 알고리즘)

  • Kim, Myoung-Ho;Park, Dong-C.
    • Proceedings of the KIEE Conference
    • /
    • 1996.07b
    • /
    • pp.1371-1373
    • /
    • 1996
  • A clustering algorithms with dynamic adjustment of learning rate for GBFCM(Gradient Based FCM) is proposed in this paper. This algorithm combines two idea of dynamic K-means algorithms and GBFCM : learning rate variation with entropy concept and continuous membership grade. To evaluate dynamic GBFCM, we made comparisons with Kohonen's Self-Organizing Map over several tutorial examples and image compression. The results show that DGBFCM(Dynamic GBFCM) gives superior performance over Kohonen's algorithm in terms of signal-to-noise.

  • PDF

The Design of the Stabilized Algorithm for Shipboard Satellite Antenna Systems using Genetic Algorithm (유전 알고리즘을 적용한 선박용 위성 안테나의 안정화 알고리즘의 설계)

  • 고운용;황승욱;진강규
    • Journal of the Korean Institute of Navigation
    • /
    • v.25 no.4
    • /
    • pp.361-369
    • /
    • 2001
  • This thesis describes the design of a stabilized algorithm for shipboard satellite antenna systems which can enhance the tracking performance. In order to overcome some drawbacks of the conventional step tracking algorithm, the proposed algorithm searches for the best tracking angles using gradient-based formulae and signal intensities measured according to a search pattern. The effectiveness of the proposed algorithm is demonstrated through simulation using real-world data.

  • PDF

A Tracking Algorithm for Shipboard Satellite Antenna Systems (선박용 위성 안테나용 트랙킹 알고리즘)

  • 고운용;황승욱;진강규
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.25 no.5
    • /
    • pp.1115-1121
    • /
    • 2001
  • This paper presents the development of a tracking algorithm for shipborad satellite antenna systems which can enhance the tracking performance. In order to overcome some drawbacks of the conventional step tracking algorithm a new tracking algorithm is proposed. The proposed algorithm searches for the best tracking angles using gradient-based formulae and signal intensities measured according to a search pattern. The effectiveness of the proposed algorithm is demonstrated through simulation using real data.

  • PDF

Development of a Tracking Algorithm for Shipboard Satellite Antenna Systems (선박용 위성 안테나의 트랙킹 알고리즘 개발)

  • 고운용;황승욱;진강규
    • Proceedings of the Korean Society of Marine Engineers Conference
    • /
    • 2001.05a
    • /
    • pp.219-224
    • /
    • 2001
  • This paper presents the development of a tracking algorithm for shipboard satellite antenna systems which can enhance the tracking performance. In order to overcome some drawbacks of the conventional step tracking algorithm, the proposed algorithm searches for the best tracking angles using gradient-based formulae and signal intensities measured according to a search pattern. The effectiveness of the proposed algorithm is demonstrated through simulation using real-world data.

  • PDF

Compression of Image Data Using Neural Networks based on Conjugate Gradient Algorithm and Dynamic Tunneling System

  • Cho, Yong-Hyun;Kim, Weon-Ook;Bang, Man-Sik;Kim, Young-il
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.740-749
    • /
    • 1998
  • This paper proposes compression of image data using neural networks based on conjugate gradient method and dynamic tunneling system. The conjugate gradient method is applied for high speed optimization .The dynamic tunneling algorithms, which is the deterministic method with tunneling phenomenon, is applied for global optimization. Converging to the local minima by using the conjugate gradient method, the new initial point for escaping the local minima is estimated by dynamic tunneling system. The proposed method has been applied the image data compression of 12 ${\times}$12 pixels. The simulation results shows the proposed networks has better learning performance , in comparison with that using the conventional BP as learning algorithm.

A Development of a Path-Based Traffic Assignment Algorithm using Conjugate Gradient Method (Conjugate Gradient 법을 이용한 경로기반 통행배정 알고리즘의 구축)

  • 강승모;권용석;박창호
    • Journal of Korean Society of Transportation
    • /
    • v.18 no.5
    • /
    • pp.99-107
    • /
    • 2000
  • Path-based assignment(PBA) is valuable to dynamic traffic control and routing in integrated ITS framework. As one of widely studied PBA a1gorithms, Gradient Projection(GP) a1gorithm typically fields rapid convergence to a neighborhood of an optimal solution. But once it comes near a solution, it tends to slow down. To overcome this problem, we develop more efficient path-based assignment algorithm by combining Conjugate Gradient method with GP algorithm. It determines more accurate moving direction near a solution in order to gain a significant advantage in speed of convergence. Also this algorithm is applied to the Sioux-Falls network and verified its efficiency. Then we demonstrate that this type of method is very useful in improving speed of convergence in the case of user equilibrium problem.

  • PDF

Nonlinear optimization algorithm using monotonically increasing quantization resolution

  • Jinwuk Seok;Jeong-Si Kim
    • ETRI Journal
    • /
    • v.45 no.1
    • /
    • pp.119-130
    • /
    • 2023
  • We propose a quantized gradient search algorithm that can achieve global optimization by monotonically reducing the quantization step with respect to time when quantization is composed of integer or fixed-point fractional values applied to an optimization algorithm. According to the white noise hypothesis states, a quantization step is sufficiently small and the quantization is well defined, the round-off error caused by quantization can be regarded as a random variable with identically independent distribution. Thus, we rewrite the searching equation based on a gradient descent as a stochastic differential equation and obtain the monotonically decreasing rate of the quantization step, enabling the global optimization by stochastic analysis for deriving an objective function. Consequently, when the search equation is quantized by a monotonically decreasing quantization step, which suitably reduces the round-off error, we can derive the searching algorithm evolving from an optimization algorithm. Numerical simulations indicate that due to the property of quantization-based global optimization, the proposed algorithm shows better optimization performance on a search space to each iteration than the conventional algorithm with a higher success rate and fewer iterations.

Adaptive Matching Scan Algorithm Based on Gradient Magnitude and Sub-blocks in Fast Motion Estimation of Full Search (전영역 탐색의 고속 움직임 예측에서 기울기 크기와 부 블록을 이용한 적응 매칭 스캔 알고리즘)

  • 김종남;최태선
    • Proceedings of the IEEK Conference
    • /
    • 1999.11a
    • /
    • pp.1097-1100
    • /
    • 1999
  • Due to the significant computation of full search in motion estimation, extensive research in fast motion estimation algorithms has been carried out. However, most of the algorithms have the degradation in predicted images compared with the full search algorithm. To reduce an amount of significant computation while keeping the same prediction quality of the full search, we propose a fast block-matching algorithm based on gradient magnitude of reference block without any degradation of predicted image. By using Taylor series expansion, we show that the block matching errors between reference block and candidate block are proportional to the gradient magnitude of matching block. With the derived result, we propose fast full search algorithm with adaptively determined scan direction in the block matching. Experimentally, our proposed algorithm is very efficient in terms of computational speedup and has the smallest computation among all the conventional full search algorithms. Therefore, our algorithm is useful in VLSI implementation of video encoder requiring real-time application.

  • PDF

Adaptive Control Based on Speed-Gradient Algorithm (Speed Gradient 알고리즘을 이용한 적응제어)

  • 정사철;김진환;이정규;함운철
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.3
    • /
    • pp.39-46
    • /
    • 1994
  • In this paper, three types of parameter update law which can be used in model reference adaptive control are suggested based on speed-gradient algorithm which was introduced by Fradkov. It is shown that the parameter update law which was proposed by Narendra is a special from of these laws and that proposed parameter update laws can insure the global stability under some conditions such as attainability and convexity. We also comment that the transfer function of reference model shoud be positive real for the realization of parameter update law.

  • PDF