• Title/Summary/Keyword: Gradient-based algorithm

검색결과 626건 처리시간 0.023초

Large-Scale Phase Retrieval via Stochastic Reweighted Amplitude Flow

  • Xiao, Zhuolei;Zhang, Yerong;Yang, Jie
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제14권11호
    • /
    • pp.4355-4371
    • /
    • 2020
  • Phase retrieval, recovering a signal from phaseless measurements, is generally considered to be an NP-hard problem. This paper adopts an amplitude-based nonconvex optimization cost function to develop a new stochastic gradient algorithm, named stochastic reweighted phase retrieval (SRPR). SRPR is a stochastic gradient iteration algorithm, which runs in two stages: First, we use a truncated sample stochastic variance reduction algorithm to initialize the objective function. The second stage is the gradient refinement stage, which uses continuous updating of the amplitude-based stochastic weighted gradient algorithm to improve the initial estimate. Because of the stochastic method, each iteration of the two stages of SRPR involves only one equation. Therefore, SRPR is simple, scalable, and fast. Compared with the state-of-the-art phase retrieval algorithm, simulation results show that SRPR has a faster convergence speed and fewer magnitude-only measurements required to reconstruct the signal, under the real- or complex- cases.

동적 GBFCM(Gradient Based FCM) 알고리즘 (Dynamic GBFCM(Gradient Based FCM) Algorithm)

  • 김명호;박동철
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1996년도 하계학술대회 논문집 B
    • /
    • pp.1371-1373
    • /
    • 1996
  • A clustering algorithms with dynamic adjustment of learning rate for GBFCM(Gradient Based FCM) is proposed in this paper. This algorithm combines two idea of dynamic K-means algorithms and GBFCM : learning rate variation with entropy concept and continuous membership grade. To evaluate dynamic GBFCM, we made comparisons with Kohonen's Self-Organizing Map over several tutorial examples and image compression. The results show that DGBFCM(Dynamic GBFCM) gives superior performance over Kohonen's algorithm in terms of signal-to-noise.

  • PDF

유전 알고리즘을 적용한 선박용 위성 안테나의 안정화 알고리즘의 설계 (The Design of the Stabilized Algorithm for Shipboard Satellite Antenna Systems using Genetic Algorithm)

  • 고운용;황승욱;진강규
    • 한국항해학회지
    • /
    • 제25권4호
    • /
    • pp.361-369
    • /
    • 2001
  • This thesis describes the design of a stabilized algorithm for shipboard satellite antenna systems which can enhance the tracking performance. In order to overcome some drawbacks of the conventional step tracking algorithm, the proposed algorithm searches for the best tracking angles using gradient-based formulae and signal intensities measured according to a search pattern. The effectiveness of the proposed algorithm is demonstrated through simulation using real-world data.

  • PDF

선박용 위성 안테나용 트랙킹 알고리즘 (A Tracking Algorithm for Shipboard Satellite Antenna Systems)

  • 고운용;황승욱;진강규
    • Journal of Advanced Marine Engineering and Technology
    • /
    • 제25권5호
    • /
    • pp.1115-1121
    • /
    • 2001
  • This paper presents the development of a tracking algorithm for shipborad satellite antenna systems which can enhance the tracking performance. In order to overcome some drawbacks of the conventional step tracking algorithm a new tracking algorithm is proposed. The proposed algorithm searches for the best tracking angles using gradient-based formulae and signal intensities measured according to a search pattern. The effectiveness of the proposed algorithm is demonstrated through simulation using real data.

  • PDF

선박용 위성 안테나의 트랙킹 알고리즘 개발 (Development of a Tracking Algorithm for Shipboard Satellite Antenna Systems)

  • 고운용;황승욱;진강규
    • 한국마린엔지니어링학회:학술대회논문집
    • /
    • 한국마린엔지니어링학회 2001년도 춘계학술대회 논문집
    • /
    • pp.219-224
    • /
    • 2001
  • This paper presents the development of a tracking algorithm for shipboard satellite antenna systems which can enhance the tracking performance. In order to overcome some drawbacks of the conventional step tracking algorithm, the proposed algorithm searches for the best tracking angles using gradient-based formulae and signal intensities measured according to a search pattern. The effectiveness of the proposed algorithm is demonstrated through simulation using real-world data.

  • PDF

Compression of Image Data Using Neural Networks based on Conjugate Gradient Algorithm and Dynamic Tunneling System

  • Cho, Yong-Hyun;Kim, Weon-Ook;Bang, Man-Sik;Kim, Young-il
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 1998년도 The Third Asian Fuzzy Systems Symposium
    • /
    • pp.740-749
    • /
    • 1998
  • This paper proposes compression of image data using neural networks based on conjugate gradient method and dynamic tunneling system. The conjugate gradient method is applied for high speed optimization .The dynamic tunneling algorithms, which is the deterministic method with tunneling phenomenon, is applied for global optimization. Converging to the local minima by using the conjugate gradient method, the new initial point for escaping the local minima is estimated by dynamic tunneling system. The proposed method has been applied the image data compression of 12 ${\times}$12 pixels. The simulation results shows the proposed networks has better learning performance , in comparison with that using the conventional BP as learning algorithm.

Conjugate Gradient 법을 이용한 경로기반 통행배정 알고리즘의 구축 (A Development of a Path-Based Traffic Assignment Algorithm using Conjugate Gradient Method)

  • 강승모;권용석;박창호
    • 대한교통학회지
    • /
    • 제18권5호
    • /
    • pp.99-107
    • /
    • 2000
  • 경로기반 통행 배정은 실시간 통행 배정에서 이용되는 경로기반 해를 제공할 수 있기 때문에 첨단 교통 체계(ITS)의 실시간 교통 제어 및 교통 안내 등에 유용하게 이용될 수 있다. 많이 사용되고 있는 경로기반 통행배정 알고리즘의 하나인 Gradient Projection(GP) 알고리즘은 일반적으로 최적해 근처로는 빠른 접근 속도를 보이나. 일단 최적해에 근접하면 수렴 속도가 다소 느려지게되는 단점이 있다. 기존 알고리즘의 이러한 단점을 극복하기 위해 기존의 GP 알고리즘에 Conjugate Gradient 법을 결합시켜 보다 효율적인 경로기반 통행배정 알고리즘을 구축하였다. 이는 최적해 근처에서 더욱 정확한 이동방향을 결정하여 빠른 시간 내에 최적해를 도출해 내도록 하기 위한 것이다. 또한, 구축된 알고리즘을 가로망에 적용, 그 효율성을 검증하여 Conjugate Gradient 법이 통행 배정 모형의 사용자 평형 모형에서와 같은 목적함수의 경우에서도 매우 빠른 수렴을 위해 유용하게 쓰일 수 있다는 것을 보였다.

  • PDF

Nonlinear optimization algorithm using monotonically increasing quantization resolution

  • Jinwuk Seok;Jeong-Si Kim
    • ETRI Journal
    • /
    • 제45권1호
    • /
    • pp.119-130
    • /
    • 2023
  • We propose a quantized gradient search algorithm that can achieve global optimization by monotonically reducing the quantization step with respect to time when quantization is composed of integer or fixed-point fractional values applied to an optimization algorithm. According to the white noise hypothesis states, a quantization step is sufficiently small and the quantization is well defined, the round-off error caused by quantization can be regarded as a random variable with identically independent distribution. Thus, we rewrite the searching equation based on a gradient descent as a stochastic differential equation and obtain the monotonically decreasing rate of the quantization step, enabling the global optimization by stochastic analysis for deriving an objective function. Consequently, when the search equation is quantized by a monotonically decreasing quantization step, which suitably reduces the round-off error, we can derive the searching algorithm evolving from an optimization algorithm. Numerical simulations indicate that due to the property of quantization-based global optimization, the proposed algorithm shows better optimization performance on a search space to each iteration than the conventional algorithm with a higher success rate and fewer iterations.

전영역 탐색의 고속 움직임 예측에서 기울기 크기와 부 블록을 이용한 적응 매칭 스캔 알고리즘 (Adaptive Matching Scan Algorithm Based on Gradient Magnitude and Sub-blocks in Fast Motion Estimation of Full Search)

  • 김종남;최태선
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 1999년도 추계종합학술대회 논문집
    • /
    • pp.1097-1100
    • /
    • 1999
  • Due to the significant computation of full search in motion estimation, extensive research in fast motion estimation algorithms has been carried out. However, most of the algorithms have the degradation in predicted images compared with the full search algorithm. To reduce an amount of significant computation while keeping the same prediction quality of the full search, we propose a fast block-matching algorithm based on gradient magnitude of reference block without any degradation of predicted image. By using Taylor series expansion, we show that the block matching errors between reference block and candidate block are proportional to the gradient magnitude of matching block. With the derived result, we propose fast full search algorithm with adaptively determined scan direction in the block matching. Experimentally, our proposed algorithm is very efficient in terms of computational speedup and has the smallest computation among all the conventional full search algorithms. Therefore, our algorithm is useful in VLSI implementation of video encoder requiring real-time application.

  • PDF

Speed Gradient 알고리즘을 이용한 적응제어 (Adaptive Control Based on Speed-Gradient Algorithm)

  • 정사철;김진환;이정규;함운철
    • 전자공학회논문지B
    • /
    • 제31B권3호
    • /
    • pp.39-46
    • /
    • 1994
  • In this paper, three types of parameter update law which can be used in model reference adaptive control are suggested based on speed-gradient algorithm which was introduced by Fradkov. It is shown that the parameter update law which was proposed by Narendra is a special from of these laws and that proposed parameter update laws can insure the global stability under some conditions such as attainability and convexity. We also comment that the transfer function of reference model shoud be positive real for the realization of parameter update law.

  • PDF