• 제목/요약/키워드: gradient-descent method

Search Result 238, Processing Time 0.027 seconds

A on-line learning algorithm for recurrent neural networks using variational method (변분법을 이용한 재귀신경망의 온라인 학습)

  • Oh, Oh, Won-Geun;Suh, Suh, Byung-Suhl
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.2 no.1
    • /
    • pp.21-25
    • /
    • 1996
  • In this paper we suggest a general purpose RNN training algorithm which is derived on the optimal control concepts and variational methods. First, learning is regared as an optimal control problem, then using the variational methods we obtain optimal weights which are given by a two-point boundary-value problem. Finally, the modified gradient descent algorithm is applied to RNN for on-line training. This algorithm is intended to be used on learning complex dynamic mappings between time varing I/O data. It is useful for nonlinear control, identification, and signal processing application of RNN because its storage requirement is not high and on-line learning is possible. Simulation results for a nonlinear plant identification are illustrated.

  • PDF

Type-2 Fuzzy Neural Networks for Pattern recognition (패턴인식을 위한 Type-2 Fuzzy Neural Networks)

  • Ji, Kwang-Hee;Kim, Hyun-Ki;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 2009.07a
    • /
    • pp.1869_1870
    • /
    • 2009
  • 본 논문에서는 다항식 기반 Type-2 Fuzzy Neural Networks(T2FNN)를 설계하고 이를 패턴분류 문제에 적용하여 그 성능을 분석한다. T2FNN은 Fuzzy C-Means(FCM)을 Type-2 Fuzzy C-Means로 확장시킨 것이라 할 수 있으며, Input layer, Fuzzyification layer, Inference layer, Deffuzification layer의 4층 네트워크로 구성된다. interval Type-1 퍼지 집합인 후반부의 연결가중치는 Gradient Descent Method를 이용하여 학습한다. 제안된 RBF 신경회로망은 모의데이터와 패턴인식 성능 평가에 많이 사용되는 machine learning 데이터에 적용하여 패턴 분류기로서의 성능을 평가받는다.

  • PDF

A Study for the Improvement of Fault Detection on Fault Indicator using DWT and Neural Network (신경회로망과 DWT를 이용한 고장표시기의 고장검출 개선에 관한 연구)

  • Hong, Dae-Seung;Yim, Hwa-Young
    • Proceedings of the KIEE Conference
    • /
    • 2007.04c
    • /
    • pp.46-48
    • /
    • 2007
  • This paper presents research about improvement of fault detection algorithm in FRTU on the feeder of distribution system. FRTU(Feeder Remote Terminal Unit) is applied to fault detection schemes for phase fault, ground fault, and cold load pickup and Inrush restraint functions distinguish the fault current and the normal load current. FRTU is occurred FI(Fault Indicator) when current is over pick-up value also inrush current is occurred FRTU indicate FI. Discrete wavelet transform(DWT) analysis gives the frequency and time-scale information. The neural network system as a fault detector was trained to discriminate inrush current from the fault status by a gradient descent method. In this paper, fault detection is improved using voltage monitoring system with DWT and neural network. These data were measured in actual 22.9kV distribution system.

  • PDF

Face Recognition Based on Improved Fuzzy RBF Neural Network for Smar t Device

  • Lee, Eung-Joo
    • Journal of Korea Multimedia Society
    • /
    • v.16 no.11
    • /
    • pp.1338-1347
    • /
    • 2013
  • Face recognition is a science of automatically identifying individuals based their unique facial features. In order to avoid overfitting and reduce the computational reduce the computational burden, a new face recognition algorithm using PCA-fisher linear discriminant (PCA-FLD) and fuzzy radial basis function neural network (RBFNN) is proposed in this paper. First, face features are extracted by the principal component analysis (PCA) method. Then, the extracted features are further processed by the Fisher's linear discriminant technique to acquire lower-dimensional discriminant patterns, the processed features will be considered as the input of the fuzzy RBFNN. As a widely applied algorithm in fuzzy RBF neural network, BP learning algorithm has the low rate of convergence, therefore, an improved learning algorithm based on Levenberg-Marquart (L-M) for fuzzy RBF neural network is introduced in this paper, which combined the Gradient Descent algorithm with the Gauss-Newton algorithm. Experimental results on the ORL face database demonstrate that the proposed algorithm has satisfactory performance and high recognition rate.

Stable Wavelet Based Fuzzy Neural Network for the Identification of Nonlinear Systems (비선형 시스템의 동정을 위한 안정한 웨이블릿 기반 퍼지 뉴럴 네트워크)

  • Oh, Joon-Seop;Park, Jin-Bae;Choi, Yoon-Ho
    • Proceedings of the KIEE Conference
    • /
    • 2005.07d
    • /
    • pp.2681-2683
    • /
    • 2005
  • In this paper, we present the structure of fuzzy neural network(FNN) based on wavelet function, and apply this network structure to the identification of nonlinear systems. For adjusting the shape of membership function and the connection weights, the parameter learning method based on the gradient descent scheme is adopted. And an approach that uses adaptive learning rates is driven via a Lyapunov stability analysis to guarantee the fast convergence. Finally, to verify the efficiency of our network structure. we compare the Identification performance of proposed wavelet based fuzzy neural network(WFNN) with those of the FNN, the wavelet fuzzy model(WFM) and the wavelet neural network(WNN) through the computer simulation.

  • PDF

Fuzzy logic control of a planar parallel manipulator using multi learning algorithm (다중 학습 알고리듬을 이용한 평면형 병렬 매니퓰레이터의 Fuzzy 논리 제어)

  • Song, Nak-Yun;Cho, Whang
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.5 no.8
    • /
    • pp.914-922
    • /
    • 1999
  • A study on the improvement of tracking performance of a 3 DOF planar parallel manipulator is performed. A class of adaptive tracking control sheme is designed using self tuning adaptive fuzzy logic control theory. This control sheme is composed of three classical PD controller and a multi learning type self tuning adaptive fuzzy logic controller set. PD controller is tuned roughly by manual setting a priori and fuzzy logic controller is tuned precisely by the gradient descent method for a global solution during run-time, so the proposed control scheme is tuned more rapidly and precisely than the single learning type self tuning adaptive fuzzy logic control sheme for a local solution. The control performance of the proposed algorithm is verified through experiments.

  • PDF

Model Predictive Control of Discrete-Time Chaotic Systems Using Neural Network (신경회로망을 이용한 이산치 혼돈 시스템의 모델 예측제어)

  • Kim, Se-Min;Choi, Yoon-Ho;Park, Jin-Bae;Joo, Young-Hoon
    • Proceedings of the KIEE Conference
    • /
    • 1999.07b
    • /
    • pp.933-935
    • /
    • 1999
  • In this paper, we present model predictive control scheme based on neural network to control discrete-time chaotic systems. We use a feedforward neural network as nonlinear prediction model. The training algorithm used is an adaptive backpropagation algorithm that tunes the connection weights. And control signal is obtained by using gradient descent (GD), some kind of LMS method. We identify that the system identification results through model prediction control have a great effect on control performance. Finally, simulation results show that the proposed control algorithm performs much better than the conventional controller.

  • PDF

Congestion Control of TCP Network Using a Self-Recurrent Wavelet Neural Network (자기회귀 웨이블릿 신경 회로망을 이용한 TCP 네트워크 혼잡제어)

  • Kim, Jae-Man;Park, Jin-Bae;Choi, Yoon-Ha
    • Proceedings of the KIEE Conference
    • /
    • 2005.10b
    • /
    • pp.325-327
    • /
    • 2005
  • In this paper, we propose the design of active queue management (AQM) control system using the self-recurrent wavelet neural network (SRWNN). By regulating the queue length close to reference value, AQM can control the congestions in TCP network. The SRWNN is designed to perform as a feedback controller for TCP dynamics. The parameters of network are tunes to minimize the difference between the queue length of TCP dynamic model and the output of SRWNN using gradient-descent method. We evaluate the performances of the proposed AQM approach through computer simulations.

  • PDF

A Study on the Eccentricity Compensation of Optical Disk Using a Wavelet Neural Network (웨이블릿 신경 회로망을 이용한 광디스크 드라이브의 편심 보상에 관한 연구)

  • Joo, Byung-Jae;Park, Jin-Bae;Choi, Yoon-Ho
    • Proceedings of the KIEE Conference
    • /
    • 2004.07d
    • /
    • pp.2613-2615
    • /
    • 2004
  • 본 논문에서는 광학 디스크 기기의 주기적인 외란인 편심 보상을 위해 웨이블릿 신경 회로망 기반 외란 모델로 구성된 순방향 오차 제거(feedforward error rejection) 방법을 제안한다. 신호 모델링 방법으로 사용되어진 신경 회로망 모델의 단점인 실시간 처리 능력 및 국부 최소치로의 가능성 등을 극복하며 주파수와 시간 영역에서의 우수한 신호 해석 능력을 가진 웨이블릿 변환의 장점을 가진 웨이블릿 신경 회로망을 이용하여 디스크의 외란을 모델링 한다. 웨이블릿 신경회로망은 경사 강하법 (gradient descent method)을 이용하여 학습하며, 본 논문에서 제안한 방법의 효율성을 검증하기 위해 실제 광학 디스크 기기의 외란 데이터를 이용한 컴퓨터 모의 실험을 수행한다.

  • PDF

Vehicle Face Recognition Algorithm Based on Weighted Nonnegative Matrix Factorization with Double Regularization Terms

  • Shi, Chunhe;Wu, Chengdong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.5
    • /
    • pp.2171-2185
    • /
    • 2020
  • In order to judge that whether the vehicles in different images which are captured by surveillance cameras represent the same vehicle or not, we proposed a novel vehicle face recognition algorithm based on improved Nonnegative Matrix Factorization (NMF), different from traditional vehicle recognition algorithms, there are fewer effective features in vehicle face image than in whole vehicle image in general, which brings certain difficulty to recognition. The innovations mainly include the following two aspects: 1) we proposed a novel idea that the vehicle type can be determined by a few key regions of the vehicle face such as logo, grille and so on; 2) Through adding weight, sparseness and classification property constraints to the NMF model, we can acquire the effective feature bases that represent the key regions of vehicle face image. Experimental results show that the proposed algorithm not only achieve a high correct recognition rate, but also has a strong robustness to some non-cooperative factors such as illumination variation.