• Title/Summary/Keyword: Back-propagation learning

Search Result 528, Processing Time 0.023 seconds

Self-Relaxation for Multilayer Perceptron

  • Liou, Cheng-Yuan;Chen, Hwann-Txong
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.113-117
    • /
    • 1998
  • We propose a way to show the inherent learning complexity for the multilayer perceptron. We display the solution space and the error surfaces on the input space of a single neuron with two inputs. The evolution of its weights will follow one of the two error surfaces. We observe that when we use the back-propagation(BP) learning algorithm (1), the wight cam not jump to the lower error surface due to the implicit continuity constraint on the changes of weight. The self-relaxation approach is to explicity find out the best combination of all neurons' two error surfaces. The time complexity of training a multilayer perceptron by self-relaxationis exponential to the number of neurons.

  • PDF

Development of Fuzzy-Neural Control Algorithm for the Motion Control of K1-Track Vehicle (K1-궤도차량의 운동제어를 위한 퍼지-뉴럴제어 알고리즘 개발)

  • 한성현
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 1997.10a
    • /
    • pp.70-75
    • /
    • 1997
  • This paper proposes a new approach to the design of fuzzy-neuro control for track vehicle system using fuzzy logic based on neural network. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based of independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is illustrated by simulation for trajectory tracking of track vehicle speed.

  • PDF

Application of Neural Networks For Estimating Evapotranspiration

  • Lee, Nam-Ho
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 1993.10a
    • /
    • pp.1273-1281
    • /
    • 1993
  • Estimation of daily and seasonal evaportranspiration is essential for water resource planning irrigation feasibility study, and real-time irrigation water management . This paper is to evaluate the applicability of neural networks to the estimation of evapotranspiration . A neural network was developed to forecast daily evapotranspiration of the rice crop. It is a three-layer network with input, hidden , and output layers. Back-propagation algorithm with delta learning rule was used to train the neural network. Training neural network wasconducted usign daily actural evapotranspiration of rice crop and daily climatic data such as mean temperature, sunshine hours, solar radiation, relative humidity , and pan evaporation . During the training, neural network parameters were calibrated. The trained network was applied to a set of field data not used in the training . The created response of the neural network was in good agreement with desired values. Evaluating the neural networ performance indicates that neural network may be applied to the estimation of evapotranspiration of the rice crop.

  • PDF

Dynamic Control of Track Vehicle Using Fuzzy-Neural Control Method (퍼지-뉴럴 제어기법에 의한 궤도차량의 동적 제어)

  • 한성현;서운학;조길수;윤강섭
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1997.04a
    • /
    • pp.133-139
    • /
    • 1997
  • This paper presents a new approach to the dynamic control technique for track vehicle system using neural network-fuzzy control method. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is propored a learning controller consisting of two neural network-fuzzy based on independent resoning and a connection net with fixed weights to simply the neural network-fuzzy. The performance of the proposed controller is shown by simulation for trajectory tracking of the speed and azimuth of a track vehicle

  • PDF

Self-learning control of nonlinear system using Back-propagation neural networks. (Back-Propagation 신경 회로망을 이용한 비선형 시스템의 자기 학습 제어)

  • Park, C.H.;Song, H.S.;Lee, J.T.;Park, Y.S.
    • Proceedings of the KIEE Conference
    • /
    • 1992.07a
    • /
    • pp.231-235
    • /
    • 1992
  • A new algorithm is proposed to identify the structure and the parameters of the nonlinear discrete-time plant with only the unknown dynamics and the weak informations about its structure. The proposed algorithm is constructed with the compensation method of weghing values using its previous derivatives and with the efficient technique updating self-learning coefficients. The result in this application is thought to prove the effectiveness of the algorithm proposed in this paper and its superiority to the conventional ones.

  • PDF

A Study on the Neuro-Fuzzy Control and Its Application

  • So, Myung-Ok;Yoo, Heui-Han;Jin, Sun-Ho
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.28 no.2
    • /
    • pp.228-236
    • /
    • 2004
  • In this paper. we present a neuro-fuzzy controller which unifies both fuzzy logic and multi-layered feed forward neural networks. Fuzzy logic provides a means for converting linguistic control knowledge into control actions. On the other hand. feed forward neural networks provide salient features. such as learning and parallelism. In the proposed neuro-fuzzy controller. the parameters of membership functions in the antecedent part of fuzzy inference rules are identified by using the error back propagation algorithm as a learning rule. while the coefficients of the linear combination of input variables in the consequent part are determined by using the least square estimation method. Finally. the effectiveness of the proposed controller is verified through computer simulation for an inverted pole system.

Design and Performance Evaluation of a Neural Network based Adaptive Filter for Application of Digital Controller (디지털 제어기용 적응 신경망 필터의 설계 및 성능평가)

  • 김진선;신우철;홍준희
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2004.10a
    • /
    • pp.345-351
    • /
    • 2004
  • This Paper describes a nonlinear adaptive noise filter using neural network for digital controller system. Back-Propagation Learning Algorithm based MLP (Multi Layer Perceptron)is used an adaptive filters. In this paper. it assume that the noise of primary input in the adaptive noise canceller is not the same characteristic as that of the reference input. Experimental reaults show that the neural network base noise canceller outperforms the linear noise canceller. Especially to make noise cancel close to realtime, Primary input is divided by unit and each divided part is processed for very short time than all the processed data are unified to whole data.

  • PDF

Development of a Neural-Fuzzy Control Algorithm for Dynamic Control of a Track Vehicle (궤도차량의 동적 제어를 위한 퍼지-뉴런 제어 알고리즘 개발)

  • 서운학
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 1999.10a
    • /
    • pp.142-147
    • /
    • 1999
  • This paper presents a new approach to the dynamic control technique for track vehicle system using neural network-fuzzy control method. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by simulation for trajectory tracking of the speed and azimuth of a track vehicle.

  • PDF

Implementation of Speed-Sensorless Induction Motor Drives with RLS Algorithm (RLS 알로리즘을 이용한 유도전동기의 속도 센서리스 운전)

  • 김윤호;국윤상
    • Proceedings of the KIPE Conference
    • /
    • 1998.07a
    • /
    • pp.384-387
    • /
    • 1998
  • This paper presents a newly developed speed sensorless drive using RLS(Recursive Least Squares) based on Neural Network Training Algorithm. The proposed algorithm based on the RLS has just the time-varying learning rate, while the well-known back-propagation (or generalized delta rule) algorithm based on gradient descent has a constant learning rate. The number of iterations required by the new algorithm to converge is less than that of the back-propagation algorithm. The RLS based on NN is used to adjust the motor speed so that the neural model output follows the desired trajectory. This mechanism forces the estimated speed to follow precisely the actual motor speed. In this paper, a flux estimation strategy using filter concept is discussed. The theoretical analysis and experimental results to verify the effectiveness of the proposed analysis and the proposed control strategy are described.

  • PDF

Improved Error Backpropagation Algorithm using Modified Activation Function Derivative (수정된 Activation Function Derivative를 이용한 오류 역전파 알고리즘의 개선)

  • 권희용;황희영
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.41 no.3
    • /
    • pp.274-280
    • /
    • 1992
  • In this paper, an Improved Error Back Propagation Algorithm is introduced, which avoids Network Paralysis, one of the problems of the Error Backpropagation learning rule. For this purpose, we analyzed the reason for Network Paralysis and modified the Activation Function Derivative of the standard Error Backpropagation Algorithm which is regarded as the cause of the phenomenon. The characteristics of the modified Activation Function Derivative is analyzed. The performance of the modified Error Backpropagation Algorithm is shown to be better than that of the standard Error Back Propagation algorithm by various experiments.

  • PDF