• Title/Summary/Keyword: Error backpropagation

Search Result 133, Processing Time 0.032 seconds

A Estimated Neural Networks for Adaptive Cognition of Nonlinear Road Situations (굴곡있는 비선형 도로 노면의 최적 인식을 위한 평가 신경망)

  • Kim, Jong-Man;Kim, Young-Min;Hwang, Jong-Sun;Sin, Dong-Yong
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2002.11a
    • /
    • pp.573-577
    • /
    • 2002
  • A new estimated neural networks are proposed in order to measure nonlinear road environments in realtime. This new neural networks is Error Estimated Neural Networks. The structure of it is similar to recurrent neural networks; a delayed output as the input and a delayed error between the output of plant and neural networks as a bias input. In addition, we compute the desired value of hidden layer by an optimal method instead of transfering desired values by backpropagation and each weights are updated by RLS(Recursive Least Square). Consequently, this neural networks are not sensitive to initial weights and a learning rate, and have a faster convergence rate than conventional neural networks. We can estimate nonlinear models in realtime by the proposed networks and control nonlinear models. To show the performance of this one, we control 7 degree simulation, this controller and driver were proved to be effective to drive a car in the environments of nonlinear road systems.

  • PDF

A Design Method for Error Backpropagation neural networks using Voronoi Diagram (보로노이 공간분류를 이용한 오류 역전파 신경망의 설계방법)

  • 김홍기
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.9 no.5
    • /
    • pp.490-495
    • /
    • 1999
  • In this paper. a learning method VoD-EBP for neural networks is proposed, which learn patterns by error back propagation. Based on Voronoi diagram, the method initializes the weights of the neural networks systematically, wh~ch results in faster learning speed and alleviated local optimum problem. The method also shows better the reliability of the design of neural network because proper number of hidden nodes are determined from the analysis of Voronoi diagram. For testing the performance, this paper shows the results of solving the XOR problem and the parity problem. The results were showed faster learning speed than ordinary error back propagation algorithm. In solving the problem, local optimum problems have not been observed.

  • PDF

Software Quality Classification using Bayesian Classifier (베이지안 분류기를 이용한 소프트웨어 품질 분류)

  • Hong, Euy-Seok
    • Journal of Information Technology Services
    • /
    • v.11 no.1
    • /
    • pp.211-221
    • /
    • 2012
  • Many metric-based classification models have been proposed to predict fault-proneness of software module. This paper presents two prediction models using Bayesian classifier which is one of the most popular modern classification algorithms. Bayesian model based on Bayesian probability theory can be a promising technique for software quality prediction. This is due to the ability to represent uncertainty using probabilities and the ability to partly incorporate expert's knowledge into training data. The two models, Na$\ddot{i}$veBayes(NB) and Bayesian Belief Network(BBN), are constructed and dimensionality reduction of training data and test data are performed before model evaluation. Prediction accuracy of the model is evaluated using two prediction error measures, Type I error and Type II error, and compared with well-known prediction models, backpropagation neural network model and support vector machine model. The results show that the prediction performance of BBN model is slightly better than that of NB. For the data set with ambiguity, although the BBN model's prediction accuracy is not as good as the compared models, it achieves better performance than the compared models for the data set without ambiguity.

Design of a Neuro Observer for Reduction of Estimate Error (추정오차 저감을 위한 뉴로 관측기 설계)

  • Yoon, Kwang-Ho;Kim, Sang-Hoon;Ban, Gi-Jong;Choi, Sung-Dae;Park, Jin-Su;Kim, Lark-Kyo;Nam, Moon-Hyon
    • Proceedings of the KIEE Conference
    • /
    • 2004.11c
    • /
    • pp.693-695
    • /
    • 2004
  • Among modem control method, the observer is being used widely because it has the advantage of the guarantee of reliability on financial problem, over heating, and physical shock. However, an existing state observer and a sliding observer have such problems that an experimenter needs to know dynamics and parameters of the system. And also, the high gain observer has such a problem that it has transient state at the beginning of the observation. In this paper, the neuro observer is proposed to improve these problems. The proposed observer complement a problem that occur from increase of gain of High-gain observer in proportion to the square number of observable state variables. And also, the proposed observer can tune the gain obtained by differentiating observational error at transient state automatically by using the backpropagation training method to stabilize the observational speed. To prove a performance of the proposed observer, it is simulated that the comparison between the state estimate performance of the proposed observer and that of sliding, high gain observer is made by using a sinusoidal input to the observer which consists of four layers in stable 2nd order system.

  • PDF

A piecewise affine approximation of sigmoid activation functions in multi-layered perceptrons and a comparison with a quantization scheme (다중계층 퍼셉트론 내 Sigmoid 활성함수의 구간 선형 근사와 양자화 근사와의 비교)

  • 윤병문;신요안
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.2
    • /
    • pp.56-64
    • /
    • 1998
  • Multi-layered perceptrons that are a nonlinear neural network model, have been widely used for various applications mainly thanks to good function approximation capability for nonlinear fuctions. However, for digital hardware implementation of the multi-layere perceptrons, the quantization scheme using "look-up tables (LUTs)" is commonly employed to handle nonlinear signmoid activation functions in the neworks, and thus requires large amount of storage to prevent unacceptable quantization errors. This paper is concerned with a new effective methodology for digital hardware implementation of multi-layered perceptrons, and proposes a "piecewise affine approximation" method in which input domain is divided into (small number of) sub-intervals and nonlinear sigmoid function is linearly approximated within each sub-interval. Using the proposed method, we develop an expression and an error backpropagation type learning algorithm for a multi-layered perceptron, and compare the performance with the quantization method through Monte Carlo simulations on XOR problems. Simulation results show that, in terms of learning convergece, the proposed method with a small number of sub-intervals significantly outperforms the quantization method with a very large storage requirement. We expect from these results that the proposed method can be utilized in digital system implementation to significantly reduce the storage requirement, quantization error, and learning time of the quantization method.quantization method.

  • PDF

The Speed Control of an Induction Motor Based on Neural Networks (뉴럴 네트워크를 이용한 유도 전동기의 속도 제어)

  • Lee, Dong-Bin;Ryu, Chang-Wan;Hong, Dae-Seung;Ko, Jae-Ho;Yim, Wha-Yeong
    • Proceedings of the KIEE Conference
    • /
    • 1999.07b
    • /
    • pp.516-518
    • /
    • 1999
  • This paper presents an feed-forward neural network design instead PI controller for the speed control of an Induction Motor. The design employs the training strategy with Neural Network Controller(NNC) and Neural Network Emulator(NNE). Emulator identifies the motor by simulating the input and output map. In order to update the weights of the Controller. Emulator supplies the error path to the output stage of the controller using backpropagation algorithm. and then Controller produces an adequate output to the system due to neural networks learning capability. Therefore it becomes adjustable to the system with changing characteristics caused by a load. The speed control based on neural networks for induction motor is implemented by a vector controlled induction motor. The simulation results demonstrate that actual motor speed with neural network system well follows the reference speed minimizing the error and is available to implement on the vector control theory.

  • PDF

Design of a Neuro Observer for Reduction of Estimate Error (추정오차 저감을 위한 뉴로 관측기 설계)

  • Nam Moon-Hyon;Yoon Kwang-Ho
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.54 no.5
    • /
    • pp.285-290
    • /
    • 2005
  • The state observer is being used widely because it has the advantage of the guarantee of reliability on financial problem, over heating, and physical shock. However, an Luenberger observer and a Sliding observer have such problems that an experimenter needs to know dynamics and parameters of the system. And also, the high gain observer has such a problem that it has transient state at the beginning of the observation. In this paper, the Neuro observer is proposed to improve these problems. The proposed Neuro observer complement a problem that occur from increase of gain of High-gain observer in proportion to the square number of observable state variables. And also, the proposed Neuro observer can tune the gain obtained by differentiating observational error at transient state automatically by using the backpropagation training method to stabilize the observational speed. To prove a performance of the proposed observer, it is simulated that the comparison between the state estimate performance of the proposed observer and that of Sliding, High gain observer is made by using a sinusoidal input to the observer which consists of four layers in stable 2nd order system.

Efficient Learning Algorithm using Structural Hybrid of Multilayer Neural Networks and Gaussian Potential Function Networks (다층 신경회로망과 가우시안 포텐샬 함수 네트워크의 구조적 결합을 이용한 효율적인 학습 방법)

  • 박상봉;박래정;박철훈
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.19 no.12
    • /
    • pp.2418-2425
    • /
    • 1994
  • Although the error backpropagation(EBP) algorithm based on the gradient descent method is a widely-used learning algorithm of neural networks, learning sometimes takes a long time to acquire accuracy. This paper develops a novel learning method to alleviate the problems of EBP algorithm such as local minima, slow speed, and size of structure and thus to improve performance by adopting other new networks. Gaussian Potential Function networks(GPFN), in parallel with multilayer neural networks. Empirical simulations show the efficacy of the proposed algorithm in function approximation, which enables us to train networks faster with the better generalization capabilities.

  • PDF

A Study on Fatigue Damage Modeling Using Neural Networks

  • Lee Dong-Woo;Hong Soon-Hyeok;Cho Seok-Swoo;Joo Won-Sik
    • Journal of Mechanical Science and Technology
    • /
    • v.19 no.7
    • /
    • pp.1393-1404
    • /
    • 2005
  • Fatigue crack growth and life have been estimated based on established empirical equations. In this paper, an alternative method using artificial neural network (ANN) -based model developed to predict fatigue damages simultaneously. To learn and generalize the ANN, fatigue crack growth rate and life data were built up using in-plane bending fatigue test results. Single fracture mechanical parameter or nondestructive parameter can't predict fatigue damage accurately but multiple fracture mechanical parameters or nondestructive parameters can. Existing fatigue damage modeling used this merit but limited real-time damage monitoring. Therefore, this study shows fatigue damage model using backpropagation neural networks on the basis of X -ray half breadth ratio B / $B_o$, fractal dimension $D_f$ and fracture mechanical parameters can estimate fatigue crack growth rate da/ dN and cycle ratio N / $N_f$ at the same time within engineering limit error ($5\%$).

The Incremental Learning Method of Variable Slope Backpropagation Algorithm Using Representative Pattern (대표 패턴을 사용한 가변 기울기 역전도 알고리즘의 점진적 학습방법)

  • 심범식;윤충화
    • Journal of the Korea Society of Computer and Information
    • /
    • v.3 no.1
    • /
    • pp.95-112
    • /
    • 1998
  • The Error Backpropagation algorithm is widely used in various areas such as associative memory, speech recognition, pattern recognition, robotics and so on. However, if and when a new leaning pattern has to be added in order to drill, it will have to accomplish a new learning with all previous learning pattern and added pattern from the very beginning. Somehow, it brings about a result which is that the more it increases the number of pattern, the longer it geometrically progress the time required by leaning. Therefore, a so-called Incremental Learning Method has to be solved the point at issue all by means in case of situation which is periodically and additionally learned by numerous data. In this study, not only the existing neural network construction is still remained, but it also suggests a method which means executing through added leaning by a model pattern. Eventually, for a efficiency of suggested technique, both Monk's data and Iris data are applied to make use of benchmark on machine learning field.

  • PDF