• Title/Summary/Keyword: Backpropagation Algorithm

Search Result 351, Processing Time 0.026 seconds

A New Evolutionary Programming Algorithm using the Learning Rule of a Neural Network for Mutation of Individuals (신경회로망의 학습 알고리듬을 이용하여 돌연변이를 수행하는 새로운 진화 프로그래밍 알고리듬)

  • 임종화;최두현;황찬식
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.36C no.3
    • /
    • pp.58-64
    • /
    • 1999
  • Evolutionary programming is mainly characterized by two factors; one is the selection strategy and the other the mutation rule. In this paper, a new mutation rule that is the same form of well-known backpropagation learning rule of neural networks has been presented. The proposed mutation rule adapts the best individual's value as the target value at the generation. The temporal error improves the exploration through guiding the direction of evolution and the momentum speeds up convergence. The efficiency and robustness of the proposed algorithm have been verified through benchmark test functions.

  • PDF

Optimization of Transonic Airfoil Using GA Based on Neural Network and Multiple Regression Model (유전 알고리듬과 반응표면을 이용한 천음속 익형의 최적설계)

  • Kim, Yun-Sik;Kim, Jong-Hun;Lee, Jong-Soo
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.26 no.12
    • /
    • pp.2556-2564
    • /
    • 2002
  • The design of airfoil had practiced by repeat tests in its first stage, though an airfoil has as been designed based on simulations according to techniques of computational fluid dynamics. Here, using of traditional optimization is unsuitable because a state of flux is hypersensitive to the shape of airfoil. Therefore the paper optimized the shape of airfoil in transonic region using a genetic algorithm (GA). Response surfaces are based on back propagation neural network (BPN) and regression model. Training data of BPN and regression model were obtained by computational fluid dynamic analysis using CFD-ACE, and each analysis has been designed by design of experiments.

A Study on the Estimation of Earth Resistivity using Backpropagation Algorithm (역전파알고리즘을 이용한 대피저항율추정에 관한 연구)

  • Park, P.K.;Yu, B.H.;Seok, J.W.;Choi, J.K.;Jung, G.J.;Kim, J.H.
    • Proceedings of the KIEE Conference
    • /
    • 1997.11a
    • /
    • pp.203-205
    • /
    • 1997
  • In this paper, we present a useful method of estimating earth resistivity using BP algorithm in Neural-Networks. From this method, equivalent earth resistivity(EER) can be obtained directly using training data composed of field-measured apparent resistivity and probe distance. This approach can reduce errors which is conventionally raised from manual operation of calculating EER. To evaluate its accuracy and convenience, the result of proposed method is compared to that of conventional methods, graphical($\rho$-a graph) and numerical(CDEGS program), respectively.

  • PDF

An Adaptive Autopilot for Course-keeping and Track-keeping Control of Ships using Adaptive Neural Network (Part II: Simulation Study)

  • Nguyen Phung-Hung;Jung Yun-Chul
    • Journal of Navigation and Port Research
    • /
    • v.30 no.2
    • /
    • pp.119-124
    • /
    • 2006
  • In Part I(theoretical study) of the paper, a new adaptive autopilot for ships based on Adaptive Neural Networks was proposed. The ANNAI autopilot was designed for course-keeping, turning and track-keeping control for ships. In this part of the paper, to show the effectiveness and feasibility of the ANNAI autopilot and automatic selection algorithm for learning rate and number of iterations, computer simulations of course-keeping and track-keeping tasks with and without the effects of measurement noise and external disturbances are presented. Additionally, the results of the previous studies using Adaptive Neural Network by backpropagation algorithm are also showed for comparison.

Image Recognition by Learning Multi-Valued Logic Neural Network

  • Kim, Doo-Ywan;Chung, Hwan-Mook
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.2 no.3
    • /
    • pp.215-220
    • /
    • 2002
  • This paper proposes a method to apply the Backpropagation(BP) algorithm of MVL(Multi-Valued Logic) Neural Network to pattern recognition. It extracts the property of an object density about an original pattern necessary for pattern processing and makes the property of the object density mapped to MVL. In addition, because it team the pattern by using multiple valued logic, it can reduce time f3r pattern and space fer memory to a minimum. There is, however, a demerit that existed MVL cannot adapt the change of circumstance. Through changing input into MVL function, not direct input of an existed Multiple pattern, and making it each variable loam by neural network after calculating each variable into liter function. Error has been reduced and convergence speed has become fast.

Acoustic Impulse Method with Neural Network for Detection of Cracks in Eggshell (음향충격법과 인공신경망에 의한 파란 검출)

  • 최완규;조한근;백진하;장영창
    • Journal of Biosystems Engineering
    • /
    • v.23 no.6
    • /
    • pp.621-628
    • /
    • 1998
  • In order to develop an inspection algorithm for an automatic eggshell inspection system, acoustic impulse response with neural network method was studied. An improved error backpropagation algorithm was selected as a loaming rule of neural network, and three layer network was chosen for the neural network architecture. Acoustic signals in time domain and theirs power spectrum were studied as the input to the neural network. The classification feasibility and success rate were investigated in terms of statistical analysis and neural network approach. As a result, the success rate was 95% with the statistical model having five independent variables. Among the neural network models studied, the power spectrum of acoustic signal as the input with 64 input neurons and the two impact data showed the success rate of 95.5% which was slightly higher than of statistical analysis.

  • PDF

Neuro-Control of Nonlinear Systems Using Genetic Algorithms (Genetic Algorithms를 이용한 비선형 시스템의 신경망 제어)

  • Cho, Hyeon-Seob;Min, Jin-Kyoung;Ryu, In-Ho
    • Proceedings of the KAIS Fall Conference
    • /
    • 2006.05a
    • /
    • pp.316-319
    • /
    • 2006
  • Connectionist networks, also called neural networks, have been broadly applied to solve many different problems since McCulloch and Pitts had shown mathematically their information processing ability in 1943. In this thesis, we present a genetic neuro-control scheme for nonlinear systems. Our method is different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its training.

  • PDF

Dynamic Neural Units and Genetic Algorithms With Applications to the Control of Unknown Nonlinear Systems (미지의 비선형 시스템 제어를 위한 DNU와 GA알고리즘 적용에 관한 연구)

  • XiaoBing, Zhao;Min, Lin;Cho, Hyeon-Seob;Jeon, Jeong-Chay
    • Proceedings of the KIEE Conference
    • /
    • 2002.07d
    • /
    • pp.2486-2489
    • /
    • 2002
  • Pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our method is different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its training.

  • PDF

Multi-layer Neural Network with Hybrid Learning Rules for Improved Robust Capability (Robustness를 형성시키기 위한 Hybrid 학습법칙을 갖는 다층구조 신경회로망)

  • 정동규;이수영
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.8
    • /
    • pp.211-218
    • /
    • 1994
  • In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

  • PDF

Implementation of an automatic face recognition system using the object centroid (무게중심을 이용한 자동얼굴인식 시스템의 구현)

  • 풍의섭;김병화;안현식;김도현
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.33B no.8
    • /
    • pp.114-123
    • /
    • 1996
  • In this paper, we propose an automatic recognition algorithm using the object centroid of a facial image. First, we separate the facial image from the background image using the chroma-key technique and we find the centroid of the separated facial image. Second, we search nose in the facial image based on knowledge of human faces and the coordinate of the object centroid and, we calculate 17 feature parameters automatically. Finally, we recognize the facial image by using feature parameters in the neural networks which are trained through error backpropagation algorithm. It is illustrated by experiments by experiments using the proposed recogniton system that facial images can be recognized in spite of the variation of the size and the position of images.

  • PDF