• Title/Summary/Keyword: Backpropagation Algorithm

Search Result 350, Processing Time 0.027 seconds

Unknown Nonlinear Systems Control Using Genetic Algorithms (Geneo-tic Algorithms를 이용한 비선형 시스템 제어)

  • Cho, Hyun-Seob
    • Proceedings of the KAIS Fall Conference
    • /
    • 2009.05a
    • /
    • pp.443-445
    • /
    • 2009
  • Dynamic Neural Unit"(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin.

  • PDF

A hardware implementation of neural network with modified HANNIBAL architecture (수정된 하니발 구조를 이용한 신경회로망의 하드웨어 구현)

  • 이범엽;정덕진
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.45 no.3
    • /
    • pp.444-450
    • /
    • 1996
  • A digital hardware architecture for artificial neural network with learning capability is described in this paper. It is a modified hardware architecture known as HANNIBAL(Hardware Architecture for Neural Networks Implementing Back propagation Algorithm Learning). For implementing an efficient neural network hardware, we analyzed various type of multiplier which is major function block of neuro-processor cell. With this result, we design a efficient digital neural network hardware using serial/parallel multiplier, and test the operation. We also analyze the hardware efficiency with logic level simulation. (author). refs., figs., tabs.

  • PDF

Neural Network Algorithm Application to Auto-tuning of Dynamic Systems (동적시스템의 자동동조를 위한 신경망 알고리즘 응용)

  • Cho, Hyun-Seob
    • Proceedings of the KAIS Fall Conference
    • /
    • 2006.11a
    • /
    • pp.186-190
    • /
    • 2006
  • "Dynamic Neural Unit"(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin.

  • PDF

Pattern Recognition using Robust Feedforward Neural Networks (로버스트 다층전방향 신경망을 이용한 패턴인식)

  • Hwang, Chang-Ha;Kim, Sang-Min
    • Journal of the Korean Data and Information Science Society
    • /
    • v.9 no.2
    • /
    • pp.345-355
    • /
    • 1998
  • The back propagation(BP) algorithm allows multilayer feedforward neural networks to learn input-output mappings from training samples. It iteratively adjusts the network parameters(weights) to minimize the sum of squared approximation errors using a gradient descent technique. However, the mapping acquired through the BP algorithm may be corrupt when errorneous training data are employed. In this paper two types of robust backpropagation algorithms are discussed both from a theoretical point of view and in the case studies of nonlinear regression function estimation and handwritten Korean character recognition. For future research we suggest Bayesian learning approach to neural networks and compare it with two robust backpropagation algorithms.

  • PDF

Stream Data Processing based on Sliding Window at u-Health System (u-Health 시스템에서 슬라이딩 윈도우 기반 스트림 데이터 처리)

  • Kim, Tae-Yeun;Song, Byoung-Ho;Bae, Sang-Hyun
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.4 no.2
    • /
    • pp.103-110
    • /
    • 2011
  • It is necessary to accurate and efficient management for measured digital data from sensors in u-health system. It is not efficient that sensor network process input stream data of mass storage stored in database the same time. We propose to improve the processing performance of multidimensional stream data continuous incoming from multiple sensor. We propose process query based on sliding window for efficient input stream and found multiple query plan to Mjoin method and we reduce stored data using backpropagation algorithm. As a result, we obtained to efficient result about 18.3% reduction rate of database using 14,324 data sets.

Intelligent AQS System with Artificial Neural Network Algorithm and ATmega128 Chip in Automobile (신경회로망 알고리즘과 ATmega128칩을 활용한 자동차용 지능형 AQS 시스템)

  • Chung Wan-Young;Lee Seung-Chul
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.12 no.6
    • /
    • pp.539-546
    • /
    • 2006
  • The Air Quality Sensor(AQS), located near the fresh air inlet, serves to reduce the amount of pollution entering the vehicle cabin through the HVAC(heating, ventilating, and air conditioning) system by sending a signal to close the fresh air inlet door/ventilation flap when the vehicle enters a high pollution area. The sensor module which includes two independent sensing elements for responding to diesel and gasoline exhaust gases, and temperature sensor and humidity sensor was designed for intelligent AQS in automobile. With this sensor module, AVR microcontroller was designed with back propagation neural network to a powerful gas/vapor pattern recognition when the motor vehicles pass a pollution area. Momentum back propagation algorithm was used in this study instead of normal backpropagation to reduce the teaming time of neural network. The signal from neural network was modified to control the inlet of automobile and display the result or alarm the situation in this study. One chip microcontroller, ATmega 128L(ATmega Ltd., USA) was used for the control and display. And our developed system can intelligently reduce the malfunction of AQS from the dampness of air or dense fog with the backpropagation neural network and the input sensor module with four sensing elements such as reducing gas sensing element, oxidizing gas sensing element, temperature sensing element and humidity sensing element.

Anomaly Detection Performance Analysis of Neural Networks using Soundex Algorithm and N-gram Techniques based on System Calls (시스템 호출 기반의 사운덱스 알고리즘을 이용한 신경망과 N-gram 기법에 대한 이상 탐지 성능 분석)

  • Park, Bong-Goo
    • Journal of Internet Computing and Services
    • /
    • v.6 no.5
    • /
    • pp.45-56
    • /
    • 2005
  • The weak foundation of the computing environment caused information leakage and hacking to be uncontrollable, Therefore, dynamic control of security threats and real-time reaction to identical or similar types of accidents after intrusion are considered to be important, h one of the solutions to solve the problem, studies on intrusion detection systems are actively being conducted. To improve the anomaly IDS using system calls, this study focuses on neural networks learning using the soundex algorithm which is designed to change feature selection and variable length data into a fixed length learning pattern, That Is, by changing variable length sequential system call data into a fixed iength behavior pattern using the soundex algorithm, this study conducted neural networks learning by using a backpropagation algorithm. The backpropagation neural networks technique is applied for anomaly detection of system calls using Sendmail Data of UNM to demonstrate its performance.

  • PDF

A Fast-Loaming Algorithm for MLP in Pattern Recognition (패턴인식의 MLP 고속학습 알고리즘)

  • Lee, Tae-Seung;Choi, Ho-Jin
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.8 no.3
    • /
    • pp.344-355
    • /
    • 2002
  • Having a variety of good characteristics against other pattern recognition techniques, Multilayer Perceptron (MLP) has been used in wide applications. But, it is known that Error Backpropagation (EBP) algorithm which MLP uses in learning has a defect that requires relatively long leaning time. Because learning data in pattern recognition contain abundant redundancies, in order to increase learning speed it is very effective to use online-based teaming methods, which update parameters of MLP pattern by pattern. Typical online EBP algorithm applies fixed learning rate for each update of parameters. Though a large amount of speedup with online EBP can be obtained by choosing an appropriate fixed rate, fixing the rate leads to the problem that the algorithm cannot respond effectively to different leaning phases as the phases change and the learning pattern areas vary. To solve this problem, this paper defines learning as three phases and proposes a Instant Learning by Varying Rate and Skipping (ILVRS) method to reflect only necessary patterns when learning phases change. The basic concept of ILVRS is as follows. To discriminate and use necessary patterns which change as learning proceeds, (1) ILVRS uses a variable learning rate which is an error calculated from each pattern and is suppressed within a proper range, and (2) ILVRS bypasses unnecessary patterns in loaming phases. In this paper, an experimentation is conducted for speaker verification as an application of pattern recognition, and the results are presented to verify the performance of ILVRS.

Design of Neural Controller and Performance analysis for Piezoelectric Ultrasonic Motor (압전 초음파 모터의 성능분석과 신경망 제어기 설계)

  • Yu, Eun-Jae;Kim, Jeung-Do;Hong, Chul-Ho;Kim, Dong-Jin;Jeong, Yeong-Chang
    • Proceedings of the KIEE Conference
    • /
    • 2004.11c
    • /
    • pp.754-756
    • /
    • 2004
  • The ultrasonic piezo motor is a new type motor that has an excellent performance and many useful features that electromagnetic motors do not have. But, it suffers from severe system non-linearities and parameter variations especially during speed control. Therefore, it is difficult to accomplish satisfactory control performance by using the conventional PID controller. In this paper, to achieve the precise control, we analyzed response time & change with a driving time, and proposed PD controller combined with neural network. The backpropagation algorithm is used to train a given trajectory. The effectiveness of the used method is confirmed by experiments. The effectiveness of the used method is confirmed by experiments using the ultrasonic motor made in Korea.

  • PDF

BACKPROPAGATION BASED ON THE CONJUGATE GRADIENT METHOD WITH THE LINEAR SEARCH BY ORDER STATISTICS AND GOLDEN SECTION

  • Choe, Sang-Woong;Lee, Jin-Choon
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.107-112
    • /
    • 1998
  • In this paper, we propose a new paradigm (NEW_BP) to be capable of overcoming limitations of the traditional backpropagation(OLD_BP). NEW_BP is based on the method of conjugate gradients with the normalized direction vectors and computes step size through the linear search which may be characterized by order statistics and golden section. Simulation results showed that NEW_BP was definitely superior to both the stochastic OLD_BP and the deterministic OLD_BP in terms of accuracy and rate of convergence and might sumount the problem of local minima. Furthermore, they confirmed us that stagnant phenomenon of training in OLD_BP resulted from the limitations of its algorithm in itself and that unessential approaches would never cured it of this phenomenon.

  • PDF