• 제목/요약/키워드: Backpropagation neural networks

검색결과 230건 처리시간 0.026초

병렬 자구성 계층 신경망 (PSHINN)의 구조 (Architectures of the Parallel, Self-Organizing Hierarchical Neural Networks)

  • 윤영우;문태현;홍대식;강창언
    • 전자공학회논문지B
    • /
    • 제31B권1호
    • /
    • pp.88-98
    • /
    • 1994
  • A new neural network architecture called the Parallel. Self-Organizing Hierarchical Neural Network (PSHNN) is presented. The new architecture involves a number of stages in which each stage can be a particular neural network (SNN). The experiments performed in comparison to multi-layered network with backpropagation training and indicated the superiority of the new architecture in the sense of classification accuracy, training time,parallelism.

  • PDF

GRADIENTS IN A DEEP NEURAL NETWORK AND THEIR PYTHON IMPLEMENTATIONS

  • Park, Young Ho
    • Korean Journal of Mathematics
    • /
    • 제30권1호
    • /
    • pp.131-146
    • /
    • 2022
  • This is an expository article about the gradients in deep neural network. It is hard to find a place where gradients in a deep neural network are dealt in details in a systematic and mathematical way. We review and compute the gradients and Jacobians to derive formulas for gradients which appear in the backpropagation and implement them in vectorized forms in Python.

이동구간 최적 제어에 의한 전력계통 안정화의 분산제어 접근 방법 (A Decentralized Approach to Power System Stabilization by Artificial Neural Network Based Receding Horizon Optimal Control)

  • 최면송
    • 대한전기학회논문지:전력기술부문A
    • /
    • 제48권7호
    • /
    • pp.815-823
    • /
    • 1999
  • This study considers an implementation of artificial neural networks to the receding horizon optimal control and is applications to power systems. The Generalized Backpropagation-Through-Time (GBTT) algorithm is presented to deal with a quadratic cost function defined in a finite-time horizon. A decentralized approach is used to control the complex global system with simpler local controllers that need only local information. A Neural network based Receding horizon Optimal Control (NROC) 1aw is derived for the local nonlinear systems. The proposed NROC scheme is implemented with two artificial neural networks, Identification Neural Network (IDNN) and Optimal Control Neural Network (OCNN). The proposed NROC is applied to a power system to improve the damping of the low-frequency oscillation. The simulation results show that the NROC based power system stabilizer performs well with good damping for different loading conditions and fault types.

  • PDF

CPU 기반의 딥러닝 컨볼루션 신경망을 이용한 이륜 차량 번호판 인식 알고리즘 (Twowheeled Motor Vehicle License Plate Recognition Algorithm using CPU based Deep Learning Convolutional Neural Network)

  • 김진호
    • 디지털산업정보학회논문지
    • /
    • 제19권4호
    • /
    • pp.127-136
    • /
    • 2023
  • Many research results on the traffic enforcement of illegal driving of twowheeled motor vehicles using license plate recognition are introduced. Deep learning convolutional neural networks can be used for character and word recognition of license plates because of better generalization capability compared to traditional Backpropagation neural networks. In the plates of twowheeled motor vehicles, the interdependent government and city words are included. If we implement the mutually independent word recognizers using error correction rules for two word recognition results, efficient license plate recognition results can be derived. The CPU based convolutional neural network without library under real time processing has an advantage of low cost real application compared to GPU based convolutional neural network with library. In this paper twowheeled motor vehicle license plate recognition algorithm is introduced using CPU based deep-learning convolutional neural network. The experimental results show that the proposed plate recognizer has 96.2% success rate for outdoor twowheeled motor vehicle images in real time.

사운덱스 알고리즘을 적용한 신경망라 뉴로-처지 기법의 호스트 이상 탐지 (Host Anomaly Detection of Neural Networks and Neural-fuzzy Techniques with Soundex Algorithm)

  • 차병래;김형종;박봉구;조혁현
    • 정보보호학회논문지
    • /
    • 제15권2호
    • /
    • pp.13-22
    • /
    • 2005
  • 본 논문에서는 시스템 호출을 이용하여 이상 침입 탐지 시스템의 성능을 향상시키기 위해, 특징 선택과 가변 길이 데이터를 고정 길이 학습 패턴으로 변환 생성하는 문제를 해결하기 위한 사운덱스 알고리즘을 적용한 신경망 학습을 통하여 이상 침입 탐지의 연구를 하고자 한다. 즉, 가변 길이의 순차적인 시스템 호출 데이터를 사운덱스 알고리즘에 의한 고정 길이의 행위 패턴을 생성하여 역전파 알고리즘과 퍼지 멤버쉽 함수에 의해 신경망 학습을 수행하였다. 역전파 신경망과 뉴로-퍼지 기법을 UNM의 Sendmail Data Set을 이용하여 시스템 호출의 이상침입 탐지에 적용하여 시간과 공간 복잡도 그리고 MDL 측면에서 성능을 검증하였다.

원자력발전소 증기발생기의 인공지능 모델링에 관한 연구 (Intelligent Modeling of Nuclear Power Plant Steam Generator)

  • 최진영;이재기
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1997년도 추계학술대회 논문집 학회본부
    • /
    • pp.675-678
    • /
    • 1997
  • In this research we continue the study of nuclear power plant steam generator's intelligent modeling. This model represents the input-output behavior and is a preliminary stage for intelligent control. Among many intelligent models available, we study neural network models that have been proven as universal function approximators. We select multilayer perceptrons, circular backpropagation networks, piecewise linearly trained networks and recurrent neural networks as the candidates for the steam generator's intelligent models. We take the input-output pairs from steam generator's reference model and train the neural network models. We validate trained neural network models as intelligent models of steam generator.

  • PDF

FNN에 기초한 Fuzzy Self-organizing Neural Network(FSONN)의 구조와 알고리즘의 구현 (The Implementation of the structure and algorithm of Fuzzy Self-organizing Neural Networks(FSONN) based on FNN)

  • 김동원;박병준;오성권
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2000년도 춘계학술대회 학술발표 논문집
    • /
    • pp.114-117
    • /
    • 2000
  • In this paper, Fuzzy Self-organizing Neural Networks(FSONN) based on Fuzzy Neural Networks(FNN) is proposed to overcome some problems, such as the conflict between ovefitting and good generation, and low reliability. The proposed FSONN consists of FNN and SONN. Here, FNN is used as the premise part of FSONN and SONN is the consequnt part of FSONN. The FUN plays the preceding role of FSONN. For the fuzzy reasoning and learning method in FNN, Simplified fuzzy reasoning and backpropagation learning rule are utilized. The number of layers and the number of nodes in each layers of SONN that is based on the GMDH method are not predetermined, unlike in the case of the popular multi layer perceptron structure and can be generated. Also the partial descriptions of nodes can use various forms such as linear, modified quadratic, cubic, high-order polynomial and so on. In this paper, the optimal design procedure of the proposed FSONN is shown in each step and performance index related to approximation and generalization capabilities of model is evaluated and also discussed.

  • PDF

신경망이론을 이용한 소유역에서의 장기 유출 해석(수공) (Long Term Streamflow Forecasting in Small Watershed using Artificial Neural Network)

  • 강문성;박승우
    • 한국농공학회:학술대회논문집
    • /
    • 한국농공학회 2000년도 학술발표회 발표논문집
    • /
    • pp.384-389
    • /
    • 2000
  • A artificial neural network model was developed to analyze and forecast the flow fluctuation at small streams in the Balan watershed. Backpropagation neural networks were found to perform very well in forecasting daily streamflows. In order to deal with slow convergence and an appropriate structure, two algorithms were proposed for speeding up the convergence of the backpropagation method, and the Bayesian Information Criterion(BIC) was proposed for obtaining the optimal number of hidden nodes. From simulations using daily flows at the HS#3 watershed of the Balan Watershed Project, which is 412,5 ㏊ in size and relatively steep in landscape, it was found that those algorithms perform satisfactorily.

  • PDF

자기조직화 지도를 이용한 반도체 패키지 내부결함의 패턴분류 알고리즘 개발 (The Development of Pattern Classification for Inner Defects in Semiconductor packages by Self-Organizing map)

  • 김재열;윤성운;김훈조;김창현;송경석;양동조
    • 한국공작기계학회:학술대회논문집
    • /
    • 한국공작기계학회 2002년도 추계학술대회 논문집
    • /
    • pp.80-84
    • /
    • 2002
  • In this study, researchers developed the est algorithm for artificial defects in the semic packages and performed to it by pattern recogn technology. For this purpose, this algorithm was I that researcher made software with matlab. The so consists of some procedures including ultrasonic acquistion, equalization filtering, self-organizing backpropagation neural network. self-organizing ma backpropagation neural network are belong to metho neural networks. And the pattern recognition tech has applied to classify three kinds of detective pa semiconductor packages. that is, crack, delaminat normal. According to the results, it was found estimative algorithm was provided the recognition r 75.7%( for crack) and 83.4%( for delamination) 87.2 % ( for normal).

  • PDF

신경망 학습 변수의 시변 제어에 관한 연구 (A study on time-varying control of learning parameters in neural networks)

  • 박종철;원상철;최한고
    • 융합신호처리학회 학술대회논문집
    • /
    • 한국신호처리시스템학회 2000년도 추계종합학술대회논문집
    • /
    • pp.201-204
    • /
    • 2000
  • This paper describes a study on the time-varying control of parameters in learning of the neural network. Elman recurrent neural network (RNN) is used to implement the control of parameters. The parameters of learning and momentum rates In the error backpropagation algorithm ate updated at every iteration using fuzzy rules based on performance index. In addition, the gain and slope of the neuron's activation function are also considered time-varying parameters. These function parameters are updated using the gradient descent algorithm. Simulation results show that the auto-tuned learning algorithm results in faster convergence and lower system error than regular backpropagation in the system identification.

  • PDF