• Title/Summary/Keyword: recurrent neural network model

Search Result 353, Processing Time 0.039 seconds

Stable Predictive Control of Chaotic Systems Using Self-Recurrent Wavelet Neural Network

  • Yoo Sung Jin;Park Jin Bae;Choi Yoon Ho
    • International Journal of Control, Automation, and Systems
    • /
    • v.3 no.1
    • /
    • pp.43-55
    • /
    • 2005
  • In this paper, a predictive control method using self-recurrent wavelet neural network (SRWNN) is proposed for chaotic systems. Since the SRWNN has a self-recurrent mother wavelet layer, it can well attract the complex nonlinear system though the SRWNN has less mother wavelet nodes than the wavelet neural network (WNN). Thus, the SRWNN is used as a model predictor for predicting the dynamic property of chaotic systems. The gradient descent method with the adaptive learning rates is applied to train the parameters of the SRWNN based predictor and controller. The adaptive learning rates are derived from the discrete Lyapunov stability theorem, which are used to guarantee the convergence of the predictive controller. Finally, the chaotic systems are provided to demonstrate the effectiveness of the proposed control strategy.

Adaptive PID controller based on error self-recurrent neural networks (오차 자기순환 신경회로망에 기초한 적응 PID제어기)

  • Lee, Chang-Goo;Shin, Dong-Young
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.4 no.2
    • /
    • pp.209-214
    • /
    • 1998
  • In this paper, we are dealing with the problem of controlling unknown nonlinear dynamical system by using neural networks. A novel error self-recurrent(ESR) neural model is presented to perform black-box identification. Through the various outcome of the experiment, a new neural network is seen to be considerably faster than the BP algorithm and has advantages of being less affected by poor initial weights and learning rate. These characteristics make it flexible to design the controller in real-time based on neural networks model. In addition, we design an adaptive PID controller that Keyser suggested by using ESR neural networks, and present a method on the implementation of adaptive controller based on neural network for practical applications. We obtained good results in the case of robot manipulator experiment.

  • PDF

Robust Position Control for PMLSM Using Friction Parameter Observer and Adaptive Recurrent Fuzzy Neural Network (마찰변수 관측기와 적응순환형 퍼지신경망을 이용한 PMLSM의 강인한 위치제어)

  • Han, Seong-Ik;Rye, Dae-Yeon;Kim, Sae-Han;Lee, Kwon-Soon
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.19 no.2
    • /
    • pp.241-250
    • /
    • 2010
  • A recurrent adaptive model-free intelligent control with a friction estimation law is proposed to enhance the positioning performance of the mover in PMLSM system. For the PMLSM with nonlinear friction and uncertainty, an adaptive recurrent fuzzy neural network(ARFNN) and compensated control law in $H_{\infty}$ performance criterion are designed to mimic a perfect control law and compensate the approximated error between ideal controller and ARFNN. Combined with friction observer to estimate nonlinear friction parameters of the LuGre model, on-line adaptive laws of the controller and observer are derived based on the Lyapunov stability criterion. To analyze the effectiveness our control scheme, some simulations for the PMLSM with nonlinear friction and uncertainty were executed.

Automatic Evaluation of Elementary School English Writing Based on Recurrent Neural Network Language Model (순환 신경망 기반 언어 모델을 활용한 초등 영어 글쓰기 자동 평가)

  • Park, Youngki
    • Journal of The Korean Association of Information Education
    • /
    • v.21 no.2
    • /
    • pp.161-169
    • /
    • 2017
  • We often use spellcheckers in order to correct the syntactic errors in our documents. However, these computer programs are not enough for elementary school students, because their sentences are not smooth even after correcting the syntactic errors in many cases. In this paper, we introduce an automated method for evaluating the smoothness of two synonymous sentences. This method uses a recurrent neural network to solve the problem of long-term dependencies and exploits subwords to cope with the rare word problem. We trained the recurrent neural network language model based on a monolingual corpus of about two million English sentences. In our experiments, the trained model successfully selected the more smooth sentences for all of nine types of test set. We expect that our approach will help in elementary school writing after being implemented as an application for smart devices.

An Intrusion Detection Model based on a Convolutional Neural Network

  • Kim, Jiyeon;Shin, Yulim;Choi, Eunjung
    • Journal of Multimedia Information System
    • /
    • v.6 no.4
    • /
    • pp.165-172
    • /
    • 2019
  • Machine-learning techniques have been actively employed to information security in recent years. Traditional rule-based security solutions are vulnerable to advanced attacks due to unpredictable behaviors and unknown vulnerabilities. By employing ML techniques, we are able to develop intrusion detection systems (IDS) based on anomaly detection instead of misuse detection. Moreover, threshold issues in anomaly detection can also be resolved through machine-learning. There are very few datasets for network intrusion detection compared to datasets for malicious code. KDD CUP 99 (KDD) is the most widely used dataset for the evaluation of IDS. Numerous studies on ML-based IDS have been using KDD or the upgraded versions of KDD. In this work, we develop an IDS model using CSE-CIC-IDS 2018, a dataset containing the most up-to-date common network attacks. We employ deep-learning techniques and develop a convolutional neural network (CNN) model for CSE-CIC-IDS 2018. We then evaluate its performance comparing with a recurrent neural network (RNN) model. Our experimental results show that the performance of our CNN model is higher than that of the RNN model when applied to CSE-CIC-IDS 2018 dataset. Furthermore, we suggest a way of improving the performance of our model.

A Study on the Intelligent Position Control System Using Sliding Mode and Friction Observer (슬라이딩 모드와 마찰관측기를 이용한 강인한 지능형 위치 제어시스템 연구)

  • Han, Seong-Ik;Lee, Yong-Jin;Lee, Kwon-Soon;Nam, Hyun-Do
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.59 no.2
    • /
    • pp.163-172
    • /
    • 2010
  • A robust positioning control system has been studied using a friction parameter observer and a recurrent fuzzy neural network based on the sliding model. To estimate a nonlinear friction parameters of the LuGre friction model, a dual friction model-based observer is introduced. In addition, an approximating method for a system uncertainty has been developed using a recurrent fuzzy neural network technique to improve positioning performance. Experimental results have been presented to validate the performance of a proposed intelligent compensation scheme.

Self-Recurrent Wavelet Neural Network Based Adaptive Backstepping Control for Steering Control of an Autonomous Underwater Vehicle (수중 자율 운동체의 방향 제어를 위한 자기회귀 웨이블릿 신경회로망 기반 적응 백스테핑 제어)

  • Seo, Kyoung-Cheol;Yoo, Sung-Jin;Park, Jin-Bae;Choi, Yoon-Ho
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.13 no.5
    • /
    • pp.406-413
    • /
    • 2007
  • This paper proposes a self-recurrent wavelet neural network(SRWNN) based adaptive backstepping control technique for the robust steering control of autonomous underwater vehicles(AUVs) with unknown model uncertainties and external disturbance. The SRWNN, which has the properties such as fast convergence and simple structure, is used as the uncertainty observer of the steering model of AUV. The adaptation laws for the weights of SRWNN and reconstruction error compensator are induced from the Lyapunov stability theorem, which are used for the on-line control of AUV. Finally, simulation results for steering control of an AUV with unknown model uncertainties and external disturbance are included to illustrate the effectiveness of the proposed method.

Nonlinear Adaptive Prediction using Locally and Globally Recurrent Neural Networks (지역 및 광역 리커런트 신경망을 이용한 비선형 적응예측)

  • 최한고
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.40 no.1
    • /
    • pp.139-147
    • /
    • 2003
  • Dynamic neural networks have been applied to diverse fields requiring temporal signal processing such as signal prediction. This paper proposes the hybrid network, composed of locally(LRNN) and globally recurrent neural networks(GRNN), to improve dynamics of multilayered recurrent networks(RNN) and then describes nonlinear adaptive prediction using the proposed network as an adaptive filter. The hybrid network consists of IIR-MLP and Elman RNN as LRNN and GRNN, respectively. The proposed network is evaluated in nonlinear signal prediction and compared with Elman RNN and IIR-MLP networks for the relative comparison of prediction performance. Experimental results show that the hybrid network performs better with respect to convergence speed and accuracy, indicating that the proposed network can be a more effective prediction model than conventional multilayered recurrent networks in nonlinear prediction for nonstationary signals.

A Preliminary Result on Electric Load Forecasting using BLRNN (BiLinear Recurrent Neural Network) (쌍선형 회귀성 신경망을 이용한 전력 수요 예측에 관한 기초연구)

  • Park, Tae-Hoon;Choi, Seung-Eok;Park, Dong-Chul
    • Proceedings of the KIEE Conference
    • /
    • 1996.07b
    • /
    • pp.1386-1388
    • /
    • 1996
  • In this paper, a recurrent neural network using polynomial is proposed for electric load forecasting. Since the proposed algorithm is based on the bilinear polynomial, it can model nonlinear systems with much more parsimony than the higher order neural networks based on the Volterra series. The proposed Bilinear Recurrent Neural Network(BLRNN) is compared with Multilayer Perceptron Type Neural Network(MLPNN) for electric load forecasting problems. The results show that the BLRNN is robust and outperforms the MLPNN in terms of forecasting accuracy.

  • PDF

Application of recurrent neural network for inflow prediction into multi-purpose dam basin (다목적댐 유입량 예측을 위한 Recurrent Neural Network 모형의 적용 및 평가)

  • Park, Myung Ky;Yoon, Yung Suk;Lee, Hyun Ho;Kim, Ju Hwan
    • Journal of Korea Water Resources Association
    • /
    • v.51 no.12
    • /
    • pp.1217-1227
    • /
    • 2018
  • This paper aims to evaluate the applicability of dam inflow prediction model using recurrent neural network theory. To achieve this goal, the Artificial Neural Network (ANN) model and the Elman Recurrent Neural Network(RNN) model were applied to hydro-meteorological data sets for the Soyanggang dam and the Chungju dam basin during dam operation period. For the model training, inflow, rainfall, temperature, sunshine duration, wind speed were used as input data and daily inflow of dam for 10 days were used for output data. The verification was carried out through dam inflow prediction between July, 2016 and June, 2018. The results showed that there was no significant difference in prediction performance between ANN model and the Elman RNN model in the Soyanggang dam basin but the prediction results of the Elman RNN model are comparatively superior to those of the ANN model in the Chungju dam basin. Consequently, the Elman RNN prediction performance is expected to be similar to or better than the ANN model. The prediction performance of Elman RNN was notable during the low dam inflow period. The performance of the multiple hidden layer structure of Elman RNN looks more effective in prediction than that of a single hidden layer structure.