• Title/Summary/Keyword: Dynamic Recurrent Neural Networks

Search Result 50, Processing Time 0.029 seconds

Exploring the Prediction of Timely Stocking in Purchasing Process Using Process Mining and Deep Learning (프로세스 마이닝과 딥러닝을 활용한 구매 프로세스의 적기 입고 예측에 관한 연구)

  • Youngsik Kang;Hyunwoo Lee;Byoungsoo Kim
    • Information Systems Review
    • /
    • v.20 no.4
    • /
    • pp.25-41
    • /
    • 2018
  • Applying predictive analytics to enterprise processes is an effective way to reduce operation costs and enhance productivity. Accordingly, the ability to predict business processes and performance indicators are regarded as a core capability. Recently, several works have predicted processes using deep learning in the form of recurrent neural networks (RNN). In particular, the approach of predicting the next step of activity using static or dynamic RNN has excellent results. However, few studies have given attention to applying deep learning in the form of dynamic RNN to predictions of process performance indicators. To fill this knowledge gap, the study developed an approach to using process mining and dynamic RNN. By utilizing actual data from a large domestic company, it has applied the suggested approach in estimating timely stocking in purchasing process, which is an important indicator of the process. The analytic methods and results of this study were presented and some implications and limitations are also discussed.

On Neural Fuzzy Systems

  • Su, Shun-Feng;Yeh, Jen-Wei
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.14 no.4
    • /
    • pp.276-287
    • /
    • 2014
  • Neural fuzzy system (NFS) is basically a fuzzy system that has been equipped with learning capability adapted from the learning idea used in neural networks. Due to their outstanding system modeling capability, NFS have been widely employed in various applications. In this article, we intend to discuss several ideas regarding the learning of NFS for modeling systems. The first issue discussed here is about structure learning techniques. Various ideas used in the literature are introduced and discussed. The second issue is about the use of recurrent networks in NFS to model dynamic systems. The discussion about the performance of such systems will be given. It can be found that such a delay feedback can only bring one order to the system not all possible order as claimed in the literature. Finally, the mechanisms and relative learning performance of with the use of the recursive least squares (RLS) algorithm are reported and discussed. The analyses will be on the effects of interactions among rules. Two kinds of systems are considered. They are the strict rules and generalized rules and have difference variances for membership functions. With those observations in our study, several suggestions regarding the use of the RLS algorithm in NFS are presented.

A Controller Design for the Prediction of Optimal Heating Load (최적 난방부하 예측 제어기 설계)

  • 정기철;양해원
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.6 no.6
    • /
    • pp.441-446
    • /
    • 2000
  • This paper presents an approach for the prediction of optimal heating load using a diagonal recurrent neural networks(DRNN) and data base system of outdoor temperature. In the DRNN, a dynamic backpropagation(DBP) with delta-bar-delta teaming method is used to train an optimal heating load identifier. And the data base system is utilized for outdoor temperature prediction. Compared to other kinds of methods, the proposed method gives better prediction performance of heating load. Also a hardware for the controller is developed using a microprocessor. The experimental results show that prediction enhancement for heating load can be achieved with the proposed method regardless of the its inherent nonlinearity and large time constant.

  • PDF

Robust Flight Control System Using Neural Networks: Dynamic Surface Design Approach (신경 회로망을 이용한 강인 비행 제어 시스템: 동적 표면 설계 접근)

  • Yoon, Sung-Jin;Choi, Yoon-Ho;Park, Jin-Bae
    • Proceedings of the KIEE Conference
    • /
    • 2006.07d
    • /
    • pp.1848-1849
    • /
    • 2006
  • The new robust controller design method is proposed for the flight control systems with model uncertainties. The proposed control system is a combination of the adaptive dynamic surface control (DSC) technique and the self recurrent wavelet neural network (SRWNN). The adaptive DSC technique provides us with the ability to overcome the "explosion of complexity" problem of the backstepping controller. The SRWNNs are used to observe the arbitrary model uncertainties of flight systems and all their weights are trained on-line. From the Lyapunov stability analysis, their adaptation laws are induced and the uniformly ultimately boundedness of all signals in a closed-loop adaptive system is proved. Finally, simulation results for a high performance aircraft (F-16) are utilized to validate the good tracking performance and robustness of the proposed control system.

  • PDF

Robust Flight Control System Using Neural Networks: Dynamic Surface Design Approach (신경 회로망을 이용한 강인 비행 제어 시스템: 동적 표면 설계 접근)

  • Yoo, Sung-Jin;Choi, Yoon-Ho;Park, Jin-Bae
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.55 no.12
    • /
    • pp.518-525
    • /
    • 2006
  • This paper presents the adaptive robust control method for the flight control systems with model uncertainties. The proposed control system can be composed simply by a combination of the adaptive dynamic surface control (DSC) technique and the self recurrent wavelet neural network (SRWNN). The adaptive DSC technique provides us with the ability to overcome the 'explosion of complexity' problem of the backstepping controller. The SRWNNs are used to observe the arbitrary model uncertainties of flight systems, and all their weights are trained on-line. From the Lyapunov stability analysis, their adaptation laws are induced and the uniformly ultimately boundedness of all signals in a closed-loop adaptive system is proved. Finally, simulation results for a high performance aircraft (F-16) are utilized to validate the good tracking performance and robustness of the proposed control system.

Performance of Exercise Posture Correction System Based on Deep Learning (딥러닝 기반 운동 자세 교정 시스템의 성능)

  • Hwang, Byungsun;Kim, Jeongho;Lee, Ye-Ram;Kyeong, Chanuk;Seon, Joonho;Sun, Young-Ghyu;Kim, Jin-Young
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.22 no.5
    • /
    • pp.177-183
    • /
    • 2022
  • Recently, interesting of home training is getting bigger due to COVID-19. Accordingly, research on applying HAR(human activity recognition) technology to home training has been conducted. However, existing paper of HAR proposed static activity instead of dynamic activity. In this paper, the deep learning model where dynamic exercise posture can be analyzed and the accuracy of the user's exercise posture can be shown is proposed. Fitness images of AI-hub are analyzed by blaze pose. The experiment is compared with three types of deep learning model: RNN(recurrent neural network), LSTM(long short-term memory), CNN(convolution neural network). In simulation results, it was shown that the f1-score of RNN, LSTM and CNN is 0.49, 0.87 and 0.98, respectively. It was confirmed that CNN is more suitable for human activity recognition than other models from simulation results. More exercise postures can be analyzed using a variety learning data.

Real-time modeling prediction for excavation behavior

  • Ni, Li-Feng;Li, Ai-Qun;Liu, Fu-Yi;Yin, Honore;Wu, J.R.
    • Structural Engineering and Mechanics
    • /
    • v.16 no.6
    • /
    • pp.643-654
    • /
    • 2003
  • Two real-time modeling prediction (RMP) schemes are presented in this paper for analyzing the behavior of deep excavations during construction. The first RMP scheme is developed from the traditional AR(p) model. The second is based on the simplified Elman-style recurrent neural networks. An on-line learning algorithm is introduced to describe the dynamic behavior of deep excavations. As a case study, in-situ measurements of an excavation were recorded and the measured data were used to verify the reliability of the two schemes. They proved to be both effective and convenient for predicting the behavior of deep excavations during construction. It is shown through the case study that the RMP scheme based on the neural network is more accurate than that based on the traditional AR(p) model.

Recurrent Neural Network Models for Prediction of the inside Temperature and Humidity in Greenhouse

  • Jung, Dae-Hyun;Kim, Hak-Jin;Park, Soo Hyun;Kim, Joon Yong
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 2017.04a
    • /
    • pp.135-135
    • /
    • 2017
  • Greenhouse have been developed to provide the plants with good environmental conditions for cultivation crop, two major factors of which are the inside air temperature and humidity. The inside temperature are influenced by the heating systems, ventilators and for systems among others, which in turn are geverned by some type of controller. Likewise, humidity environment is the result of complex mass exchanges between the inside air and the several elements of the greenhouse and the outside boundaries. Most of the existing models are based on the energy balance method and heat balance equation for modelling the heat and mass fluxes and generating dynamic elements. However, greenhouse are classified as complex system, and need to make a sophisticated modeling. Furthermore, there is a difficulty in using classical control methods for complex process system due to the process are non linear and multi-output(MIMO) systems. In order to predict the time evolution of conditions in certain greenhouse as a function, we present here to use of recurrent neural networks(RNN) which has been used to implement the direct dynamics of the inside temperature and inside humidity of greenhouse. For the training, we used algorithm of a backpropagation Through Time (BPTT). Because the environmental parameters are shared by all time steps in the network, the gradient at each output depends not only on the calculations of the current time step, but also the previous time steps. The training data was emulated to 13 input variables during March 1 to 7, and the model was tested with database file of March 8. The RMSE of results of the temperature modeling was $0.976^{\circ}C$, and the RMSE of humidity simulation was 4.11%, which will be given to prove the performance of RNN in prediction of the greenhouse environment.

  • PDF

Nonlinear Prediction of Nonstationary Signals using Neural Networks (신경망을 이용한 비정적 신호의 비선형 예측)

  • Choi, Han-Go;Lee, Ho-Sub;Kim, Sang-Hee
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.35S no.10
    • /
    • pp.166-174
    • /
    • 1998
  • Neural networks, having highly nonlinear dynamics by virtue of the distributed nonlinearities and the learing ability, have the potential for the adaptive prediction of nonstationary signals. This paper describes the nonlinear prediction of these signals in two ways; using a nonlinear module and the cascade combination of nonlinear and linear modules. Fully-connected recurrent neural networks (RNNs) and a conventional tapped-delay-line (TDL) filter are used as the nonlinear and linear modules respectively. The dynamic behavior of the proposed predictors is demonstrated for chaotic time series adn speech signals. For the relative comparison of prediction performance, the proposed predictors are compared with a conventional ARMA linear prediction model. Experimental results show that the neural networks based adaptive predictor ourperforms the traditional linear scheme significantly. We also find that the cascade combination predictor is well suitable for the prediction of the time series which contain large variations of signal amplitude.

  • PDF

Nonlinear Friction Control Using the Robust Friction State Observer and Recurrent Fuzzy Neural Network Estimator (강인한 마찰 상태 관측기와 순환형 퍼지신경망 관측기를 이용한 비선형 마찰제어)

  • Han, Seong-Ik
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.18 no.1
    • /
    • pp.90-102
    • /
    • 2009
  • In this paper, a tracking control problem for a mechanical servo system with nonlinear dynamic friction is treated. The nonlinear friction model contains directly immeasurable friction state and the uncertainty caused by incomplete modeling and variations of its parameter. In order to provide the efficient solution to these control problems, we propose a hybrid control scheme, which consists of a robust friction state observer, a RFNN estimator and an approximation error estimator with sliding mode control. A sliding mode controller and a robust friction state observer is firstly designed to estimate the unknown infernal state of the LuGre friction model. Next, a RFNN estimator is introduced to approximate the unknown lumped friction uncertainty. Finally, an adaptive approximation error estimator is designed to compensate the approximation error of the RFNN estimator. Some simulations and experiments on the mechanical servo system composed of ball-screw and DC servo motor are presented. Results demonstrate the remarkable performance of the proposed control scheme.