• Title/Summary/Keyword: Sequential Neural Network

Search Result 106, Processing Time 0.027 seconds

Tensile Properties Estimation Method Using Convolutional LSTM Model

  • Choi, Hyeon-Joon;Kang, Dong-Joong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.11
    • /
    • pp.43-49
    • /
    • 2018
  • In this paper, we propose a displacement measurement method based on deep learning using image data obtained from tensile tests of a material specimen. We focus on the fact that the sequential images during the tension are generated and the displacement of the specimen is represented in the image data. So, we designed sample generation model which makes sequential images of specimen. The behavior of generated images are similar to the real specimen images under tensile force. Using generated images, we trained and validated our model. In the deep neural network, sequential images are assigned to a multi-channel input to train the network. The multi-channel images are composed of sequential images obtained along the time domain. As a result, the neural network learns the temporal information as the images express the correlation with each other along the time domain. In order to verify the proposed method, we conducted experiments by comparing the deformation measuring performance of the neural network changing the displacement range of images.

A study on sequential iterative learning for overcoming catastrophic forgetting phenomenon of artificial neural network (인공 신경망의 Catastrophic forgetting 현상 극복을 위한 순차적 반복 학습에 대한 연구)

  • Choi, Dong-bin;Park, Young-beom
    • Journal of Platform Technology
    • /
    • v.6 no.4
    • /
    • pp.34-40
    • /
    • 2018
  • Currently, artificial neural networks perform well for a single task, but NN have the problem of forgetting previous learning by learning other kinds of tasks. This is called catastrophic forgetting. To use of artificial neural networks in general purpose this should be solved. There are many efforts to overcome catastrophic forgetting. However, even though there was a lot of effort, it did not completely overcome the catastrophic forgetting. In this paper, we propose sequential iterative learning using core concepts used in elastic weight consolidation (EWC). The experiment was performed to reproduce catastrophic forgetting phenomenon using EMNIST data set which extended MNIST, which is widely used for artificial neural network learning, and overcome it through sequential iterative learning.

Development of Optimization Algorithm for Unconstrained Problems Using the Sequential Design of Experiments and Artificial Neural Network (순차적 실험계획법과 인공신경망을 이용한 제한조건이 없는 문제의 최적화 알고리즘 개발)

  • Lee, Jung-Hwan;Suh, Myung-Won
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.32 no.3
    • /
    • pp.258-266
    • /
    • 2008
  • The conventional approximate optimization method, which uses the statistical design of experiments(DOE) and response surface method(RSM), can derive an approximated optimum results through the iterative process by a trial and error. The quality of results depends seriously on the factors and levels assigned by a designer. The purpose of this study is to propose a new technique, which is called a sequential design of experiments(SDOE), to reduce a trial and error procedure and to find an appropriate condition for using artificial neural network(ANN) systematically. An appropriate condition is determined from the iterative process based on the analysis of means. With this new technique and ANN, it is possible to find an optimum design accurately and efficiently. The suggested algorithm has been applied to various mathematical examples and a structural problem.

Comparison of Classification Models for Sequential Flight Test Results (단계별 비행훈련 성패 예측 모형의 성능 비교 연구)

  • Sohn, So-Young;Cho, Yong-Kwan;Choi, Sung-Ok;Kim, Young-Joun
    • Journal of the Ergonomics Society of Korea
    • /
    • v.21 no.1
    • /
    • pp.1-14
    • /
    • 2002
  • The main purpose of this paper is to present selection criteria for ROK Airforce pilot training candidates in order to save costs involved in sequential pilot training. We use classification models such Decision Tree, Logistic Regression and Neural Network based on aptitude test results of 288 ROK Air Force applicants in 1994-1996. Different models are compared in terms of classification accuracy, ROC and Lift-value. Neural network is evaluated as the best model for each sequential flight test result while Logistic regression model outperforms the rest of them for discriminating the last flight test result. Therefore we suggest a pilot selection criterion based on this logistic regression. Overall. we find that the factors such as Attention Sharing, Speed Tracking, Machine Comprehension and Instrument Reading Ability having significant effects on the flight results. We expect that the use of our criteria can increase the effectiveness of flight resources.

Bayesian Analysis for Neural Network Models

  • Chung, Younshik;Jung, Jinhyouk;Kim, Chansoo
    • Communications for Statistical Applications and Methods
    • /
    • v.9 no.1
    • /
    • pp.155-166
    • /
    • 2002
  • Neural networks have been studied as a popular tool for classification and they are very flexible. Also, they are used for many applications of pattern classification and pattern recognition. This paper focuses on Bayesian approach to feed-forward neural networks with single hidden layer of units with logistic activation. In this model, we are interested in deciding the number of nodes of neural network model with p input units, one hidden layer with m hidden nodes and one output unit in Bayesian setup for fixed m. Here, we use the latent variable into the prior of the coefficient regression, and we introduce the 'sequential step' which is based on the idea of the data augmentation by Tanner and Wong(1787). The MCMC method(Gibbs sampler and Metropolish algorithm) can be used to overcome the complicated Bayesian computation. Finally, a proposed method is applied to a simulated data.

Acute Leukemia Classification Using Sequential Neural Network Classifier in Clinical Decision Support System (임상적 의사결정지원시스템에서 순차신경망 분류기를 이용한 급성백혈병 분류기법)

  • Lim, Seon-Ja;Vincent, Ivan;Kwon, Ki-Ryong;Yun, Sung-Dae
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.2
    • /
    • pp.174-185
    • /
    • 2020
  • Leukemia induced death has been listed in the top ten most dangerous mortality basis for human being. Some of the reason is due to slow decision-making process which caused suitable medical treatment cannot be applied on time. Therefore, good clinical decision support for acute leukemia type classification has become a necessity. In this paper, the author proposed a novel approach to perform acute leukemia type classification using sequential neural network classifier. Our experimental result only cover the first classification process which shows an excellent performance in differentiating normal and abnormal cells. Further development is needed to prove the effectiveness of second neural network classifier.

Time Series Forecasting Based on Modified Ensemble Algorithm (시계열 예측의 변형된 ENSEMBLE ALGORITHM)

  • Kim Yon Hyong;Kim Jae Hoon
    • The Korean Journal of Applied Statistics
    • /
    • v.18 no.1
    • /
    • pp.137-146
    • /
    • 2005
  • Neural network is one of the most notable technique. It usually provides more powerful forecasting models than the traditional time series techniques. Employing the Ensemble technique in forecasting model, one should provide a initial distribution. Usually the uniform distribution is assumed so that the initialization is noninformative. However, it would be expected a sequential informative initialization based on data rather than the uniform initialization gives further reduction in forecasting error. In this note, a modified Ensemble algorithm using sequential initial probability is developed. The sequential distribution is designed to have much weight on the recent data.

Minimization of differential column shortening and sequential analysis of RC 3D-frames using ANN

  • Njomo, Wilfried W.;Ozay, Giray
    • Structural Engineering and Mechanics
    • /
    • v.51 no.6
    • /
    • pp.989-1003
    • /
    • 2014
  • In the preliminary design stage of an RC 3D-frame, repeated sequential analyses to determine optimal members' sizes and the investigation of the parameters required to minimize the differential column shortening are computational effort consuming, especially when considering various types of loads such as dead load, temperature action, time dependent effects, construction and live loads. Because the desired accuracy at this stage does not justify such luxury, two backpropagation feedforward artificial neural networks have been proposed in order to approximate this information. Instead of using a commercial software package, many references providing advanced principles have been considered to code a program and generate these neural networks. The first one predicts the typical amount of time between two phases, needed to achieve the minimum maximorum differential column shortening. The other network aims to prognosticate sequential analysis results from those of the simultaneous analysis. After the training stages, testing procedures have been carried out in order to ensure the generalization ability of these respective systems. Numerical cases are studied in order to find out how good these ANN match with the sequential finite element analysis. Comparison reveals an acceptable fit, enabling these systems to be safely used in the preliminary design stage.

Comparison of Neural Network Techniques for Text Data Analysis

  • Kim, Munhee;Kang, Kee-Hoon
    • International Journal of Advanced Culture Technology
    • /
    • v.8 no.2
    • /
    • pp.231-238
    • /
    • 2020
  • Generally, sequential data refers to data having continuity. Text data, which is a representative type of unstructured data, is also sequential data in that it is necessary to know the meaning of the preceding word in order to know the meaning of the following word or context. So far, many techniques for analyzing sequential data such as text data have been proposed. In this paper, four methods of 1d-CNN, LSTM, BiLSTM, and C-LSTM are introduced, focusing on neural network techniques. In addition, by using this, IMDb movie review data was classified into two classes to compare the performance of the techniques in terms of accuracy and analysis time.

Construct of Fuzzy Inference Network based on the Neural Logic Network (신경 논리 망을 기반으로 한 퍼지 추론 망 구성)

  • 이말례
    • Korean Journal of Cognitive Science
    • /
    • v.13 no.1
    • /
    • pp.13-21
    • /
    • 2002
  • Fuzzy logic ignores some information in the reasoning process. Neural network is powerful tools for the pattern processing, but, not appropriate for the logical reasoning. To model human knowledge, besides pattern processing capability, the logical reasoning capability is equally important. Another new neural network called neural logic network is able to do the logical reasoning. Because the fuzzy inference is a fuzzy logical reasoning, we construct fuzzy inference network based on the neural logic network, extending the existing rule-inference network. And the traditional propagation rule is modified. Experiments are performed to compare search costs by sequential searching and searching by priority. The experimental results show that the searching by priority is more efficient than the sequential searching as the size of the fuzzy inference network becomes larder and an the number of searching increases.

  • PDF