• Title/Summary/Keyword: 순환신경망 모델

Search Result 202, Processing Time 0.027 seconds

Comparative analysis of activation functions of artificial neural network for prediction of optimal groundwater level in the middle mountainous area of Pyoseon watershed in Jeju Island (제주도 표선유역 중산간지역의 최적 지하수위 예측을 위한 인공신경망의 활성화함수 비교분석)

  • Shin, Mun-Ju;Kim, Jin-Woo;Moon, Duk-Chul;Lee, Jeong-Han;Kang, Kyung Goo
    • Journal of Korea Water Resources Association
    • /
    • v.54 no.spc1
    • /
    • pp.1143-1154
    • /
    • 2021
  • The selection of activation function has a great influence on the groundwater level prediction performance of artificial neural network (ANN) model. In this study, five activation functions were applied to ANN model for two groundwater level observation wells in the middle mountainous area of the Pyoseon watershed in Jeju Island. The results of the prediction of the groundwater level were compared and analyzed, and the optimal activation function was derived. In addition, the results of LSTM model, which is a widely used recurrent neural network model, were compared and analyzed with the results of the ANN models with each activation function. As a result, ELU and Leaky ReLU functions were derived as the optimal activation functions for the prediction of the groundwater level for observation well with relatively large fluctuations in groundwater level and for observation well with relatively small fluctuations, respectively. On the other hand, sigmoid function had the lowest predictive performance among the five activation functions for training period, and produced inappropriate results in peak and lowest groundwater level prediction. The ANN-ELU and ANN-Leaky ReLU models showed groundwater level prediction performance comparable to that of the LSTM model, and thus had sufficient potential for application. The methods and results of this study can be usefully used in other studies.

Development of Prediction Model of Financial Distress and Improvement of Prediction Performance Using Data Mining Techniques (데이터마이닝 기법을 이용한 기업부실화 예측 모델 개발과 예측 성능 향상에 관한 연구)

  • Kim, Raynghyung;Yoo, Donghee;Kim, Gunwoo
    • Information Systems Review
    • /
    • v.18 no.2
    • /
    • pp.173-198
    • /
    • 2016
  • Financial distress can damage stakeholders and even lead to significant social costs. Thus, financial distress prediction is an important issue in macroeconomics. However, most existing studies on building a financial distress prediction model have only considered idiosyncratic risk factors without considering systematic risk factors. In this study, we propose a prediction model that considers both the idiosyncratic risk based on a financial ratio and the systematic risk based on a business cycle. Ultimately, we build several IT artifacts associated with financial ratio and add them to the idiosyncratic risk factors as well as address the imbalanced data problem by using an oversampling technique and synthetic minority oversampling technique (SMOTE) to ensure good performance. When considering systematic risk, our study ensures that each data set consists of both financially distressed companies and financially sound companies in each business cycle phase. We conducted several experiments that change the initial imbalanced sample ratio between the two company groups into a 1:1 sample ratio using SMOTE and compared the prediction results from the individual data set. We also predicted data sets from the subsequent business cycle phase as a test set through a built prediction model that used business contraction phase data sets, and then we compared previous prediction performance and subsequent prediction performance. Thus, our findings can provide insights into making rational decisions for stakeholders that are experiencing an economic crisis.

CycleGAN Based Translation Method between Asphalt and Concrete Crack Images for Data Augmentation (데이터 증강을 위한 순환 생성적 적대 신경망 기반의 아스팔트와 콘크리트 균열 영상 간의 변환 기법)

  • Shim, Seungbo
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.21 no.5
    • /
    • pp.171-182
    • /
    • 2022
  • The safe use of a structure requires it to be maintained in an undamaged state. Thus, a typical factor that determines the safety of a structure is a crack in it. In addition, cracks are caused by various reasons, damage the structure in various ways, and exist in different shapes. Making matters worse, if these cracks are unattended, the risk of structural failure increases and proceeds to a catastrophe. Hence, recently, methods of checking structural damage using deep learning and computer vision technology have been introduced. These methods usually have the premise that there should be a large amount of training image data. However, the amount of training image data is always insufficient. Particularly, this insufficiency negatively affects the performance of deep learning crack detection algorithms. Hence, in this study, a method of augmenting crack image data based on the image translation technique was developed. In particular, this method obtained the crack image data for training a deep learning neural network model by transforming a specific case of a asphalt crack image into a concrete crack image or vice versa . Eventually, this method expected that a robust crack detection algorithm could be developed by increasing the diversity of its training data.

Ensemble Design of Machine Learning Technigues: Experimental Verification by Prediction of Drifter Trajectory (앙상블을 이용한 기계학습 기법의 설계: 뜰개 이동경로 예측을 통한 실험적 검증)

  • Lee, Chan-Jae;Kim, Yong-Hyuk
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.8 no.3
    • /
    • pp.57-67
    • /
    • 2018
  • The ensemble is a unified approach used for getting better performance by using multiple algorithms in machine learning. In this paper, we introduce boosting and bagging, which have been widely used in ensemble techniques, and design a method using support vector regression, radial basis function network, Gaussian process, and multilayer perceptron. In addition, our experiment was performed by adding a recurrent neural network and MOHID numerical model. The drifter data used for our experimental verification consist of 683 observations in seven regions. The performance of our ensemble technique is verified by comparison with four algorithms each. As verification, mean absolute error was adapted. The presented methods are based on ensemble models using bagging, boosting, and machine learning. The error rate was calculated by assigning the equal weight value and different weight value to each unit model in ensemble. The ensemble model using machine learning showed 61.7% improvement compared to the average of four machine learning technique.

Intrusion Detection Method Using Unsupervised Learning-Based Embedding and Autoencoder (비지도 학습 기반의 임베딩과 오토인코더를 사용한 침입 탐지 방법)

  • Junwoo Lee;Kangseok Kim
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.12 no.8
    • /
    • pp.355-364
    • /
    • 2023
  • As advanced cyber threats continue to increase in recent years, it is difficult to detect new types of cyber attacks with existing pattern or signature-based intrusion detection method. Therefore, research on anomaly detection methods using data learning-based artificial intelligence technology is increasing. In addition, supervised learning-based anomaly detection methods are difficult to use in real environments because they require sufficient labeled data for learning. Research on an unsupervised learning-based method that learns from normal data and detects an anomaly by finding a pattern in the data itself has been actively conducted. Therefore, this study aims to extract a latent vector that preserves useful sequence information from sequence log data and develop an anomaly detection learning model using the extracted latent vector. Word2Vec was used to create a dense vector representation corresponding to the characteristics of each sequence, and an unsupervised autoencoder was developed to extract latent vectors from sequence data expressed as dense vectors. The developed autoencoder model is a recurrent neural network GRU (Gated Recurrent Unit) based denoising autoencoder suitable for sequence data, a one-dimensional convolutional neural network-based autoencoder to solve the limited short-term memory problem that GRU can have, and an autoencoder combining GRU and one-dimensional convolution was used. The data used in the experiment is time-series-based NGIDS (Next Generation IDS Dataset) data, and as a result of the experiment, an autoencoder that combines GRU and one-dimensional convolution is better than a model using a GRU-based autoencoder or a one-dimensional convolution-based autoencoder. It was efficient in terms of learning time for extracting useful latent patterns from training data, and showed stable performance with smaller fluctuations in anomaly detection performance.

Development of user activity type and recognition technology using LSTM (LSTM을 이용한 사용자 활동유형 및 인식기술 개발)

  • Kim, Young-kyun;Kim, Won-jong;Lee, Seok-won
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2018.10a
    • /
    • pp.360-363
    • /
    • 2018
  • Human activity is influenced by various factors, from individual physical features such as vertebral flexion and pelvic distortion to feelings such as joy, anger, and sadness. However, the nature of these behaviors changes over time, and behavioral characteristics do not change much in the short term. The activity data of a person has a time series characteristic that changes with time and a certain regularity for each action. In this study, we applied LSTM, a kind of cyclic neural network to deal with time - series characteristics, to the technique of recognizing activity type and improved recognition rate of activity type by measuring time and parameter optimization of components of LSTM model.

  • PDF

Development of physical activity monitoring system using multiple motion sensors (다중모드 센서를 이용한 신체활동 모니터링 시스템 개발)

  • Lee, SeoYong;Park, ChaeEun;Jeong, DaSol;Choi, JaeHong;Kim, HwanSeog
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2020.07a
    • /
    • pp.147-149
    • /
    • 2020
  • 코로나바이러스의 세계 확산, 발병 이후 사람들의 실내활동 증가와 건강, 면역에 대한 관심은 많이 증가했다. 이에 맞춰 더욱 정교하고 바른 정보에 의한 스마트헬스케어 역시 관심이 증대되고 있다. 여기서 이야기하는 스마트헬스케어의 범위는 영상 장치를 비롯해 다양한 센서를 활용해 신체활동을 모니터링하고 분석하며 기존의 방식보다 더 객관적인 정보를 제공해 주는 것을 말한다. 위 기술과 대중의 관심을 바탕으로 하여 본 연구에서는 다중 모드 센서를 신체에 부착하여 신체활동을 모니터링 하는 시스템 개발을 목적으로 한다. 하드웨어 설계 부분에서 설계가 완성된 Arduino nano 33 Sense를 이용하여 스마트 헬스 실험 시간을 대폭 줄였다. 또한 운동과 같은 시계열 데이터를 분석하기 좋은 LSTM 기법을 채택하였으며, 개발된 모델을 추후 활용할 방안에 대해 논하였다.

  • PDF

Identifying Correction Range of Geomagnetic Field for Indoor Positioning of Workers at Construction Site (건설현장 내 작업자 실내측위를 위한 지구자기장 보정 범위 도출)

  • Kim, Hyeonmin;Ahn, Heejae;Lee, Changsu;Kim, Harim;Ko, Youngwoong;Cho, HunHee
    • Proceedings of the Korean Institute of Building Construction Conference
    • /
    • 2022.11a
    • /
    • pp.93-94
    • /
    • 2022
  • Although various studies about indoor positioning systems, such as beacon and Wifi, have been conducting for indoor positioning of workers at construction sites, these systems have limitations in terms of accuracy or economics. To overcome these limitations, geomagnetic field sequence-based indoor positioning technology can be a good alternative. However, it is necessary to correct the geomagnetic field near the construction material stocking area since the geomagnetic field can be distorted near construction materials such as rebars. Therefore, this study conducted an experiment for identifying correction range of geomagnetic field near the construction material stocking area. It was analyzed that the geomagnetic field should be corrected up to 60cm in the horizontal direction from the stocking point if the height of stocking area for rebars is 40cm or more. This study can be used for important reference for development of geomagnetic field sequence-based indoor positioning technology suitable for construction sites.

  • PDF

Automatic sentence segmentation of subtitles generated by STT (STT로 생성된 자막의 자동 문장 분할)

  • Kim, Ki-Hyun;Kim, Hong-Ki;Oh, Byoung-Doo;Kim, Yu-Seop
    • Annual Conference on Human and Language Technology
    • /
    • 2018.10a
    • /
    • pp.559-560
    • /
    • 2018
  • 순환 신경망(RNN) 기반의 Long Short-Term Memory(LSTM)는 자연어처리 분야에서 우수한 성능을 보이는 모델이다. 음성을 문자로 변환해주는 Speech to Text (STT)를 이용해 자막을 생성하고, 생성된 자막을 다른 언어로 동시에 번역을 해주는 서비스가 활발히 진행되고 있다. STT를 사용하여 자막을 추출하는 경우에는 마침표가 없이 전부 연결된 문장이 생성되기 때문에 정확한 번역이 불가능하다. 본 논문에서는 영어자막의 자동 번역 시, 정확도를 높이기 위해 텍스트를 문장으로 분할하여 마침표를 생성해주는 방법을 제안한다. 이 때, LSTM을 이용하여 데이터를 학습시킨 후 테스트한 결과 62.3%의 정확도로 마침표의 위치를 예측했다.

  • PDF

Backstepping Control-Based Precise Positioning Control Using Robust Friction State Observer and RFNN (강인한 마찰상태관측기와 RFNN을 이용한 백스테핑 제어기반 정밀 위치제어)

  • Yeo, Dae-Yeon;Han, Seong-Ik;Lee, Kwon-Soon
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.19 no.3
    • /
    • pp.394-401
    • /
    • 2010
  • In this article, we investigate a robust friction compensation scheme for the purpose of accomplishing precision positioning performance a servo mechanical system with nonlinear dynamic friction. To estimate the friction state and tackle robustness problem for uncertainty, a RFNN and reconstructed error compensator as well as a robust friction state observer are developed. The asymptotic stability of the series of friction compensation methodologies are verified from the Lyapunov's stability theory. Some simulations and experiments on a servo mechanical system were carried out to evaluate the effectiveness of the proposed control scheme.