• 한국어정보학회:학술대회논문집
• /
• 2017.10a
• /
• pp.285-287
• /
• 2017

본 논문에서는 Multi-layer sequence-to-sequence 구조를 이용해 한국어 대화 시스템을 개발하였다. sequence-to-sequence는 RNN 혹은 그 변형 네트워크에 데이터를 입력하고, 입력이 완료된 후의 은닉층의 embedding에 기반해 출력열을 생성한다. 우리는 sequence-to-sequence로 입력된 발화에 대해 출력 발화를 내어주는 대화 모델을 학습하였고, 그 성능을 측정하였다. RNN에 대해서는 약 80만 발화를, MTRNN에 대해서는 5만 발화를 학습하고 평가하였다. 모델의 결과로 나타난 발화들을 정리하고 분석하였다.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2018.05a
• /
• pp.445-445
• /
• 2018

기후변화에 따른 환경오염은 21세기 인류에게 가장 심각한 문제 중의 하나로 대두되고 있다. 환경적인 측면에서 하천오염은 경제적으로 많은 문제를 발생시키고 있다. 이러한 하천오염 문제를 해결하기 위해서는 오염물질의 농도 측적 및 데이터 축적이 필수적이라 할 수 있다. 그러나 일반적으로 오염물질 부하량에 대한 직접적인 측정은 비용 측면에서 쉽지 않은 것이 사실이다. 또한 실시간으로 BOD, COD, TN, TP 등의 자료를 이용하여 예측하는 것에는 자료의 부족성으로 인해 한계가 있다. 본 연구에서는 구글의 딥러닝 오픈소스 라이브러리인 텐서플로우를 활용하여 기계학습을 통한 하천오염 예측을 목적으로 하고 있다. 기계학습을 위하여 텐서플로우를 활용하여 RNN, LSTM 인공신경망 모형을 구축하였다. 하천오염의 학습과 예측을 위해 결과치 분석을 위한 자료로는 금강 유역에 위치한 옥천 관측소 충청북도 옥천군 이원면 이원대교에 위치한 $36^{\circ}14'31.0''N$ $127^{\circ}40'02.6''E$의 관측소에서 BOD, COD, DO, 부유물질의 자료를 사용하였다. 모형의 학습을 위해서 입력자료는 수위, 유량, 평균기온, 평균풍속 자료를 2004년 ~ 2017년까지의 14년간의 자료를 사용하였다. 연구를 위해 BOD, COD, DO 부유물질 자료는 물환경정보시스템(http://water.nier.go.kr/)의 자료를 활용하고 수위, 유량등의 자료는 국가수자원관리종합정보시스템 (http://www.wamis.go.kr/)의 자료를 사용하였다. 그러나 수온, 수위, 풍속등의 자료는 일 자료가 있는가 반면 BOD, COD, TN, TP등의 자료는 일 자료가 있지 않아 이를 원활히 활용할 수 있도록 예측을 위한 결과치의 선형보간법을 통해 일 자료를 획득한 후 연구를 하였다. RNN, LSTM의 분석 시 학습속도, 반복시행횟수 sequence length의 길이 등의 값을 조절 하면서 결과치를 분석하였다.

• Korean Journal of Agricultural Science
• /
• v.46 no.1
• /
• pp.67-78
• /
• 2019

The purpose of this study was to predict the water quality using the RNN (recurrent neutral network) and LSTM (long short-term memory). These are advanced forms of machine learning algorithms that are better suited for time series learning compared to artificial neural networks; however, they have not been investigated before for water quality prediction. Three water quality indexes, the BOD (biochemical oxygen demand), COD (chemical oxygen demand), and SS (suspended solids) are predicted by the RNN and LSTM. TensorFlow, an open source library developed by Google, was used to implement the machine learning algorithm. The Okcheon observation point in the Geum River basin in the Republic of Korea was selected as the target point for the prediction of the water quality. Ten years of daily observed meteorological (daily temperature and daily wind speed) and hydrological (water level and flow discharge) data were used as the inputs, and irregularly observed water quality (BOD, COD, and SS) data were used as the learning materials. The irregularly observed water quality data were converted into daily data with the linear interpolation method. The water quality after one day was predicted by the machine learning algorithm, and it was found that a water quality prediction is possible with high accuracy compared to existing physical modeling results in the prediction of the BOD, COD, and SS, which are very non-linear. The sequence length and iteration were changed to compare the performances of the algorithms.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.19 no.4
• /
• pp.161-167
• /
• 2019

Recently, demand forecasting techniques have been actively studied due to interest in stable power supply with surging power demand, and increase in spread of smart meters that enable real-time power measurement. In this study, we proceeded the deep learning prediction model experiments which learns actual measured power usage data of home and outputs the forecasting result. And we proceeded pre-processing with moving average method. The predicted value made by the model is evaluated with the actual measured data. Through this forecasting, it is possible to lower the power supply reserve ratio and reduce the waste of the unused power. In this paper, we conducted experiments on three types of networks: Multi Layer Perceptron (MLP), Recurrent Neural Network (RNN), and Long Short Term Memory (LSTM) and we evaluate the results of each scheme. Evaluation is conducted with following method: MSE(Mean Squared Error) method and MAE(Mean Absolute Error).

• Journal of Internet Computing and Services
• /
• v.24 no.2
• /
• pp.11-18
• /
• 2023

Recently, in the field of Speech Emotion Recognition (SER), many studies have been conducted to improve accuracy using voice features and modeling. In addition to modeling studies to improve the accuracy of existing voice emotion recognition, various studies using voice features are being conducted. This paper, voice files are separated by time interval in a time series method, focusing on the fact that voice emotions are related to time flow. After voice file separation, we propose a model for classifying emotions of speech data by extracting speech features Mel, Chroma, zero-crossing rate (ZCR), root mean square (RMS), and mel-frequency cepstrum coefficients (MFCC) and applying them to a recurrent neural network model used for sequential data processing. As proposed method, voice features were extracted from all files using 'librosa' library and applied to neural network models. The experimental method compared and analyzed the performance of models of recurrent neural network (RNN), long short-term memory (LSTM) and gated recurrent unit (GRU) using the Interactive emotional dyadic motion capture Interactive Emotional Dyadic Motion Capture (IEMOCAP) english dataset.

• Atmosphere
• /
• v.31 no.1
• /
• pp.73-83
• /
• 2021

Numerical weather prediction (NWP) models play an essential role in predicting weather factors, but using them is challenging due to various factors. To overcome the difficulties of NWP models, deep learning models have been deployed in weather forecasting by several recent studies. This study adapts long short-term memory (LSTM), which demonstrates remarkable performance in time-series prediction. The combination of LSTM model input of meteorological features and activation functions have a significant impact on the performance therefore, the results from 5 combinations of input features and 4 activation functions are analyzed in 9 Automated Surface Observing System (ASOS) stations corresponding to cities/islands/mountains. The optimized LSTM model produces better performance within eight forecast hours than Local Data Assimilation and Prediction System (LDAPS) operated by Korean meteorological administration. Therefore, this study illustrates that this LSTM model can be usefully applied to very short-term weather forecasting, and further studies about CNN-LSTM model with 2-D spatial convolution neural network (CNN) coupled in LSTM are required for improvement.

• Journal of Industrial Convergence
• /
• v.21 no.1
• /
• pp.167-173
• /
• 2023

As research has been published to predict future data using regression analysis or artificial intelligence as a method of analyzing economic indicators. In this study, we designed a system that predicts prospective futures prices using artificial intelligence that utilizes topic probability data obtained from past news articles using topic modeling. Topic probability distribution data for each news article were obtained using the Latent Dirichlet Allocation (LDA) method that can extract the topic of a document from past news articles via unsupervised learning. Further, the topic probability distribution data were used as the input for a Long Short-Term Memory (LSTM) network, a derivative of Recurrent Neural Networks (RNN) in artificial intelligence, in order to predict prospective futures prices. The method proposed in this study was able to predict the trend of futures prices. Later, this method will also be able to predict the trend of prices for derivative products like options. However, because statistical errors occurred for certain data; further research is required to improve accuracy.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2022.05a
• /
• pp.117-117
• /
• 2022

범지구적인 기후변화로 인하여 도시유역의 국지성 집중호우가 빈번히 발생하고 기상이변 현상이 빈번하게 발생하고 있다. 이로 인해 도시지역의 침수 등의 자연재해 증가로 인명 및 재산피해가 발생하고 있다. 이에 따라 하수도의 제 기능을 수행하고 있다면 문제가 없지만 이상기후로 인한 기록적인 폭우에 의해 침수가 발생하고 있다. 홍수 및 집중호우와 같은 극치사상의 발생빈도가 증가됨에 따라 강우사상의 변동에 따른 하수관로의 수위를 예측하고 침수에 대해 대처하기 위해 과거 수위에 따른 수위 예측은 중요할 것으로 판단된다. 본 연구에서는 서울 열린데이터 광장에서 제공하는 서울시 하수관로 수위 현황 자료를 활용하여 하수관로 수위 예측을 확인해 보았다. 대상자료는 서울특별시 강동구에 위치한 하수관로 수위 자료로, 서울 열린데이터 광장에서 제공하고 있는 2012년 ~ 2020년 25개 구 데이터 중 가장 누락데이터가 적은 자료를 활용하여 연구를 진행하였다. 하수관로 수위 예측에는 딥러닝 알고리즘RNN-LSTM 알고리즘을 활용하였으며, RNN-LSTM 알고리즘은 하천의 수위 예측에 우수한 성능을 보여준 바 있다. 하수관로 수위 예측에 앞서 1분 단위로 수집된 수위 데이터를 5분 평균, 5분 스킵자료, 10분 평균, 10분 스킵 등 비교를 위해 데이터를 구분하여 학습에 활용하였으며, 데이터 분석을 위해 하수관로 수위값 변동이 심한 1주일을 선정하여 분석을 실시하였다. 연구에는Google에서 개발한 딥러닝 오픈소스 라이브러리인 텐서플로우를 활용하였으며, 하수관로 수위 고유번호 25-0001을 대상으로 예측을 하였다. 학습에는 2012년 ~ 2018년의 하수관로 수위 자료를 활용하였으며, 모형의 검증을 위해 결정계수(R square)를 이용하여 통계분석을 실시하였다.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.19 no.1
• /
• pp.29-35
• /
• 2019

As the fourth industrial revolution is emerging, many companies are increasingly interested in smart factories and the importance of sensors is being emphasized. In the case that sensors for collecting sensing data fail, the plant could not be optimized and further it could not be operated properly, which may incur a financial loss. For this purpose, it is necessary to diagnose the status of sensors to prevent sensor' fault. In the paper, we propose a scheme to diagnose digital-sensor' fault by analyzing the rising time and falling time of digital sensors through the LSTM(Long Short Term Memory) of Deep Learning RNN algorithm. Experimental results of the proposed scheme are compared with those of rule-based fault diagnosis algorithm in terms of AUC(Area Under the Curve) of accuracy and ROC(Receiver Operating Characteristic) curve. Experimental results show that the proposed system has better and more stable performance than the rule-based fault diagnosis algorithm.

• Journal of Korea Multimedia Society
• /
• v.23 no.10
• /
• pp.1236-1249
• /
• 2020

In a most recent object tracking research work, applying Convolutional Neural Network and Recurrent Neural Network-based strategies become relevant for resolving the noticeable challenges in it, like, occlusion, motion, object, and camera viewpoint variations, changing several targets, lighting variations. In this paper, the LSTM Network-based Tracking association method has proposed where the technique capable of real-time multi-object tracking by creating one of the useful LSTM networks that associated with tracking, which supports the long term tracking along with solving challenges. The LSTM network is a different neural network defined in Keras as a sequence of layers, where the Sequential classes would be a container for these layers. This purposing network structure builds with the integration of tracking association on Keras neural-network library. The tracking process has been associated with the LSTM Network feature learning output and obtained outstanding real-time detection and tracking performance. In this work, the main focus was learning trackable objects locations, appearance, and motion details, then predicting the feature location of objects on boxes according to their initial position. The performance of the joint object tracking system has shown that the LSTM network is more powerful and capable of working on a real-time multi-object tracking process.