• 전기전자학회논문지
• /
• 제23권4호
• /
• pp.1328-1336
• /
• 2019

안전하고 최적의 배터리 성능을 유지하기 위해 정확한 충전상태(SOC) 추정 기술이 필수적이다. 본 논문에서는 기존의 전류적산 방법이 가지고 있는 문제를 해결하기 위해 시간 종속성을 가지는 인공지능 기반의 LSTM을 이용한 SOC 추정 방법을 적용하였다. 훈련과 검증에 필요한 데이터는 전기적 실험을 통해 일정 크기로 방전된 전류, 전압, 온도를 수집하였고 학습을 위한 입력데이터의 질을 향상시키기 위해 데이터 전처리를 수행하였다. 또한, LSTM 모델의 구조 및 하이퍼파라미터 설정에 따른 학습 능력과 SOC 추정 성능을 비교하였다. 학습한 모델은 UDDS 프로파일을 통해 검증하였으며, RMSE 0.82%, MAX 2.54%의 추정 정확도를 달성하였다.

• 한국정보과학회 언어공학연구회:학술대회논문집(한글 및 한국어 정보처리)
• /
• 한국정보과학회언어공학연구회 2017년도 제29회 한글 및 한국어 정보처리 학술대회
• /
• pp.159-162
• /
• 2017

Long Short-Term Memory Recurrent Neural Network(LSTM RNN)는 순차 데이터 모델링에 적합한 딥러닝 모델이다. Bidirectional LSTM RNN(BiLSTM RNN)은 RNN의 그래디언트 소멸 문제(vanishing gradient problem)를 해결한 LSTM RNN을 입력 데이터의 양 방향에 적용시킨 것으로 입력 열의 모든 정보를 볼 수 있는 장점이 있어 자연어처리를 비롯한 다양한 분야에서 많이 사용되고 있다. Highway Network는 비선형 변환을 거치지 않은 입력 정보를 히든레이어에서 직접 사용할 수 있게 LSTM 유닛에 게이트를 추가한 딥러닝 모델이다. 본 논문에서는 Highway Network를 한국어 의미역 결정에 적용하여 기존 연구 보다 더 높은 성능을 얻을 수 있음을 보인다.

• 한국어정보학회:학술대회논문집
• /
• 한국어정보학회 2017년도 제29회 한글및한국어정보처리학술대회
• /
• pp.159-162
• /
• 2017

Long Short-Term Memory Recurrent Neural Network(LSTM RNN)는 순차 데이터 모델링에 적합한 딥러닝 모델이다. Bidirectional LSTM RNN(BiLSTM RNN)은 RNN의 그래디언트 소멸 문제(vanishing gradient problem)를 해결한 LSTM RNN을 입력 데이터의 양 방향에 적용시킨 것으로 입력 열의 모든 정보를 볼 수 있는 장점이 있어 자연어처리를 비롯한 다양한 분야에서 많이 사용되고 있다. Highway Network는 비선형 변환을 거치지 않은 입력 정보를 히든레이어에서 직접 사용할 수 있게 LSTM 유닛에 게이트를 추가한 딥러닝 모델이다. 본 논문에서는 Highway Network를 한국어 의미역 결정에 적용하여 기존 연구 보다 더 높은 성능을 얻을 수 있음을 보인다.

• 한국산업정보학회논문지
• /
• 제28권5호
• /
• pp.77-87
• /
• 2023

재생 에너지 생성에서 중요한 역할을 하는 풍력 터빈은 작동 상태를 정확하게 평가하는 것이 에너지 생산을 극대화하고 가동 중지 시간을 최소화하는 데 매우 중요하다. 이 연구는 풍력 터빈 상태 진단을 위한 다양한 신경망 모델의 비교 분석을 수행하고 센서 측정 및 과거 터빈 데이터가 포함된 데이터 세트를 사용하여 효율성을 평가하였다. 분석을 위해 2MW 이중 여자 유도 발전기 기반 풍력 터빈 시스템(모델 HQ2000)에서 수집된 감시 제어 및 데이터 수집 데이터를 활용했다. 활성화함수, 은닉층 등을 고려하여 인공신경망, 장단기기억, 순환신경망 등 다양한 신경망 모델을 구축하였다. 대칭 평균 절대 백분율 오류는 모델의 성능을 평가하는 데 사용되었다. 평가를 바탕으로 풍력 터빈 상태 진단을 위한 신경망 모델의 상대적 효율성에 관한 결론이 도출되었다. 본 연구결과는 풍력발전기의 상태진단을 위한 모델선정의 길잡이가 되며, 고도의 신경망 기반 기법을 통한 신뢰성 및 효율성 향상에 기여하고, 향후 관련연구의 방향을 제시하는데 기여한다.

• 한국물환경학회지
• /
• 제39권1호
• /
• pp.46-60
• /
• 2023

Climate change causes fluctuations in water quality in the aquatic environment, which can cause changes in water circulation patterns and severe adverse effects on aquatic ecosystems in the future. Therefore, research is needed to predict and respond to water quality changes caused by climate change in advance. In this study, we tried to predict the dissolved oxygen (DO), chlorophyll-a, and turbidity of the Paldang reservoir for about two weeks using long short-term memory (LSTM) and gated recurrent units (GRU), which are deep learning algorithms based on recurrent neural networks. The model was built based on real-time water quality data and meteorological data. The observation period was set from July to September in the summer of 2021 (Period 1) and from March to May in the spring of 2022 (Period 2). We tried to select an algorithm with optimal predictive power for each water quality parameter. In addition, to improve the predictive power of the model, an important variable extraction technique using random forest was used to select only the important variables as input variables. In both Periods 1 and 2, the predictive power after extracting important variables was further improved. Except for DO in Period 2, GRU was selected as the best model in all water quality parameters. This methodology can be useful for preventive water quality management by identifying the variability of water quality in advance and predicting water quality in a short period.

• 청정기술
• /
• 제28권2호
• /
• pp.138-146
• /
• 2022

Electricity has become a factor that dramatically affects the market economy. The day-ahead system marginal price determines electricity prices, and system marginal price forecasting is critical in maintaining energy management systems. There have been several studies using mathematics and machine learning models to forecast the system marginal price, but few studies have been conducted to develop, compare, and analyze various machine learning and deep learning models based on a data-driven framework. Therefore, in this study, different machine learning algorithms (i.e., autoregressive-based models such as the autoregressive integrated moving average model) and deep learning networks (i.e., recurrent neural network-based models such as the long short-term memory and gated recurrent unit model) are considered and integrated evaluation metrics including a forecasting test and information criteria are proposed to discern the optimal forecasting model. A case study of South Korea using long-term time-series system marginal price data from 2016 to 2021 was applied to the developed framework. The results of the study indicate that the autoregressive integrated moving average model (R-squared score: 0.97) and the gated recurrent unit model (R-squared score: 0.94) are appropriate for system marginal price forecasting. This study is expected to contribute significantly to energy management systems and the suggested framework can be explicitly applied for renewable energy networks.

• 한국수자원학회:학술대회논문집
• /
• 한국수자원학회 2023년도 학술발표회
• /
• pp.37-37
• /
• 2023

There is currently a high-accuracy modern forecasting method that uses machine learning algorithms or artificial neural network models to forecast river water levels or flowrate. As a result, this study aims to develop a mathematical model based on artificial neural networks to effectively forecast river water levels upstream of Tranh Culvert in North Vietnam's Bac Hung Hai irrigation system. The mathematical model was thoroughly studied and evaluated by using hydrological data from six gauge stations over a period of twenty-two years between 2000 and 2022. Furthermore, the results of the developed model were also compared to those of the long-short-term memory neural networks model. This study performs four predictions, with a forecast time ranging from 6 to 24 hours and a time step of 6 hours. To validate and test the model's performance, the Nash-Sutcliffe efficiency coefficient (NSE), mean absolute error, and root mean squared error were calculated. During the testing phase, the NSE of the model varies from 0.981 to 0.879, corresponding to forecast cases from one to four time steps ahead. The forecast results from the model are very reasonable, indicating that the model performed excellently. Therefore, the proposed model can be used to forecast water levels in North Vietnam's irrigation system or rivers impacted by tides.

• 한국정보처리학회:학술대회논문집
• /
• 한국정보처리학회 2018년도 추계학술발표대회
• /
• pp.613-616
• /
• 2018

Sequence tagging is an important task in Natural Language Processing (NLP), in which the Named Entity Recognition (NER) is the key issue. So far the most widely adopted model for NER in NLP is that of combining the neural network of bidirectional long short-term memory (BiLSTM) and the statistical sequence prediction method of Conditional Random Field (CRF). In this work, we improve the prediction accuracy of the BiLSTM by supporting an aligned word representation mechanism. We have performed experiments on multilingual (English, Spanish and Dutch) datasets and confirmed that our proposed model outperformed the existing state-of-the-art models.

• International Journal of Advanced Culture Technology
• /
• 제11권4호
• /
• pp.393-405
• /
• 2023

Accurate prediction of wind speed and power is vital for enhancing the efficiency of wind energy systems. Numerous solutions have been implemented to date, demonstrating their potential to improve forecasting. Among these, deep learning is perceived as a revolutionary approach in the field. However, despite their effectiveness, the noise present in the collected data remains a significant challenge. This noise has the potential to diminish the performance of these algorithms, leading to inaccurate predictions. In response to this, this study explores a novel feature engineering approach. This approach involves altering the data input shape in both Convolutional Neural Network-Long Short-Term Memory (CNN-LSTM) and Autoregressive models for various forecasting horizons. The results reveal substantial enhancements in model resilience against noise resulting from step increases in data. The approach could achieve an impressive 83% accuracy in predicting unseen data up to the 24th steps. Furthermore, this method consistently provides high accuracy for short, mid, and long-term forecasts, outperforming the performance of individual models. These findings pave the way for further research on noise reduction strategies at different forecasting horizons through shape-wise feature engineering.

• Journal of Information Processing Systems
• /
• 제19권5호
• /
• pp.688-701
• /
• 2023

The conventional methods of network intrusion detection system (NIDS) cannot measure the trend of intrusiondetection targets effectively, which lead to low detection accuracy. In this study, a NIDS method which based on a deep neural network in a big-data environment is proposed. Firstly, the entire framework of the NIDS model is constructed in two stages. Feature reduction and anomaly probability output are used at the core of the two stages. Subsequently, a convolutional neural network, which encompasses a down sampling layer and a characteristic extractor consist of a convolution layer, the correlation of inputs is realized by introducing bidirectional long short-term memory. Finally, after the convolution layer, a pooling layer is added to sample the required features according to different sampling rules, which promotes the overall performance of the NIDS model. The proposed NIDS method and three other methods are compared, and it is broken down under the conditions of the two databases through simulation experiments. The results demonstrate that the proposed model is superior to the other three methods of NIDS in two databases, in terms of precision, accuracy, F1- score, and recall, which are 91.64%, 93.35%, 92.25%, and 91.87%, respectively. The proposed algorithm is significant for improving the accuracy of NIDS.