• International Journal of Internet, Broadcasting and Communication
• /
• 제16권3호
• /
• pp.236-241
• /
• 2024

Due to the recent emphasis on carbon neutrality and environmental regulations, the global electric vehicle (EV) market is experiencing rapid growth. This surge has raised concerns about the recycling and disposal methods for EV batteries. Unlike traditional internal combustion engine vehicles, EVs require unique and safe methods for the recovery and disposal of their batteries. In this process, predicting the lifespan of the battery is essential. Impedance and State of Charge (SOC) analysis are commonly used methods for this purpose. However, predicting the lifespan of batteries with complex chemical characteristics through electrical measurements presents significant challenges. To enhance the accuracy and precision of existing measurement methods, this paper proposes using a Long Short-Term Memory (LSTM) model, a type of deep learning-based recurrent neural network, to diagnose battery performance. The goal is to achieve safe classification through this model. The designed structure was evaluated, yielding results with a Mean Absolute Error (MAE) of 0.8451, a Root Mean Square Error (RMSE) of 1.3448, and an accuracy of 0.984, demonstrating excellent performance.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제17권1호
• /
• pp.239-260
• /
• 2023

The underwater acoustic wireless communication networks are generally formed by the different autonomous underwater acoustic vehicles, and transceivers interconnected to the bottom of the ocean with battery deployed modems. Orthogonal frequency division multiplexing (OFDM) has become the most popular modulation technique in underwater acoustic communication due to its high data transmission and robustness over other symmetrical modulation techniques. To maintain the operability of underwater acoustic communication networks, the power consumption of battery-operated transceivers becomes a vital necessity to be minimized. The OFDM technology has a major lack of peak to average power ratio (PAPR) which results in the consumption of more power, creating non-linear distortion and increasing the bit error rate (BER). To overcome this situation, we have contributed our symmetry research into three dimensions. Firstly, we propose a machine learning-based underwater acoustic communication system through long short-term memory neural network (LSTM-NN). Secondly, the proposed LSTM-NN reduces the PAPR and makes the system reliable and efficient, which turns into a better performance of BER. Finally, the simulation and water tank experimental data results are executed which proves that the LSTM-NN is the best solution for mitigating the PAPR with non-linear distortion and complexity in the overall communication system.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제17권7호
• /
• pp.1759-1772
• /
• 2023

Chinese named entity recognition (NER) is a challenging work that seeks to find, recognize and classify various types of information elements in unstructured text. Due to the Chinese text has no natural boundary like the spaces in the English text, Chinese named entity identification is much more difficult. At present, most deep learning based NER models are developed using a bidirectional long short-term memory network (BiLSTM), yet the performance still has some space to improve. To further improve their performance in Chinese NER tasks, we propose a new NER model, IDCNN-BiLSTM-Highway, which is a combination of the BiLSTM, the iterated dilated convolutional neural network (IDCNN) and the highway network. In our model, IDCNN is used to achieve multiscale context aggregation from a long sequence of words. Highway network is used to effectively connect different layers of networks, allowing information to pass through network layers smoothly without attenuation. Finally, the global optimum tag result is obtained by introducing conditional random field (CRF). The experimental results show that compared with other popular deep learning-based NER models, our model shows superior performance on two Chinese NER data sets: Resume and Yidu-S4k, The F1-scores are 94.98 and 77.59, respectively.

• Wind and Structures
• /
• 제38권2호
• /
• pp.147-160
• /
• 2024

The aerodynamic force is a significant component that influences the stability and safety of structures. It has unstable properties and depends on computer precision, making its long-term prediction challenging. Accurately estimating the aerodynamic traits of structures is critical for structural design and vibration control. This paper establishes an unsteady aerodynamic time series prediction model using Long Short-Term Memory (LSTM) network. The unsteady aerodynamic force under varied Reynolds number and angles of attack is predicted by the LSTM model. The input of the model is the aerodynamic coefficients of the 1 to n sample points and output is the aerodynamic coefficients of the n+1 sample point. The model is predicted by interpolation and extrapolation utilizing Unsteady Reynolds-average Navier-Stokes (URANS) simulation data of flow around a circular cylinder, square cylinder and airfoil. The results illustrate that the trajectories of the LSTM prediction results and URANS outcomes are largely consistent with time. The mean relative error between the forecast results and the original results is less than 6%. Therefore, our technique has a prospective application in unsteady aerodynamic force prediction of structures and can give technical assistance for engineering applications.

• 정보처리학회논문지:소프트웨어 및 데이터공학
• /
• 제7권8호
• /
• pp.307-324
• /
• 2018

최근 순환 신경 망(Recurrent Neural Networks)은 시간에 대한 의존성을 고려한 구조를 통해 순차 데이터(Sequential data)의 예측 문제 해결에서 각광받고 있다. 하지만 순차 데이터의 시간 스텝이 늘어남에 따라 발생하는 그라디언트 소실(Gradients vanishing)이 문제로 대두되었다. 이를 해결하기 위해 장단기 기억 모델(Long Short-Term Memory)이 제안되었지만, 많은 데이터를 저장하고 장기간 보존하는 데에 한계가 있다. 따라서 순환 신경망과 메모리 요소(Memory component)를 활용한 학습 모델인 메모리-증대 신경망(Memory-Augmented Neural Networks)에 대한 연구가 최근 활발히 진행되고 있다. 본 논문에서는 딥 러닝(Deep Learning) 분야의 화두로 떠오른 메모리-증대 신경망 주요 모델들의 구조와 특징을 열거하고, 이를 활용한 최신 기법들과 향후 연구 방향을 제시한다.

• 전력전자학회논문지
• /
• 제26권3호
• /
• pp.183-191
• /
• 2021

A battery management system (BMS) provides some functions for ensuring safety and reliability that includes algorithms estimating battery states. Given the changes caused by various operating conditions, the state-of-health (SOH), which represents a figure of merit of the battery's ability to store and deliver energy, becomes challenging to estimate. Machine learning methods can be applied to perform accurate SOH estimation. In this study, we propose a Long-Term Recurrent Convolutional Network (LRCN) that combines the Convolutional Neural Network (CNN) and Long Short-term Memory (LSTM) to extract aging characteristics and learn temporal mechanisms. The dataset collected by the battery aging experiments of NASA PCoE is used to train models. The input dataset used part of the charging profile. The accuracy of the proposed model is compared with the CNN and LSTM models using the k-fold cross-validation technique. The proposed model achieves a low RMSE of 2.21%, which shows higher accuracy than others in SOH estimation.

• 대한원격탐사학회지
• /
• 제38권6_1호
• /
• pp.1047-1056
• /
• 2022

지구 온난화의 중요한 지시자인 북극의 바다 얼음인 해빙은 기후 시스템, 선박의 항로 안내, 어업 활동 등에서의 중요성으로 인해 다양한 학문 분야에서 관심을 받고 있다. 최근 자동화와 효율적인 미래 예측에 대한 요구가 커지면서 인공지능을 이용한 새로운 해빙 예측 모델들이 전통적인 수치 및 통계 예측 모델을 대체하기 위해 개발되고 있다. 본 연구에서는 북극 해빙의 전역적, 지역적 특징을 학습할 수 있는 two-stream convolutional long- and short-term memory (TS-ConvLSTM) 인공지능 모델의 북극 해빙 면적이 최저를 보이는 9월에 대해 2001년부터 2021년까지 장기적인 성능 검증을 통해 향후 운용 가능한 시스템으로써의 가능성을 살펴보고자 한다. 장기 자료를 통한 검증 결과 TS-ConvLSTM 모델이 훈련자료의 양이 증가하면서 향상된 예측 성능을 보여주고 있지만, 최근 지구 온난화로 인한 단년생 해빙의 감소로 인해 해빙 농도 5-50% 구간에서는 예측력이 저하되고 있음을 보여주었다. 반면 TS-ConvLSTM에 의해 예측된 해빙 면적과 달리 Sea Ice Prediction Network에 제출된 Sea Ice Outlook (SIO)들의 해빙 면적 중간값의 경우 훈련자료가 늘어나더라도 눈에 띄는 향상을 보이지 않았다. 본 연구를 통해 TS-ConvLSTM 모델의 향후 북극 해빙 예측 시스템의 운용 가능 잠재성을 확인하였으나, 향후 연구에서는 예측이 어려운 자연 환경에서 더욱 안정성 있는 예측 시스템 개발을 위해 더 많은 시공간 변화 패턴을 학습할 수 있는 방안을 고려해야 할 것이다.

• International Journal of Advanced Culture Technology
• /
• 제5권1호
• /
• pp.83-89
• /
• 2017

In this paper, we propose an extended method of one-hot Long Short-Term Memory (LSTM) and evaluate the performance on spam filtering task. Most of traditional methods proposed for spam filtering task use word occurrences to represent spam or non-spam messages and all syntactic and semantic information are ignored. Major issue appears when both spam and non-spam messages share many common words and noise words. Therefore, it becomes challenging to the system to filter correct labels between spam and non-spam. Unlike previous studies on information filtering task, instead of using only word occurrence and word context as in probabilistic models, we apply a neural network-based approach to train the system filter for a better performance. In addition to one-hot representation, using term weight with attention mechanism allows classifier to focus on potential words which most likely appear in spam and non-spam collection. As a result, we obtained some improvement over the performances of the previous methods. We find out using region embedding and pooling features on the top of LSTM along with attention mechanism allows system to explore a better document representation for filtering task in general.

• 정보과학회 논문지
• /
• 제44권11호
• /
• pp.1125-1129
• /
• 2017

LSTM(Long Short-term Memory)은 이전 상태의 정보를 기억하여 현재 상태에 반영해 학습하는 순환신경망(Recurrent Neural Network) 모델이다. 악성코드에서 선형적 순서 정보는 각 시점에서 호출되는 함수로서 정의 가능하다. 본 논문에서는 LSTM 모델의 이전 상태를 기억하는 특성을 이용하며, 시간 순서에 따른 악성코드의 함수 호출 정보를 입력으로 사용한다. 그리고 실험으로서 우리가 제시한 방법이 악성코드 분류가 가능함을 보이고 순서 정보의 길이 변화에 따른 정확률을 측정한다.

• Journal of Information Processing Systems
• /
• 제17권4호
• /
• pp.707-720
• /
• 2021

To improve the accuracy of the recommendation system, multi-criteria recommendation systems have been widely researched. However, it is highly complicated to extract the preferred features of users and items from the data. To this end, subjective indicators, which indicate a user's priorities for personalized recommendations, should be derived. In this study, we propose a method for generating recommendation candidates by predicting multi-criteria ratings from reviews and using them to derive user priorities. Using a deep learning model based on convolutional neural network (CNN) and bidirectional long short-term memory (BiLSTM), multi-criteria prediction ratings were derived from reviews. These ratings were then aggregated to form a linear regression model to predict the overall rating. This model not only predicts the overall rating but also uses the training weights from the layers of the model as the user's priority. Based on this, a new score matrix for recommendation is derived by calculating the similarity between the user and the item according to the criteria, and an item suitable for the user is proposed. The experiment was conducted by collecting the actual "TripAdvisor" dataset. For performance evaluation, the proposed method was compared with a general recommendation system based on singular value decomposition. The results of the experiments demonstrate the high performance of the proposed method.