• Title/Summary/Keyword: deep Learning

Search Result 5,763, Processing Time 0.028 seconds

A Study on the Development of DGA based on Deep Learning (Deep Learning 기반의 DGA 개발에 대한 연구)

  • Park, Jae-Gyun;Choi, Eun-Soo;Kim, Byung-June;Zhang, Pan
    • Korean Journal of Artificial Intelligence
    • /
    • v.5 no.1
    • /
    • pp.18-28
    • /
    • 2017
  • Recently, there are many companies that use systems based on artificial intelligence. The accuracy of artificial intelligence depends on the amount of learning data and the appropriate algorithm. However, it is not easy to obtain learning data with a large number of entity. Less data set have large generalization errors due to overfitting. In order to minimize this generalization error, this study proposed DGA which can expect relatively high accuracy even though data with a less data set is applied to machine learning based genetic algorithm to deep learning based dropout. The idea of this paper is to determine the active state of the nodes. Using Gradient about loss function, A new fitness function is defined. Proposed Algorithm DGA is supplementing stochastic inconsistency about Dropout. Also DGA solved problem by the complexity of the fitness function and expression range of the model about Genetic Algorithm As a result of experiments using MNIST data proposed algorithm accuracy is 75.3%. Using only Dropout algorithm accuracy is 41.4%. It is shown that DGA is better than using only dropout.

Impact parameter prediction of a simulated metallic loose part using convolutional neural network

  • Moon, Seongin;Han, Seongjin;Kang, To;Han, Soonwoo;Kim, Kyungmo;Yu, Yongkyun;Eom, Joseph
    • Nuclear Engineering and Technology
    • /
    • v.53 no.4
    • /
    • pp.1199-1209
    • /
    • 2021
  • The detection of unexpected loose parts in the primary coolant system in a nuclear power plant remains an extremely important issue. It is essential to develop a methodology for the localization and mass estimation of loose parts owing to the high prediction error of conventional methods. An effective approach is presented for the localization and mass estimation of a loose part using machine-learning and deep-learning algorithms. First, a methodology was developed to estimate both the impact location and the mass of a loose part at the same times in a real structure in which geometric changes exist. Second, an impact database was constructed through a series of impact finite-element analyses (FEAs). Then, impact parameter prediction modes were generated for localization and mass estimation of a simulated metallic loose part using machine-learning algorithms (artificial neural network, Gaussian process, and support vector machine) and a deep-learning algorithm (convolutional neural network). The usefulness of the methodology was validated through blind tests, and the noise effect of the training data was also investigated. The high performance obtained in this study shows that the proposed methodology using an FEA-based database and deep learning is useful for localization and mass estimation of loose parts on site.

Development of Semi-Active Control Algorithm Using Deep Q-Network (Deep Q-Network를 이용한 준능동 제어알고리즘 개발)

  • Kim, Hyun-Su;Kang, Joo-Won
    • Journal of Korean Association for Spatial Structures
    • /
    • v.21 no.1
    • /
    • pp.79-86
    • /
    • 2021
  • Control performance of a smart tuned mass damper (TMD) mainly depends on control algorithms. A lot of control strategies have been proposed for semi-active control devices. Recently, machine learning begins to be applied to development of vibration control algorithm. In this study, a reinforcement learning among machine learning techniques was employed to develop a semi-active control algorithm for a smart TMD. The smart TMD was composed of magnetorheological damper in this study. For this purpose, an 11-story building structure with a smart TMD was selected to construct a reinforcement learning environment. A time history analysis of the example structure subject to earthquake excitation was conducted in the reinforcement learning procedure. Deep Q-network (DQN) among various reinforcement learning algorithms was used to make a learning agent. The command voltage sent to the MR damper is determined by the action produced by the DQN. Parametric studies on hyper-parameters of DQN were performed by numerical simulations. After appropriate training iteration of the DQN model with proper hyper-parameters, the DQN model for control of seismic responses of the example structure with smart TMD was developed. The developed DQN model can effectively control smart TMD to reduce seismic responses of the example structure.

Implementation of YOLOv5-based Forest Fire Smoke Monitoring Model with Increased Recognition of Unstructured Objects by Increasing Self-learning data

  • Gun-wo, Do;Minyoung, Kim;Si-woong, Jang
    • International Journal of Advanced Culture Technology
    • /
    • v.10 no.4
    • /
    • pp.536-546
    • /
    • 2022
  • A society will lose a lot of something in this field when the forest fire broke out. If a forest fire can be detected in advance, damage caused by the spread of forest fires can be prevented early. So, we studied how to detect forest fires using CCTV currently installed. In this paper, we present a deep learning-based model through efficient image data construction for monitoring forest fire smoke, which is unstructured data, based on the deep learning model YOLOv5. Through this study, we conducted a study to accurately detect forest fire smoke, one of the amorphous objects of various forms, in YOLOv5. In this paper, we introduce a method of self-learning by producing insufficient data on its own to increase accuracy for unstructured object recognition. The method presented in this paper constructs a dataset with a fixed labelling position for images containing objects that can be extracted from the original image, through the original image and a model that learned from it. In addition, by training the deep learning model, the performance(mAP) was improved, and the errors occurred by detecting objects other than the learning object were reduced, compared to the model in which only the original image was learned.

Research on Forecasting Framework for System Marginal Price based on Deep Recurrent Neural Networks and Statistical Analysis Models

  • Kim, Taehyun;Lee, Yoonjae;Hwangbo, Soonho
    • Clean Technology
    • /
    • v.28 no.2
    • /
    • pp.138-146
    • /
    • 2022
  • Electricity has become a factor that dramatically affects the market economy. The day-ahead system marginal price determines electricity prices, and system marginal price forecasting is critical in maintaining energy management systems. There have been several studies using mathematics and machine learning models to forecast the system marginal price, but few studies have been conducted to develop, compare, and analyze various machine learning and deep learning models based on a data-driven framework. Therefore, in this study, different machine learning algorithms (i.e., autoregressive-based models such as the autoregressive integrated moving average model) and deep learning networks (i.e., recurrent neural network-based models such as the long short-term memory and gated recurrent unit model) are considered and integrated evaluation metrics including a forecasting test and information criteria are proposed to discern the optimal forecasting model. A case study of South Korea using long-term time-series system marginal price data from 2016 to 2021 was applied to the developed framework. The results of the study indicate that the autoregressive integrated moving average model (R-squared score: 0.97) and the gated recurrent unit model (R-squared score: 0.94) are appropriate for system marginal price forecasting. This study is expected to contribute significantly to energy management systems and the suggested framework can be explicitly applied for renewable energy networks.

Efficient Large Dataset Construction using Image Smoothing and Image Size Reduction

  • Jaemin HWANG;Sac LEE;Hyunwoo LEE;Seyun PARK;Jiyoung LIM
    • Korean Journal of Artificial Intelligence
    • /
    • v.11 no.1
    • /
    • pp.17-24
    • /
    • 2023
  • With the continuous growth in the amount of data collected and analyzed, deep learning has become increasingly popular for extracting meaningful insights from various fields. However, hardware limitations pose a challenge for achieving meaningful results with limited data. To address this challenge, this paper proposes an algorithm that leverages the characteristics of convolutional neural networks (CNNs) to reduce the size of image datasets by 20% through smoothing and shrinking the size of images using color elements. The proposed algorithm reduces the learning time and, as a result, the computational load on hardware. The experiments conducted in this study show that the proposed method achieves effective learning with similar or slightly higher accuracy than the original dataset while reducing computational and time costs. This color-centric dataset construction method using image smoothing techniques can lead to more efficient learning on CNNs. This method can be applied in various applications, such as image classification and recognition, and can contribute to more efficient and cost-effective deep learning. This paper presents a promising approach to reducing the computational load and time costs associated with deep learning and provides meaningful results with limited data, enabling them to apply deep learning to a broader range of applications.

A Study on the Evaluation of Concrete Unit-Water Content of FDR Sensor Using Deep Learning and Machine Learning (딥러닝과 머신러닝을 이용한 FDR 센서의 콘크리트 단위수량 평가에 관한 연구)

  • Lee, Seung-Yeop;Youn, Ji-Won;Wi, Gwang-Woo;Yang, Hyun-Min;Lee, Han-Seung
    • Proceedings of the Korean Institute of Building Construction Conference
    • /
    • 2022.11a
    • /
    • pp.29-30
    • /
    • 2022
  • The unit-water content has a very significant effect on the durability of the construction structure and the quality of concrete. Although there are various methods for measuring the unit-water content, there are problems of time required for measurement, precision, and reproducibility. Recently, there is an FDR sensor capable of measuring moisture content in real time through an apparent dielectric constant change of electromagnetic waves. In addition, various artificial intelligence techniques that can non-linearly supplement the accuracy of FDR sensors are being studied. In this study, the accuracy of unit-water content measurement was compared and evaluated using machine learning and deep learning techniques after normalizing the data secured in concrete using frequency domain reflectometry (FDR) sensors used to measure soil moisture at home and abroad. The result of comparing the accuracy of machine learning and deep learning is judged to be excellent in the accuracy of deep learning, which can well express the nonlinear relationship between FDR sensor data and concrete unit-water content.

  • PDF

Predicting Session Conversion on E-commerce: A Deep Learning-based Multimodal Fusion Approach

  • Minsu Kim;Woosik Shin;SeongBeom Kim;Hee-Woong Kim
    • Asia pacific journal of information systems
    • /
    • v.33 no.3
    • /
    • pp.737-767
    • /
    • 2023
  • With the availability of big customer data and advances in machine learning techniques, the prediction of customer behavior at the session-level has attracted considerable attention from marketing practitioners and scholars. This study aims to predict customer purchase conversion at the session-level by employing customer profile, transaction, and clickstream data. For this purpose, we develop a multimodal deep learning fusion model with dynamic and static features (i.e., DS-fusion). Specifically, we base page views within focal visist and recency, frequency, monetary value, and clumpiness (RFMC) for dynamic and static features, respectively, to comprehensively capture customer characteristics for buying behaviors. Our model with deep learning architectures combines these features for conversion prediction. We validate the proposed model using real-world e-commerce data. The experimental results reveal that our model outperforms unimodal classifiers with each feature and the classical machine learning models with dynamic and static features, including random forest and logistic regression. In this regard, this study sheds light on the promise of the machine learning approach with the complementary method for different modalities in predicting customer behaviors.

Study on the Pad Wear Profile Based on the Conditioner Swing Using Deep Learning for CMP Pad Conditioning (CMP 패드 컨디셔닝에서 딥러닝을 활용한 컨디셔너 스윙에 따른 패드 마모 프로파일에 관한 연구)

  • Byeonghun Park;Haeseong Hwang;Hyunseop Lee
    • Tribology and Lubricants
    • /
    • v.40 no.2
    • /
    • pp.67-70
    • /
    • 2024
  • Chemical mechanical planarization (CMP) is an essential process for ensuring high integration when manufacturing semiconductor devices. CMP mainly requires the use of polyurethane-based polishing pads as an ultraprecise process to achieve mechanical material removal and the required chemical reactions. A diamond disk performs pad conditioning to remove processing residues on the pad surface and maintain sufficient surface roughness during CMP. However, the diamond grits attached to the disk cause uneven wear of the pad, leading to the poor uniformity of material removal during CMP. This study investigates the pad wear rate profile according to the swing motion of the conditioner during swing-arm-type CMP conditioning using deep learning. During conditioning, the motion of the swing arm is independently controlled in eight zones of the same pad radius. The experiment includes six swingmotion conditions to obtain actual data on the pad wear rate profile, and deep learning learns the pad wear rate profile obtained in the experiment. The absolute average error rate between the experimental values and learning results is 0.01%. This finding confirms that the experimental results can be well represented by learning. Pad wear rate profile prediction using the learning results reveals good agreement between the predicted and experimental values.

Generalized Steganalysis using Deep Learning (딥러닝을 이용한 범용적 스테그아날리시스)

  • Kim, Hyunjae;Lee, Jaekoo;Kim, Gyuwan;Yoon, Sungroh
    • KIISE Transactions on Computing Practices
    • /
    • v.23 no.4
    • /
    • pp.244-249
    • /
    • 2017
  • Steganalysis is to detect information hidden by steganography inside general data such as images. There are stegoanalysis techniques that use machine learning (ML). Existing ML approaches to steganalysis are based on extracting features from stego images and modeling them. Recently deep learning-based methodologies have shown significant improvements in detection accuracy. However, all the existing methods, including deep learning-based ones, have a critical limitation in that they can only detect stego images that are created by a specific steganography method. In this paper, we propose a generalized steganalysis method that can model multiple types of stego images using deep learning. Through various experiments, we confirm the effectiveness of our approach and envision directions for future research. In particular, we show that our method can detect each type of steganography with the same level of accuracy as that of a steganalysis method dedicated to that type of steganography, thereby demonstrating the general applicability of our approach to multiple types of stego images.