• Title/Summary/Keyword: neural network.

Search Result 11,767, Processing Time 0.036 seconds

Resilience against Adversarial Examples: Data-Augmentation Exploiting Generative Adversarial Networks

  • Kang, Mingu;Kim, HyeungKyeom;Lee, Suchul;Han, Seokmin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.11
    • /
    • pp.4105-4121
    • /
    • 2021
  • Recently, malware classification based on Deep Neural Networks (DNN) has gained significant attention due to the rise in popularity of artificial intelligence (AI). DNN-based malware classifiers are a novel solution to combat never-before-seen malware families because this approach is able to classify malwares based on structural characteristics rather than requiring particular signatures like traditional malware classifiers. However, these DNN-based classifiers have been found to lack robustness against malwares that are carefully crafted to evade detection. These specially crafted pieces of malware are referred to as adversarial examples. We consider a clever adversary who has a thorough knowledge of DNN-based malware classifiers and will exploit it to generate a crafty malware to fool DNN-based classifiers. In this paper, we propose a DNN-based malware classifier that becomes resilient to these kinds of attacks by exploiting Generative Adversarial Network (GAN) based data augmentation. The experimental results show that the proposed scheme classifies malware, including AEs, with a false positive rate (FPR) of 3.0% and a balanced accuracy of 70.16%. These are respective 26.1% and 18.5% enhancements when compared to a traditional DNN-based classifier that does not exploit GAN.

Application and Research of Monte Carlo Sampling Algorithm in Music Generation

  • MIN, Jun;WANG, Lei;PANG, Junwei;HAN, Huihui;Li, Dongyang;ZHANG, Maoqing;HUANG, Yantai
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.10
    • /
    • pp.3355-3372
    • /
    • 2022
  • Composing music is an inspired yet challenging task, in that the process involves many considerations such as assigning pitches, determining rhythm, and arranging accompaniment. Algorithmic composition aims to develop algorithms for music composition. Recently, algorithmic composition using artificial intelligence technologies received considerable attention. In particular, computational intelligence is widely used and achieves promising results in the creation of music. This paper attempts to provide a survey on the music generation based on the Monte Carlo (MC) algorithm. First, transform the MIDI music format files to digital data. Among these data, use the logistic fitting method to fit the time series, obtain the time distribution regular pattern. Except for time series, the converted data also includes duration, pitch, and velocity. Second, using MC simulation to deal with them summed up their distribution law respectively. The two main control parameters are the value of discrete sampling and standard deviation. Processing the above parameters and converting the data to MIDI file, then compared with the output generated by LSTM neural network, evaluate the music comprehensively.

Deep Learning Based Electricity Demand Prediction and Power Grid Operation according to Urbanization Rate and Industrial Differences (도시화율 및 산업 구성 차이에 따른 딥러닝 기반 전력 수요 변동 예측 및 전력망 운영)

  • KIM, KAYOUNG;LEE, SANGHUN
    • Journal of Hydrogen and New Energy
    • /
    • v.33 no.5
    • /
    • pp.591-597
    • /
    • 2022
  • Recently, technologies for efficient power grid operation have become important due to climate change. For this reason, predicting power demand using deep learning is being considered, and it is necessary to understand the influence of characteristics of each region, industrial structure, and climate. This study analyzed the power demand of New Jersey in US, with a high urbanization rate and a large service industry, and West Virginia in US, a low urbanization rate and a large coal, energy, and chemical industries. Using recurrent neural network algorithm, the power demand from January 2020 to August 2022 was learned, and the daily and weekly power demand was predicted. In addition, the power grid operation based on the power demand forecast was discussed. Unlike previous studies that have focused on the deep learning algorithm itself, this study analyzes the regional power demand characteristics and deep learning algorithm application, and power grid operation strategy.

Point-level deep learning approach for 3D acoustic source localization

  • Lee, Soo Young;Chang, Jiho;Lee, Seungchul
    • Smart Structures and Systems
    • /
    • v.29 no.6
    • /
    • pp.777-783
    • /
    • 2022
  • Even though several deep learning-based methods have been applied in the field of acoustic source localization, the previous works have only been conducted using the two-dimensional representation of the beamforming maps, particularly with the planar array system. While the acoustic sources are more required to be localized in a spherical microphone array system considering that we live and hear in the 3D world, the conventional 2D equirectangular map of the spherical beamforming map is highly vulnerable to the distortion that occurs when the 3D map is projected to the 2D space. In this study, a 3D deep learning approach is proposed to fulfill accurate source localization via distortion-free 3D representation. A target function is first proposed to obtain 3D source distribution maps that can represent multiple sources' positional and strength information. While the proposed target map expands the source localization task into a point-wise prediction task, a PointNet-based deep neural network is developed to precisely estimate the multiple sources' positions and strength information. While the proposed model's localization performance is evaluated, it is shown that the proposed method can achieve improved localization results from both quantitative and qualitative perspectives.

Shield TBM disc cutter replacement and wear rate prediction using machine learning techniques

  • Kim, Yunhee;Hong, Jiyeon;Shin, Jaewoo;Kim, Bumjoo
    • Geomechanics and Engineering
    • /
    • v.29 no.3
    • /
    • pp.249-258
    • /
    • 2022
  • A disc cutter is an excavation tool on a tunnel boring machine (TBM) cutterhead; it crushes and cuts rock mass while the machine excavates using the cutterhead's rotational movement. Disc cutter wear occurs naturally. Thus, along with the management of downtime and excavation efficiency, abrasioned disc cutters need to be replaced at the proper time; otherwise, the construction period could be delayed and the cost could increase. The most common prediction models for TBM performance and for the disc cutter lifetime have been proposed by the Colorado School of Mines and Norwegian University of Science and Technology. However, design parameters of existing models do not well correspond to the field values when a TBM encounters complex and difficult ground conditions in the field. Thus, this study proposes a series of machine learning models to predict the disc cutter lifetime of a shield TBM using the excavation (machine) data during operation which is response to the rock mass. This study utilizes five different machine learning techniques: four types of classification models (i.e., K-Nearest Neighbors (KNN), Support Vector Machine, Decision Tree, and Staking Ensemble Model) and one artificial neural network (ANN) model. The KNN model was found to be the best model among the four classification models, affording the highest recall of 81%. The ANN model also predicted the wear rate of disc cutters reasonably well.

Prediction of the static and dynamic mechanical properties of sedimentary rock using soft computing methods

  • Lawal, Abiodun I.;Kwon, Sangki;Aladejare, Adeyemi E.;Oniyide, Gafar O.
    • Geomechanics and Engineering
    • /
    • v.28 no.3
    • /
    • pp.313-324
    • /
    • 2022
  • Rock properties are important in the design of mines and civil engineering excavations to prevent the imminent failure of slopes and collapse of underground excavations. However, the time, cost, and expertise required to perform experiments to determine those properties are high. Therefore, empirical models have been developed for estimating the mechanical properties of rock that are difficult to determine experimentally from properties that are less difficult to measure. However, the inherent variability in rock properties makes the accurate performance of the empirical models unrealistic and therefore necessitate the use of soft computing models. In this study, Gaussian process regression (GPR), artificial neural network (ANN) and response surface method (RSM) have been proposed to predict the static and dynamic rock properties from the P-wave and rock density. The outcome of the study showed that GPR produced more accurate results than the ANN and RSM models. GPR gave the correlation coefficient of above 99% for all the three properties predicted and RMSE of less than 5. The detailed sensitivity analysis is also conducted using the RSM and the P-wave velocity is found to be the most influencing parameter in the rock mechanical properties predictions. The proposed models can give reasonable predictions of important mechanical properties of sedimentary rock.

Forecasting Chemical Tanker Freight Rate with ANN

  • Lim, Sangseop;Kim, Seokhun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.4
    • /
    • pp.113-118
    • /
    • 2021
  • In this paper, we propose an efficient dynamic workload balancing strategy which improves the performance of high-performance computing system. The key idea of this dynamic workload balancing strategy is to minimize execution time of each job and to maximize the system throughput by effectively using system resource such as CPU, memory. Also, this strategy dynamically allocates job by considering demanded memory size of executing job and workload status of each node. If an overload node occurs due to allocated job, the proposed scheme migrates job, executing in overload nodes, to another free nodes and reduces the waiting time and execution time of job by balancing workload of each node. Through simulation, we show that the proposed dynamic workload balancing strategy based on CPU, memory improves the performance of high-performance computing system compared to previous strategies.

Proposing a gamma radiation based intelligent system for simultaneous analyzing and detecting type and amount of petroleum by-products

  • Roshani, Mohammadmehdi;Phan, Giang;Faraj, Rezhna Hassan;Phan, Nhut-Huan;Roshani, Gholam Hossein;Nazemi, Behrooz;Corniani, Enrico;Nazemi, Ehsan
    • Nuclear Engineering and Technology
    • /
    • v.53 no.4
    • /
    • pp.1277-1283
    • /
    • 2021
  • It is important for operators of poly-pipelines in petroleum industry to continuously monitor characteristics of transferred fluid such as its type and amount. To achieve this aim, in this study a dual energy gamma attenuation technique in combination with artificial neural network (ANN) is proposed to simultaneously determine type and amount of four different petroleum by-products. The detection system is composed of a dual energy gamma source, including americium-241 and barium-133 radioisotopes, and one 2.54 cm × 2.54 cm sodium iodide detector for recording the transmitted photons. Two signals recorded in transmission detector, namely the counts under photo peak of Americium-241 with energy of 59.5 keV and the counts under photo peak of Barium-133 with energy of 356 keV, were applied to the ANN as the two inputs and volume percentages of petroleum by-products were assigned as the outputs.

An artificial intelligence-based design model for circular CFST stub columns under axial load

  • Ipek, Suleyman;Erdogan, Aysegul;Guneyisi, Esra Mete
    • Steel and Composite Structures
    • /
    • v.44 no.1
    • /
    • pp.119-139
    • /
    • 2022
  • This paper aims to use the artificial intelligence approach to develop a new model for predicting the ultimate axial strength of the circular concrete-filled steel tubular (CFST) stub columns. For this, the results of 314 experimentally tested circular CFST stub columns were employed in the generation of the design model. Since the influence of the column diameter, steel tube thickness, concrete compressive strength, steel tube yield strength, and column length on the ultimate axial strengths of columns were investigated in these experimental studies, here, in the development of the design model, these variables were taken into account as input parameters. The model was developed using the backpropagation algorithm named Bayesian Regularization. The accuracy, reliability, and consistency of the developed model were evaluated statistically, and also the design formulae given in the codes (EC4, ACI, AS, AIJ, and AISC) and the previous empirical formulations proposed by other researchers were used for the validation and comparison purposes. Based on this evaluation, it can be expressed that the developed design model has a strong and reliable prediction performance with a considerably high coefficient of determination (R-squared) value of 0.9994 and a low average percent error of 4.61. Besides, the sensitivity of the developed model was also monitored in terms of dimensional properties of columns and mechanical characteristics of materials. As a consequence, it can be stated that for the design of the ultimate axial capacity of the circular CFST stub columns, a novel artificial intelligence-based design model with a good and robust prediction performance was proposed herein.

Encoding Dictionary Feature for Deep Learning-based Named Entity Recognition

  • Ronran, Chirawan;Unankard, Sayan;Lee, Seungwoo
    • International Journal of Contents
    • /
    • v.17 no.4
    • /
    • pp.1-15
    • /
    • 2021
  • Named entity recognition (NER) is a crucial task for NLP, which aims to extract information from texts. To build NER systems, deep learning (DL) models are learned with dictionary features by mapping each word in the dataset to dictionary features and generating a unique index. However, this technique might generate noisy labels, which pose significant challenges for the NER task. In this paper, we proposed DL-dictionary features, and evaluated them on two datasets, including the OntoNotes 5.0 dataset and our new infectious disease outbreak dataset named GFID. We used (1) a Bidirectional Long Short-Term Memory (BiLSTM) character and (2) pre-trained embedding to concatenate with (3) our proposed features, named the Convolutional Neural Network (CNN), BiLSTM, and self-attention dictionaries, respectively. The combined features (1-3) were fed through BiLSTM - Conditional Random Field (CRF) to predict named entity classes as outputs. We compared these outputs with other predictions of the BiLSTM character, pre-trained embedding, and dictionary features from previous research, which used the exact matching and partial matching dictionary technique. The findings showed that the model employing our dictionary features outperformed other models that used existing dictionary features. We also computed the F1 score with the GFID dataset to apply this technique to extract medical or healthcare information.