• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.33 no.5
• /
• pp.761-773
• /
• 2023

This paper proposes a method to increase the power-analysis resistance of the neural network model's feedforward process by replacing the exponential-based activation function, used in the deep-learning field, with an approximated function especially at the multi-layer perceptron model. Due to its nature, the feedforward process of neural networks calculates secret weight and bias, which already trained, so it has risk of exposure of internal information by side-channel attacks. However, various functions are used as the activation function in neural network, so it's difficult to apply conventional side-channel countermeasure techniques, such as masking, to activation function(especially, to exponential-based activation functions). Therefore, this paper shows that even if an exponential-based activation function is replaced with approximated function of simple form, there is no fatal performance degradation of the model, and than suggests a power-analysis resistant feedforward neural network with exponential-based activation function, by masking approximated function and whole network.

• Industry Promotion Research
• /
• v.6 no.1
• /
• pp.1-7
• /
• 2021

We investigated multi-layer perceptrons and supervised learning algorithms, and also examined how to model functional relationships between covariates and response variables using a package called neuralnet. The algorithm applied in this paper is characterized by continuous adjustment of the weights, which are parameters to minimize the error function based on the comparison between the actual and predicted values of the response variable. In the neuralnet package, the activation and error functions can be appropriately selected according to the given situation, and the remaining parameters can be set as default values. As a result of using the neuralnet package for the infertility data, we found that age has little influence on infertility among the four independent variables. In addition, the weight of the neural network takes various values from -751.6 to 7.25, and the intercepts of the first hidden layer are -92.6 and 7.25, and the weights for the covariates age, parity, induced, and spontaneous to the first hidden neuron are identified as 3.17, -5.20, -36.82, and -751.6.

• The Journal of the Acoustical Society of Korea
• /
• v.13 no.6
• /
• pp.5-14
• /
• 1994

This paper is about an experiment of speaker-independent automatic Korean spoken words recognition using Multi-Layered Perceptron and Error Back-propagation algorithm. The object words are 50 citynames of D.D.D local numbers. 43 of those are 2 syllables and the rest 7 are 3 syllables. The words were not segmented into syllables or phonemes, and some feature components extracted from the words in equal gap were applied to the neural network. That led independent result on the speech duration, and the PARCOR coefficients calculated from the frames using linear predictive analysis were employed as feature components. This paper tried to find out the optimum conditions through 4 differerent experiments which are comparison between total and pre-classified training, dependency of recognition rate on the number of frames and PAROCR order, recognition change due to the number of neurons in the hidden layer, and the comparison of the output pattern composition method of output neurons. As a result, the recognition rate of $89.6\%$ is obtaimed through the research.

• Journal of Institute of Control, Robotics and Systems
• /
• v.4 no.4
• /
• pp.487-493
• /
• 1998

Camera calibration is the process of determining the coordinate relationship between a camera image and its real world space. Accurate calibration of a camera is necessary for the applications that involve quantitative measurement of camera images. However, if the camera plane is parallel or near parallel to the calibration board on which 2 dimensional objects are defined(this is called "ill-conditioned"), existing solution procedures are not well applied. In this paper, we propose a neural network-based approach to camera calibration for 2D images formed by a mono-camera or a pair of cameras. Multi-layer perceptrons are developed to transform the coordinates of each image point to the world coordinates. The validity of the approach is tested with data points which cover the whole 2D space concerned. Experimental results for both mono-camera and stereo-camera cases indicate that the proposed approach is comparable to Tsai's method［8］. Especially for the stereo camera case, the approach works better than the Tsai's method as the angle between the camera optical axis and the Z-axis increases. Therefore, we believe the approach could be an alternative solution procedure for the ill -conditioned camera calibration.libration.

• Computers and Concrete
• /
• v.10 no.6
• /
• pp.557-573
• /
• 2012

This paper discusses the combined application of two different techniques, Neural Networks (NN) and Principal Component Analysis (PCA), for improved prediction of concrete properties. The combination of these approaches allowed the development of six neural networks models for predicting slump and compressive strength of concrete with mineral additives such as blast furnace slag, fly ash and silica fume. The Back-Propagation Multi-Layer Perceptron (BPMLP) with Bayesian regularization was used in all these models. They are produced to implement the complex nonlinear relationship between the inputs and the output of the network. They are also established through the incorporation of a huge experimental database on concrete organized in the form Mix-Property. Thus, the data comprising the concrete mixtures are much correlated to each others. The PCA is proposed for the compression and the elimination of the correlation between these data. After applying the PCA, the uncorrelated data were used to train the six models. The predictive results of these models were compared with the actual experimental trials. The results showed that the elimination of the correlation between the input parameters using PCA improved the predictive generalisation performance models with smaller architectures and dimensionality reduction. This study showed also that using the developed models for numerical investigations on the parameters affecting the properties of concrete is promising.

• Smart Structures and Systems
• /
• v.14 no.2
• /
• pp.159-189
• /
• 2014

One of the most important requirements in the evaluation of existing structural systems and ensuring a safe performance during their service life is damage assessment. Damage can be defined as a weakening of the structure that adversely affects its current or future performance which may cause undesirable displacements, stresses or vibrations to the structure. The mass and stiffness of a structure will change due to the damage, which in turn changes the measured dynamic response of the system. Damage detection can increase safety, reduce maintenance costs and increase serviceability of the structures. Artificial Neural Networks (ANNs) are simplified models of the human brain and evolved as one of the most useful mathematical concepts used in almost all branches of science and engineering. ANNs have been applied increasingly due to its powerful computational and excellent pattern recognition ability for detecting damage in structural engineering. This paper presents and reviews the technical literature for past two decades on structural damage detection using ANNs with modal parameters such as natural frequencies and mode shapes as inputs.

• Journal of Korean Society for Quality Management
• /
• v.47 no.3
• /
• pp.497-508
• /
• 2019

Purpose: The purpose of this study is to overcome limitations of conventional studies that to predict Baltic Dry Index (BDI). The study proposed applications of Artificial Neural Network (ANN) named Long Short-Term Memory (LSTM) to predict BDI. Methods: The BDI time-series prediction was carried out through eight variables related to the dry bulk market. The prediction was conducted in two steps. First, identifying the goodness of fitness for the BDI time-series of specific ANN models and determining the network structures to be used in the next step. While using ANN's generalization capability, the structures determined in the previous steps were used in the empirical prediction step, and the sliding-window method was applied to make a daily (one-day ahead) prediction. Results: At the empirical prediction step, it was possible to predict variable y(BDI time series) at point of time t by 8 variables (related to the dry bulk market) of x at point of time (t-1). LSTM, known to be good at learning over a long period of time, showed the best performance with higher predictive accuracy compared to Multi-Layer Perceptron (MLP) and Recurrent Neural Network (RNN). Conclusion: Applying this study to real business would require long-term predictions by applying more detailed forecasting techniques. I hope that the research can provide a point of reference in the dry bulk market, and furthermore in the decision-making and investment in the future of the shipping business as a whole.

• Journal of Institute of Control, Robotics and Systems
• /
• v.14 no.8
• /
• pp.818-823
• /
• 2008

In this paper, we propose a feature extraction method which extracts directional features of handwritten numerals by using the projection runlength. Our directional featrures are obtained from four directional images, each of which contains horizontal, vertical, right-diagonal and left-diagonal lines in entire numeral shape respectively. A conventional method which extracts directional features by using Kirsch masks generates edge-shaped double line directional images for four directions, whereas our method uses the projections and their runlengths for four directions to produces single line directional images for four directions. To obtain the directional projections for four directions from a numeral image, some preprocessing steps such as thinning and dilation are required, but the shapes of resultant directional lines are more similar to the numeral lines of input numerals. Four [$4{\times}4$] directional features of a numeral are obtained from four directional line images through a zoning method. By using a hybrid feature which is made by combining our feature with the conventional features of a mesh features, a kirsch directional feature and a concavity feature, higher recognition rates of the handwrittern numerals can be obtained. For recognition test with given features, we use a multi-layer perceptron neural network classifier which is trained with the back propagation algorithm. Through the experiments with the handwritten numeral database of Concordia University, we have achieved a recognition rate of 97.85%.

• Proceedings of the Computational Structural Engineering Institute Conference
• /
• 2006.04a
• /
• pp.1009-1014
• /
• 2006

Synthetic materials with excellent thermodynamic characteristics and the merit of anti-corrosion are frequently used in buildings and constructions for enforcement of bent in stead of steel plates. Among them, many practical studies have been conducted on bond strength because of increased bond strength of FRP plates. Previous investigators identified the bond strength of FRP plates through experiments with settlement of various variables to identify the bond strength. However, the experiments to identify the bond force are difficult to be conducted because they requires large expenses and long time for equipment arrangement, thus, are conducted with limitation. In this study, for bond experiment, optimum neural network model was developed with use of Back-propagation and Conjugate gradient technique of previous investigators. Learning was performed with use of the variables of previous investigators in developed neural network model so as to identify the bond strength of FRP plates. for verification of developed model, credibility and excellence was proven by comparing with the models of previous investigators.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.6 no.1
• /
• pp.64-69
• /
• 2006

Due to the inherent nonlinear nature of Electro-rheological (ER) fluid dampers, one of the challenging aspects for utilizing these devices to achieve high system performance is the development of accurate models and control algorithms that can take advantage of their unique characteristics. In this paper, the nonlinear damping force model is made to identify the properties of the ER damper using higher order spectrum. The higher order spectral analysis is used to investigate the nonlinear frequency coupling phenomena with the damping force signal according to the sinusoidal excitation of the damper. Also, this paper presents an inverse model of the ER damper, i.e., the model can predict the required voltage so that the ER damper can produce the desired force for the requirement of vibration control of vehicle suspension systems. The inverse model is constructed by using a multi-layer perceptron neural network. A quarter-car suspension model is considered in this paper for analysis and simulation. Simulation results show that the proposed inverse model of ER damper can obtain control voltage of ER damper for required damping force.