• Title/Summary/Keyword: Neural network optimization

Search Result 812, Processing Time 0.029 seconds

High-Efficiency Design of Axial Flow Fan through Shape Optimization of Airfoil (익형의 형상최적화를 통한 고효율 축류송풍기 설계)

  • Lee, Ki-Sang;Kim, Kwang-Yong;Choi, Jae-Ho
    • The KSFM Journal of Fluid Machinery
    • /
    • v.11 no.2
    • /
    • pp.46-54
    • /
    • 2008
  • This study presents a numerical optimization to optimize an axial flow fan blade to increase the efficiency. The radial basis neural network is used as an optimization method with the numerical analysis by Reynolds-averaged Navier-Stokes equations using SST model as turbulence closure. Four design variables related to airfoil maximum camber, maximum camber location, leading edge radius and trailing edge radius, respectively, are selected, and efficiency is considered as objective function which is to be maximized. Thirty designs are evaluated to get the objective function values of each design used to train the neural network. Optimum shape shows the efficiency increased by 1.0%.

Analysis of Evolutionary Optimization Methods for CNN Structures (CNN 구조의 진화 최적화 방식 분석)

  • Seo, Kisung
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.6
    • /
    • pp.767-772
    • /
    • 2018
  • Recently, some meta-heuristic algorithms, such as GA(Genetic Algorithm) and GP(Genetic Programming), have been used to optimize CNN(Convolutional Neural Network). The CNN, which is one of the deep learning models, has seen much success in a variety of computer vision tasks. However, designing CNN architectures still requires expert knowledge and a lot of trial and error. In this paper, the recent attempts to automatically construct CNN architectures are investigated and analyzed. First, two GA based methods are summarized. One is the optimization of CNN structures with the number and size of filters, connection between consecutive layers, and activation functions of each layer. The other is an new encoding method to represent complex convolutional layers in a fixed-length binary string, Second, CGP(Cartesian Genetic Programming) based method is surveyed for CNN structure optimization with highly functional modules, such as convolutional blocks and tensor concatenation, as the node functions in CGP. The comparison for three approaches is analysed and the outlook for the potential next steps is suggested.

Neural Network Structure and Parameter Optimization via Genetic Algorithms (유전알고리즘을 이용한 신경망 구조 및 파라미터 최적화)

  • 한승수
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.11 no.3
    • /
    • pp.215-222
    • /
    • 2001
  • Neural network based models of semiconductor manufacturing processes have been shown to offer advantages in both accuracy and generalization over traditional methods. However, model development is often complicated by the fact that back-propagation neural networks contain several adjustable parameters whose optimal values unknown during training. These include learning rate, momentum, training tolerance, and the number of hidden layer neurOnS. This paper presents an investigation of the use of genetic algorithms (GAs) to determine the optimal neural network parameters for the modeling of plasma-enhanced chemical vapor deposition (PECVD) of silicon dioxide films. To find an optimal parameter set for the neural network PECVD models, a performance index was defined and used in the GA objective function. This index was designed to account for network prediction error as well as training error, with a higher emphasis on reducing prediction error. The results of the genetic search were compared with the results of a similar search using the simplex algorithm.

  • PDF

Heart Attack Prediction using Neural Network and Different Online Learning Methods

  • Antar, Rayana Khaled;ALotaibi, Shouq Talal;AlGhamdi, Manal
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.6
    • /
    • pp.77-88
    • /
    • 2021
  • Heart Failure represents a critical pathological case that is challenging to predict and discover at an early age, with a notable increase in morbidity and mortality. Machine Learning and Neural Network techniques play a crucial role in predicting heart attacks, diseases and more. These techniques give valuable perspectives for clinicians who may then adjust their diagnosis for each individual patient. This paper evaluated neural network models for heart attacks predictions. Several online learning methods were investigated to automatically and accurately predict heart attacks. The UCI dataset was used in this work to train and evaluate First Order and Second Order Online Learning methods; namely Backpropagation, Delta bar Delta, Levenberg Marquardt and QuickProp learning methods. An optimizer technique was also used to minimize the random noise in the database. A regularization concept was employed to further improve the generalization of the model. Results show that a three layers' NN model with a Backpropagation algorithm and Nadam optimizer achieved a promising accuracy for the heart attach prediction tasks.

The development of four efficient optimal neural network methods in forecasting shallow foundation's bearing capacity

  • Hossein Moayedi;Binh Nguyen Le
    • Computers and Concrete
    • /
    • v.34 no.2
    • /
    • pp.151-168
    • /
    • 2024
  • This research aimed to appraise the effectiveness of four optimization approaches - cuckoo optimization algorithm (COA), multi-verse optimization (MVO), particle swarm optimization (PSO), and teaching-learning-based optimization (TLBO) - that were enhanced with an artificial neural network (ANN) in predicting the bearing capacity of shallow foundations located on cohesionless soils. The study utilized a database of 97 laboratory experiments, with 68 experiments for training data sets and 29 for testing data sets. The ANN algorithms were optimized by adjusting various variables, such as population size and number of neurons in each hidden layer, through trial-and-error techniques. Input parameters used for analysis included width, depth, geometry, unit weight, and angle of shearing resistance. After performing sensitivity analysis, it was determined that the optimized architecture for the ANN structure was 5×5×1. The study found that all four models demonstrated exceptional prediction performance: COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP. It is worth noting that the MVO-MLP model exhibited superior accuracy in generating network outputs for predicting measured values compared to the other models. The training data sets showed R2 and RMSE values of (0.07184 and 0.9819), (0.04536 and 0.9928), (0.09194 and 0.9702), and (0.04714 and 0.9923) for COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP methods respectively. Similarly, the testing data sets produced R2 and RMSE values of (0.08126 and 0.07218), (0.07218 and 0.9814), (0.10827 and 0.95764), and (0.09886 and 0.96481) for COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP methods respectively.

Promoter classification using genetic algorithm controlled generalized regression neural network

  • Kim, Kun-Ho;Kim, Byun-Gwhan;Kim, Kyung-Nam;Hong, Jin-Han;Park, Sang-Ho
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.2226-2229
    • /
    • 2003
  • A new method is presented to construct a classifier. This was accomplished by combining a generalized regression neural network (GRNN) and a genetic algorithm (GA). The classifier constructed in this way is referred to as a GA-GRNN. The GA played a role of controlling training factors simultaneously. In GA optimization, neuron spreads were represented in a chromosome. The proposed optimization method was applied to a data set, consisted of 4 different promoter sequences. The training and test data were composed of 115 and 58 sequence patterns, respectively. The range of neuron spreads was experimentally varied from 0.4 to 1.4 with an increment of 0.1. The GA-GRNN was compared to a conventional GRNN. The classifier performance was investigated in terms of the classification sensitivity and prediction accuracy. The GA-GRNN significantly improved the total classification sensitivity compared to the conventional GRNN. Also, the GA-GRNN demonstrated an improvement of about 10.1% in the total prediction accuracy. As a result, the proposed GA-GRNN illustrated improved classification sensitivity and prediction accuracy over the conventional GRNN.

  • PDF

Efficiency Optimization Control of IPMSM Drive using HIC (HIC를 이용한 IPMSM 드라이브의 효율 최적화 제어)

  • Baek, Jung-Woo;Ko, Jae-Sub;Choi, Jung-Sik;Kang, Sung-Joon;Jang, Mi-Geum;Chung, Dong-Hwa
    • Proceedings of the KIEE Conference
    • /
    • 2009.07a
    • /
    • pp.780_781
    • /
    • 2009
  • This paper proposes efficiency optimization control of IPMSM drive using hybrid intelligent controller(HIC). The design of the speed controller based on fuzzy-neural network that is implemented using fuzzy control and neural network. The design of the current based on adaptive fuzzy control using model reference and the estimation of the speed based on neural network using ANN controller. In order to maximize the efficiency in such applications, this paper proposes the optimal control method of the armature current. The optimal current can be decided according to the operating speed and the load conditions. This paper proposes speed control of IPMSM using ALM-FNN, current control of model reference adaptive fuzzy control(MTC) and estimation of speed using ANN controller. The proposed control algorithm is applied to IPMSM drive system controlled HIC, the operating characteristics controlled by efficiency optimization control are examined in detail.

  • PDF

Slope stability analysis using black widow optimization hybridized with artificial neural network

  • Hu, Huanlong;Gor, Mesut;Moayedi, Hossein;Osouli, Abdolreza;Foong, Loke Kok
    • Smart Structures and Systems
    • /
    • v.29 no.4
    • /
    • pp.523-533
    • /
    • 2022
  • A novel metaheuristic search method, namely black widow optimization (BWO) is employed to increase the accuracy of slope stability analysis. The BWO is a recently-developed optimizer that supervises the training of an artificial neural network (ANN) for predicting the factor of safety (FOS) of a single-layer cohesive soil slope. The designed slope bears a loaded foundation in different distances from the crest. A sensitivity analysis is conducted based on the number of active individuals in the BWO algorithm, and it was shown that the best performance is acquired for the population size of 40. Evaluation of the results revealed that the capability of the ANN was significantly enhanced by applying the BWO. In this sense, the learning root mean square error fell down by 23.34%. Also, the correlation between the testing data rose from 0.9573 to 0.9737. Therefore, the postposed BWO-ANN can be promisingly used for the early prediction of FOS in real-world projects.

Alternative optimization procedure for parameter design using neural network without SN (파라미터 설계에서 신호대 잡음비 사용 없이 신경망을 이용한 최적화 대체방안)

  • Na, Myung-Whan;Kwon, Yong-Man
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.2
    • /
    • pp.211-218
    • /
    • 2010
  • Taguchi has used the signal-to-noise ratio (SN) to achieve the appropriate set of operating conditions where variability around target is low in the Taguchi parameter design. Many Statisticians criticize the Taguchi techniques of analysis, particularly those based on the SN. Moreover, there are difficulties in practical application, such as complexity and nonlinear relationships among quality characteristics and design (control) factors, and interactions occurred among control factors. Neural networks have a learning capability and model free characteristics. There characteristics support neural networks as a competitive tool in processing multivariable input-output implementation. In this paper we propose a substantially simpler optimization procedure for parameter design using neural network without resorting to SN. An example is illustrated to compare the difference between the Taguchi method and neural network method.

Structural failure classification for reinforced concrete buildings using trained neural network based multi-objective genetic algorithm

  • Chatterjee, Sankhadeep;Sarkar, Sarbartha;Hore, Sirshendu;Dey, Nilanjan;Ashour, Amira S.;Shi, Fuqian;Le, Dac-Nhuong
    • Structural Engineering and Mechanics
    • /
    • v.63 no.4
    • /
    • pp.429-438
    • /
    • 2017
  • Structural design has an imperative role in deciding the failure possibility of a Reinforced Concrete (RC) structure. Recent research works achieved the goal of predicting the structural failure of the RC structure with the assistance of machine learning techniques. Previously, the Artificial Neural Network (ANN) has been trained supported by Particle Swarm Optimization (PSO) to classify RC structures with reasonable accuracy. Though, keeping in mind the sensitivity in predicting the structural failure, more accurate models are still absent in the context of Machine Learning. Since the efficiency of multi-objective optimization over single objective optimization techniques is well established. Thus, the motivation of the current work is to employ a Multi-objective Genetic Algorithm (MOGA) to train the Neural Network (NN) based model. In the present work, the NN has been trained with MOGA to minimize the Root Mean Squared Error (RMSE) and Maximum Error (ME) toward optimizing the weight vector of the NN. The model has been tested by using a dataset consisting of 150 RC structure buildings. The proposed NN-MOGA based model has been compared with Multi-layer perceptron-feed-forward network (MLP-FFN) and NN-PSO based models in terms of several performance metrics. Experimental results suggested that the NN-MOGA has outperformed other existing well known classifiers with a reasonable improvement over them. Meanwhile, the proposed NN-MOGA achieved the superior accuracy of 93.33% and F-measure of 94.44%, which is superior to the other classifiers in the present study.