• Title/Summary/Keyword: network optimization

Search Result 2,239, Processing Time 0.032 seconds

The development of four efficient optimal neural network methods in forecasting shallow foundation's bearing capacity

  • Hossein Moayedi;Binh Nguyen Le
    • Computers and Concrete
    • /
    • v.34 no.2
    • /
    • pp.151-168
    • /
    • 2024
  • This research aimed to appraise the effectiveness of four optimization approaches - cuckoo optimization algorithm (COA), multi-verse optimization (MVO), particle swarm optimization (PSO), and teaching-learning-based optimization (TLBO) - that were enhanced with an artificial neural network (ANN) in predicting the bearing capacity of shallow foundations located on cohesionless soils. The study utilized a database of 97 laboratory experiments, with 68 experiments for training data sets and 29 for testing data sets. The ANN algorithms were optimized by adjusting various variables, such as population size and number of neurons in each hidden layer, through trial-and-error techniques. Input parameters used for analysis included width, depth, geometry, unit weight, and angle of shearing resistance. After performing sensitivity analysis, it was determined that the optimized architecture for the ANN structure was 5×5×1. The study found that all four models demonstrated exceptional prediction performance: COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP. It is worth noting that the MVO-MLP model exhibited superior accuracy in generating network outputs for predicting measured values compared to the other models. The training data sets showed R2 and RMSE values of (0.07184 and 0.9819), (0.04536 and 0.9928), (0.09194 and 0.9702), and (0.04714 and 0.9923) for COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP methods respectively. Similarly, the testing data sets produced R2 and RMSE values of (0.08126 and 0.07218), (0.07218 and 0.9814), (0.10827 and 0.95764), and (0.09886 and 0.96481) for COA-MLP, MVO-MLP, PSO-MLP, and TLBO-MLP methods respectively.

Automated optimization for memory-efficient high-performance deep neural network accelerators

  • Kim, HyunMi;Lyuh, Chun-Gi;Kwon, Youngsu
    • ETRI Journal
    • /
    • v.42 no.4
    • /
    • pp.505-517
    • /
    • 2020
  • The increasing size and complexity of deep neural networks (DNNs) necessitate the development of efficient high-performance accelerators. An efficient memory structure and operating scheme provide an intuitive solution for high-performance accelerators along with dataflow control. Furthermore, the processing of various neural networks (NNs) requires a flexible memory architecture, programmable control scheme, and automated optimizations. We first propose an efficient architecture with flexibility while operating at a high frequency despite the large memory and PE-array sizes. We then improve the efficiency and usability of our architecture by automating the optimization algorithm. The experimental results show that the architecture increases the data reuse; a diagonal write path improves the performance by 1.44× on average across a wide range of NNs. The automated optimizations significantly enhance the performance from 3.8× to 14.79× and further provide usability. Therefore, automating the optimization as well as designing an efficient architecture is critical to realizing high-performance DNN accelerators.

The optimization of fuzzy neural network using genetic algorithms and its application to the prediction of the chaotic time series data (유전 알고리듬을 이용한 퍼지 신경망의 최적화 및 혼돈 시계열 데이터 예측에의 응용)

  • Jang, Wook;Kwon, Oh-Gook;Joo, Young-Hoon;Yoon, Tae-Sung;Park, Jin-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.708-711
    • /
    • 1997
  • This paper proposes the hybrid algorithm for the optimization of the structure and parameters of the fuzzy neural networks by genetic algorithms (GA) to improve the behaviour and the design of fuzzy neural networks. Fuzzy neural networks have a distinguishing feature in that they can possess the advantage of both neural networks and fuzzy systems. In this way, we can bring the low-level learning and computational power of neural networks into fuzzy systems and also high-level, human like IF-THEN rule thinking and reasoning of fuzzy systems into neural networks. As a result, there are many research works concerning the optimization of the structure and parameters of fuzzy neural networks. In this paper, we propose the hybrid algorithm that can optimize both the structure and parameters of fuzzy neural networks. Numerical example is provided to show the advantages of the proposed method.

  • PDF

Buckling optimization of laminated composite plate with elliptical cutout using ANN and GA

  • Nicholas, P. Emmanuel;Padmanaban, K.P.;Vasudevan, D.
    • Structural Engineering and Mechanics
    • /
    • v.52 no.4
    • /
    • pp.815-827
    • /
    • 2014
  • Buckling optimization of laminated composite plates is significant as they fail because of buckling under in-plane compressive loading. The plate is usually modeled without cutout so that the buckling strength is found analytically using classical laminate plate theory (CLPT). However in real world applications, the composite plates are modeled with cutouts for getting them assembled and to offer the provisions like windows, doors and control system. Finite element analysis (FEA) is used to analyze the buckling strength of the plate with cutouts and it leads to high computational cost when the plate is optimized. In this article, a genetic algorithm based optimization technique is used to optimize the composite plate with cutout. The computational time is highly reduced by replacing FEA with artificial neural network (ANN). The effectiveness of the proposed method is explored with two numerical examples.

Survey on IEEE 802.11 DCF Game Theoretic Approaches (IEEE 802.11 DCF에서의 게임 이론적 접근방법 소개)

  • Choi, Byeong-Cheol;Kim, Jung-Nyeo;Ryu, Jae-Cheol
    • Proceedings of the KIEE Conference
    • /
    • 2007.04a
    • /
    • pp.240-242
    • /
    • 2007
  • The game theoretic analysis in wireless networks can be classified into the jamming game of the physical layer, the multiple access game of the medium access layer, the forwarder's dilemma and joint packet forwarding game of the network layer, and etc. In this paper, the game theoretic analysis about the multiple access game that selfish nodes exist in the IEEE 802.11 DCF(Distributed Coordination Function) wireless networks is addressed. In this' wireless networks, the modeling of the CSMA/CA protocol based DCF, the utility or payoff function calculation of the game, the system optimization (using optimization theory or convex optimization), and selection of Pareto-optimality and Nash Equilibrium in game strategies are the important elements for analyzing how nodes are operated in the steady state of system. Finally, the main issues about the game theory in the wireless network are introduced.

  • PDF

Role of Artificial Neural Networks in Multidisciplinary Optimization and Axiomatic Design

  • Lee, Jong-Soo
    • Proceedings of the KSME Conference
    • /
    • 2008.11a
    • /
    • pp.695-700
    • /
    • 2008
  • Artificial neural network (ANN) has been extensively used in areas of nonlinear system modeling, analysis and design applications. Basically, ANN has its distinct capabilities of implementing system identification and/or function approximation using a number of input/output patterns that can be obtained via numerical and/or experimental manners. The paper describes a role of ANN, especially a back-propagation neural network (BPN) in the context of engineering analysis, design and optimization. Fundamental mechanism of BPN is briefly summarized in terms of training procedure and function approximation. The BPN based causality analysis (CA) is further discussed to realize the problem decomposition in the context of multidisciplinary design optimization. Such CA is also applied to quantitatively evaluate the uncoupled or decoupled design matrix in the context of axiomatic design with the independence axiom.

  • PDF

High-Efficiency Design of Axial Flow Fan through Shape Optimization of Airfoil (익형의 형상최적화를 통한 고효율 축류송풍기 설계)

  • Lee, Ki-Sang;Kim, Kwang-Yong;Choi, Jae-Ho
    • The KSFM Journal of Fluid Machinery
    • /
    • v.11 no.2
    • /
    • pp.46-54
    • /
    • 2008
  • This study presents a numerical optimization to optimize an axial flow fan blade to increase the efficiency. The radial basis neural network is used as an optimization method with the numerical analysis by Reynolds-averaged Navier-Stokes equations using SST model as turbulence closure. Four design variables related to airfoil maximum camber, maximum camber location, leading edge radius and trailing edge radius, respectively, are selected, and efficiency is considered as objective function which is to be maximized. Thirty designs are evaluated to get the objective function values of each design used to train the neural network. Optimum shape shows the efficiency increased by 1.0%.

Analysis of Evolutionary Optimization Methods for CNN Structures (CNN 구조의 진화 최적화 방식 분석)

  • Seo, Kisung
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.6
    • /
    • pp.767-772
    • /
    • 2018
  • Recently, some meta-heuristic algorithms, such as GA(Genetic Algorithm) and GP(Genetic Programming), have been used to optimize CNN(Convolutional Neural Network). The CNN, which is one of the deep learning models, has seen much success in a variety of computer vision tasks. However, designing CNN architectures still requires expert knowledge and a lot of trial and error. In this paper, the recent attempts to automatically construct CNN architectures are investigated and analyzed. First, two GA based methods are summarized. One is the optimization of CNN structures with the number and size of filters, connection between consecutive layers, and activation functions of each layer. The other is an new encoding method to represent complex convolutional layers in a fixed-length binary string, Second, CGP(Cartesian Genetic Programming) based method is surveyed for CNN structure optimization with highly functional modules, such as convolutional blocks and tensor concatenation, as the node functions in CGP. The comparison for three approaches is analysed and the outlook for the potential next steps is suggested.

Application of Multivariate Adaptive Regression Spline-Assisted Objective Function on Optimization of Heat Transfer Rate Around a Cylinder

  • Dey, Prasenjit;Das, Ajoy K.
    • Nuclear Engineering and Technology
    • /
    • v.48 no.6
    • /
    • pp.1315-1320
    • /
    • 2016
  • The present study aims to predict the heat transfer characteristics around a square cylinder with different corner radii using multivariate adaptive regression splines (MARS). Further, the MARS-generated objective function is optimized by particle swarm optimization. The data for the prediction are taken from the recently published article by the present authors [P. Dey, A. Sarkar, A.K. Das, Development of GEP and ANN model to predict the unsteady forced convection over a cylinder, Neural Comput. Appl. (2015) 1-13]. Further, the MARS model is compared with artificial neural network and gene expression programming. It has been found that the MARS model is very efficient in predicting the heat transfer characteristics. It has also been found that MARS is more efficient than artificial neural network and gene expression programming in predicting the forced convection data, and also particle swarm optimization can efficiently optimize the heat transfer rate.

SEQUENTIAL MINIMAL OPTIMIZATION WITH RANDOM FOREST ALGORITHM (SMORF) USING TWITTER CLASSIFICATION TECHNIQUES

  • J.Uma;K.Prabha
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.4
    • /
    • pp.116-122
    • /
    • 2023
  • Sentiment categorization technique be commonly isolated interested in threes significant classifications name Machine Learning Procedure (ML), Lexicon Based Method (LB) also finally, the Hybrid Method. In Machine Learning Methods (ML) utilizes phonetic highlights with apply notable ML algorithm. In this paper, in classification and identification be complete base under in optimizations technique called sequential minimal optimization with Random Forest algorithm (SMORF) for expanding the exhibition and proficiency of sentiment classification framework. The three existing classification algorithms are compared with proposed SMORF algorithm. Imitation result within experiential structure is Precisions (P), recalls (R), F-measures (F) and accuracy metric. The proposed sequential minimal optimization with Random Forest (SMORF) provides the great accuracy.