• Title/Summary/Keyword: multi-level neural networks

Search Result 44, Processing Time 0.027 seconds

Multi-Level Neural Networks for Progressive Structural Design (점진적 구조설계를 위한 다단계 인공신경망)

  • 김남희;장승필;이승철
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2001.04a
    • /
    • pp.233-240
    • /
    • 2001
  • Artificial neural networks(ANN) have been exploited where the relationship among information is very complicated and nonlinear. It is appropriate to computerize the information and knowledge used in the preliminary design stage where it lacks of formality of representation of designers' experience and intuition. However, most designers start the preliminary design stage with very little information. Therefore, the ANN model for this stage must be designed to have input much less than output. This case usually causes big troubles such as in learning time, convergence and reliability of solutions. To address this problem, this paper proposes multi-level neural networks for progressive structural design considering that all the design information can not be obtained at a time but are growing gradually. The use of multi-level networks developed in this paper has been proved its validity by applying it to the preliminary design of cable-stayed bridges.

  • PDF

A hardware implementation of neural network with modified HANNIBAL architecture (수정된 하니발 구조를 이용한 신경회로망의 하드웨어 구현)

  • 이범엽;정덕진
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.45 no.3
    • /
    • pp.444-450
    • /
    • 1996
  • A digital hardware architecture for artificial neural network with learning capability is described in this paper. It is a modified hardware architecture known as HANNIBAL(Hardware Architecture for Neural Networks Implementing Back propagation Algorithm Learning). For implementing an efficient neural network hardware, we analyzed various type of multiplier which is major function block of neuro-processor cell. With this result, we design a efficient digital neural network hardware using serial/parallel multiplier, and test the operation. We also analyze the hardware efficiency with logic level simulation. (author). refs., figs., tabs.

  • PDF

Convolutional Neural Network Based Multi-feature Fusion for Non-rigid 3D Model Retrieval

  • Zeng, Hui;Liu, Yanrong;Li, Siqi;Che, JianYong;Wang, Xiuqing
    • Journal of Information Processing Systems
    • /
    • v.14 no.1
    • /
    • pp.176-190
    • /
    • 2018
  • This paper presents a novel convolutional neural network based multi-feature fusion learning method for non-rigid 3D model retrieval, which can investigate the useful discriminative information of the heat kernel signature (HKS) descriptor and the wave kernel signature (WKS) descriptor. At first, we compute the 2D shape distributions of the two kinds of descriptors to represent the 3D model and use them as the input to the networks. Then we construct two convolutional neural networks for the HKS distribution and the WKS distribution separately, and use the multi-feature fusion layer to connect them. The fusion layer not only can exploit more discriminative characteristics of the two descriptors, but also can complement the correlated information between the two kinds of descriptors. Furthermore, to further improve the performance of the description ability, the cross-connected layer is built to combine the low-level features with high-level features. Extensive experiments have validated the effectiveness of the designed multi-feature fusion learning method.

System for Preliminary Structural Design using Multi-Level Neural Networks (다단계 신경망을 이용한 초기 구조설계 시스템 개발)

  • 김남희;장승필;이승철
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.15 no.2
    • /
    • pp.261-270
    • /
    • 2002
  • The use of ANN is appropriate to computerize the information and knowledge used in the preliminary design stage where it lacks of formality of representation of designers' experience and intuition. Considering that there exists very little design information in preliminary design stage to start with, the ANN model for this stage must be designed to have input much less than output. However, this situation usually causes various problems such as in teaming time, convergence and reliability of solutions. To address this problem, this paper proposes multi-level neural networks lot progressive structural design considering that all the design information can not be obtained at a time but we growing gradually. The use of multi-level networks developed in this paper has been proved its validity by applying it to the preliminary design of cable-stayed bridges.

Genetically Optimized Fuzzy Polynomial Neural Network and Its Application to Multi-variable Software Process

  • Lee In-Tae;Oh Sung-Kwun;Kim Hyun-Ki;Pedrycz Witold
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.6 no.1
    • /
    • pp.33-38
    • /
    • 2006
  • In this paper, we propose a new architecture of Fuzzy Polynomial Neural Networks(FPNN) by means of genetically optimized Fuzzy Polynomial Neuron(FPN) and discuss its comprehensive design methodology involving mechanisms of genetic optimization, especially Genetic Algorithms(GAs). The conventional FPNN developed so far are based on mechanisms of self-organization and evolutionary optimization. The design of the network exploits the extended Group Method of Data Handling(GMDH) with some essential parameters of the network being provided by the designer and kept fixed throughout the overall development process. This restriction may hamper a possibility of producing an optimal architecture of the model. The proposed FPNN gives rise to a structurally optimized network and comes with a substantial level of flexibility in comparison to the one we encounter in conventional FPNNs. It is shown that the proposed advanced genetic algorithms based Fuzzy Polynomial Neural Networks is more useful and effective than the existing models for nonlinear process. We experimented with Medical Imaging System(MIS) dataset to evaluate the performance of the proposed model.

Genetically Optimized Hybrid Fuzzy Set-based Polynomial Neural Networks with Polynomial and Fuzzy Polynomial Neurons

  • Oh Sung-Kwun;Roh Seok-Beom;Park Keon-Jun
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.5 no.4
    • /
    • pp.327-332
    • /
    • 2005
  • We investigatea new fuzzy-neural networks-Hybrid Fuzzy set based polynomial Neural Networks (HFSPNN). These networks consist of genetically optimized multi-layer with two kinds of heterogeneous neurons thatare fuzzy set based polynomial neurons (FSPNs) and polynomial neurons (PNs). We have developed a comprehensive design methodology to determine the optimal structure of networks dynamically. The augmented genetically optimized HFSPNN (namely gHFSPNN) results in a structurally optimized structure and comes with a higher level of flexibility in comparison to the one we encounter in the conventional HFPNN. The GA-based design procedure being applied at each layer of gHFSPNN leads to the selection leads to the selection of preferred nodes (FSPNs or PNs) available within the HFSPNN. In the sequel, the structural optimization is realized via GAs, whereas the ensuing detailed parametric optimization is carried out in the setting of a standard least square method-based learning. The performance of the gHFSPNN is quantified through experimentation where we use a number of modeling benchmarks synthetic and experimental data already experimented with in fuzzy or neurofuzzy modeling.

Robot PTP Trajectory Planning Using a Hierarchical Neural Network Structure (계층 구조의 신경회로망에 의한 로보트 PTP 궤적 계획)

  • 경계현;고명삼;이범희
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.39 no.10
    • /
    • pp.1121-1232
    • /
    • 1990
  • A hierarchical neural network structure is described for robot PTP trajectory planning. In the first level, the multi-layered Perceptron neural network is used for the inverse kinematics with the back-propagation learning procedure. In the second level, a saccade generation model based joint trajectory planning model in proposed and analyzed with several features. Various simulations are performed to investigate the characteristics of the proposed neural networks.

  • PDF

Hybrid Multi-layer Perceptron with Fuzzy Set-based PNs with the Aid of Symbolic Coding Genetic Algorithms

  • Roh, Seok-Beom;Oh, Sung-Kwun;Ahn, Tae-Chon
    • Proceedings of the KIEE Conference
    • /
    • 2005.10b
    • /
    • pp.155-157
    • /
    • 2005
  • We propose a new category of hybrid multi-layer neural networks with hetero nodes such as Fuzzy Set based Polynomial Neurons (FSPNs) and Polynomial Neurons (PNs). These networks are based on a genetically optimized multi-layer perceptron. We develop a comprehensive design methodology involving mechanisms of genetic optimization and genetic algorithms, in particular. The augmented genetically optimized HFPNN (namely gHFPNN) results in a structurally optimized structure and comes with a higher level of flexibility in comparison to the one we encounter in the conventional HFPNN. The GA-based design procedure being applied at each layer of HFPNN leads to the selection of preferred nodes (FPNs or PNs) available within the HFPNN. In the sequel, two general optimization mechanisms are explored. First, the structural optimization is realized via GAs whereas the ensuing detailed parametric optimization is carried out in the setting of a standard least square method-based learning. The performance of the gHFPNNs quantified through experimentation where we use a number of modeling benchmarks-synthetic and experimental data already experimented with in fuzzy or neurofuzzy modeling.

  • PDF

Neural Network Training Using a GMDH Type Algorithm

  • Pandya, Abhijit S.;Gilbar, Thomas;Kim, Kwang-Baek
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.5 no.1
    • /
    • pp.52-58
    • /
    • 2005
  • We have developed a Group Method of Data Handling (GMDH) type algorithm for designing multi-layered neural networks. The algorithm is general enough that it will accept any number of inputs and any sized training set. Each neuron of the resulting network is a function of two of the inputs to the layer. The equation for each of the neurons is a quadratic polynomial. Several forms of the equation are tested for each neuron to make sure that only the best equation of two inputs is kept. All possible combinations of two inputs to each layer are also tested. By carefully testing each resulting neuron, we have developed an algorithm to keep only the best neurons at each level. The algorithm's goal is to create as accurate a network as possible while minimizing the size of the network. Software was developed to train and simulate networks using our algorithm. Several applications were modeled using our software, and the result was that our algorithm succeeded in developing small, accurate, multi-layer networks.

Using neural networks to model and predict amplitude dependent damping in buildings

  • Li, Q.S.;Liu, D.K.;Fang, J.Q.;Jeary, A.P.;Wong, C.K.
    • Wind and Structures
    • /
    • v.2 no.1
    • /
    • pp.25-40
    • /
    • 1999
  • In this paper, artificial neural networks, a new kind of intelligent method, are employed to model and predict amplitude dependent damping in buildings based on our full-scale measurements of buildings. The modelling method and procedure using neural networks to model the damping are studied. Comparative analysis of different neural network models of damping, which includes multi-layer perception network (MLP), recurrent neural network, and general regression neural network (GRNN), is performed and discussed in detail. The performances of the models are evaluated and discussed by tests and predictions including self-test, "one-lag" prediction and "multi-lag" prediction of the damping values at high amplitude levels. The established models of damping are used to predict the damping in the following three ways : (1) the model is established by part of the data measured from one building and is used to predict the another part of damping values which are always difficult to obtain from field measurements : the values at the high amplitude level. (2) The model is established by the damping data measured from one building and is used to predict the variation curve of damping for another building. And (3) the model is established by the data measured from more than one buildings and is used to predict the variation curve of damping for another building. The prediction results are discussed.