• Title/Summary/Keyword: Multi-layer neural network

Search Result 514, Processing Time 0.025 seconds

A multi-crack effects analysis and crack identification in functionally graded beams using particle swarm optimization algorithm and artificial neural network

  • Abolbashari, Mohammad Hossein;Nazari, Foad;Rad, Javad Soltani
    • Structural Engineering and Mechanics
    • /
    • v.51 no.2
    • /
    • pp.299-313
    • /
    • 2014
  • In the first part of this paper, the influences of some of crack parameters on natural frequencies of a cracked cantilever Functionally Graded Beam (FGB) are studied. A cantilever beam is modeled using Finite Element Method (FEM) and its natural frequencies are obtained for different conditions of cracks. Then effect of variation of depth and location of cracks on natural frequencies of FGB with single and multiple cracks are investigated. In the second part, two Multi-Layer Feed Forward (MLFF) Artificial Neural Networks (ANNs) are designed for prediction of FGB's Cracks' location and depth. Particle Swarm Optimization (PSO) and Back-Error Propagation (BEP) algorithms are applied for training ANNs. The accuracy of two training methods' results are investigated.

GA-based Feed-forward Self-organizing Neural Network Architecture and Its Applications for Multi-variable Nonlinear Process Systems

  • Oh, Sung-Kwun;Park, Ho-Sung;Jeong, Chang-Won;Joo, Su-Chong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.3 no.3
    • /
    • pp.309-330
    • /
    • 2009
  • In this paper, we introduce the architecture of Genetic Algorithm(GA) based Feed-forward Polynomial Neural Networks(PNNs) and discuss a comprehensive design methodology. A conventional PNN consists of Polynomial Neurons, or nodes, located in several layers through a network growth process. In order to generate structurally optimized PNNs, a GA-based design procedure for each layer of the PNN leads to the selection of preferred nodes(PNs) with optimal parameters available within the PNN. To evaluate the performance of the GA-based PNN, experiments are done on a model by applying Medical Imaging System(MIS) data to a multi-variable software process. A comparative analysis shows that the proposed GA-based PNN is modeled with higher accuracy and more superb predictive capability than previously presented intelligent models.

A Study on Development of Embedded System for Speech Recognition using Multi-layer Recurrent Neural Prediction Models & HMM (다층회귀신경예측 모델 및 HMM 를 이용한 임베디드 음성인식 시스템 개발에 관한 연구)

  • Kim, Jung hoon;Jang, Won il;Kim, Young tak;Lee, Sang bae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.3
    • /
    • pp.273-278
    • /
    • 2004
  • In this paper, the recurrent neural networks (RNN) is applied to compensate for HMM recognition algorithm, which is commonly used as main recognizer. Among these recurrent neural networks, the multi-layer recurrent neural prediction model (MRNPM), which allows operating in real-time, is used to implement learning and recognition, and HMM and MRNPM are used to design a hybrid-type main recognizer. After testing the designed speech recognition algorithm with Korean number pronunciations (13 words), which are hardly distinct, for its speech-independent recognition ratio, about 5% improvement was obtained comparing with existing HMM recognizers. Based on this result, only optimal (recognition) codes were extracted in the actual DSP (TMS320C6711) environment, and the embedded speech recognition system was implemented. Similarly, the implementation result of the embedded system showed more improved recognition system implementation than existing solid HMM recognition systems.

Computation of Noncentral F Probabilities using multilayer neural network (다층 신경 망을 이용한 비중심F분포 확률계산)

  • Gu, Sun-Hee
    • The KIPS Transactions:PartB
    • /
    • v.9B no.3
    • /
    • pp.271-276
    • /
    • 2002
  • The test statistic in ANOVA tests has a single or doubly noncentral F distribution and the noncentral F distribution is applied to the calculation of the power functions of tests of general linear hypotheses. Although various approximations of noncentral F distribution are suggested, they are troublesome to compute. In this paper, the calculation of noncentral F distribution is applied to the neural network theory, to solve the computation problem. The neural network consists of the multi-layer perceptron structure and learning process has the algorithm of the backpropagation. Using fables and figs, comparisons are made between the results obtained by neural network theory and the Patnaik's values. Regarding of accuracy and calculation, the results by neural network are efficient than the Patnaik's values.

Voiced-Unvoiced-Silence Detection Algorithm using Perceptron Neural Network (퍼셉트론 신경회로망을 사용한 유성음, 무성음, 묵음 구간의 검출 알고리즘)

  • Choi, Jae-Seung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.6 no.2
    • /
    • pp.237-242
    • /
    • 2011
  • This paper proposes a detection algorithm for each section which detects the voiced section, unvoiced section, and the silence section at each frame using a multi-layer perceptron neural network. First, a power spectrum and FFT (fast Fourier transform) coefficients obtained by FFT are used as the input to the neural network for each frame, then the neural network is trained using these power spectrum and FFT coefficients. In this experiment, the performance of the proposed algorithm for detection of the voiced section, unvoiced section, and silence section was evaluated based on the detection rates using various speeches, which are degraded by white noise and used as the input data of the neural network. In this experiment, the detection rates were 92% or more for such speech and white noise when training data and evaluation data were the different.

Improved Estimation Method for the Capacitor Voltage in Modular Multilevel Converters Using Distributed Neural Network Observer

  • Mehdi Syed Musadiq;Dong-Myung Lee
    • Journal of IKEEE
    • /
    • v.27 no.4
    • /
    • pp.430-438
    • /
    • 2023
  • The Modular Multilevel Converter (MMC) has emerged as a key component in HVDC systems due to its ability to efficiently transmit large amounts of power over long distances. In such systems, accurate estimation of the MMC capacitor voltage is of utmost importance for ensuring optimal system performance, stability, and reliability. Traditional methods for voltage estimation may face limitations in accuracy and robustness, prompting the need for innovative approaches. In this paper, we propose a novel distributed neural network observer specifically designed for MMC capacitor voltage estimation. Our observer harnesses the power of a multi-layer neural network architecture, which enables the observer to learn and adapt to the complex dynamics of the MMC system. By utilizing a distributed approach, we deploy multiple observers, each with its own set of neural network layers, to collectively estimate the capacitor voltage. This distributed configuration enhances the accuracy and robustness of the voltage estimation process. A crucial aspect of our observer's performance lies in the meticulous initialization of random weights within the neural network. This initialization process ensures that the observer starts with a solid foundation for efficient learning and accurate voltage estimation. The observer iteratively updates its weights based on the observed voltage and current values, continuously improving its estimation accuracy over time. The validity of proposed algorithm is verified by the result of estimated voltage at each observer in capacitor of MMC.

A reconfigurable modular approach for digital neural network (디지털 신경회로망의 하드웨어 구현을 위한 재구성형 모듈러 디자인의 적용)

  • Yun, Seok-Bae;Kim, Young-Joo;Dong, Sung-Soo;Lee, Chong-Ho
    • Proceedings of the KIEE Conference
    • /
    • 2002.07d
    • /
    • pp.2755-2757
    • /
    • 2002
  • In this paper, we propose a now architecture for hardware implementation of digital neural network. By adopting flexible ladder-style bus and internal connection network into traditional SIMD-type digital neural network architecture, the proposed architecture enables fast processing that is based on parallelism, while does not abandon the flexibility and extensibility of the traditional approach. In the proposed architecture, users can change the network topology by setting configuration registers. Such reconfigurability on hardware allows enough usability like software simulation. We implement the proposed design on real FPGA, and configure the chip to multi-layer perceptron with back propagation for alphabet recognition problem. Performance comparison with its software counterpart shows its value in the aspect of performance and flexibility.

  • PDF

A Study on the Syllable Recognition Using Neural Network Predictive HMM

  • Kim, Soo-Hoon;Kim, Sang-Berm;Koh, Si-Young;Hur, Kang-In
    • The Journal of the Acoustical Society of Korea
    • /
    • v.17 no.2E
    • /
    • pp.26-30
    • /
    • 1998
  • In this paper, we compose neural network predictive HMM(NNPHMM) to provide the dynamic feature of the speech pattern for the HMM. The NNPHMM is the hybrid network of neura network and the HMM. The NNPHMM trained to predict the future vector, varies each time. It is used instead of the mean vector in the HMM. In the experiment, we compared the recognition abilities of the one hundred Korean syllables according to the variation of hidden layer, state number and prediction orders of the NNPHMM. The hidden layer of NNPHMM increased from 10 dimensions to 30 dimensions, the state number increased from 4 to 6 and the prediction orders increased from 10 dimensions to 30 dimension, the state number increased from 4 to 6 and the prediction orders increased from the second oder to the fourth order. The NNPHMM in the experiment is composed of multi-layer perceptron with one hidden layer and CMHMM. As a result of the experiment, the case of prediction order is the second, the average recognition rate increased 3.5% when the state number is changed from 4 to 5. The case of prediction order is the third, the recognition rate increased 4.0%, and the case of prediction order is fourth, the recognition rate increased 3.2%. But the recognition rate decreased when the state number is changed from 5 to 6.

  • PDF

Structural failure classification for reinforced concrete buildings using trained neural network based multi-objective genetic algorithm

  • Chatterjee, Sankhadeep;Sarkar, Sarbartha;Hore, Sirshendu;Dey, Nilanjan;Ashour, Amira S.;Shi, Fuqian;Le, Dac-Nhuong
    • Structural Engineering and Mechanics
    • /
    • v.63 no.4
    • /
    • pp.429-438
    • /
    • 2017
  • Structural design has an imperative role in deciding the failure possibility of a Reinforced Concrete (RC) structure. Recent research works achieved the goal of predicting the structural failure of the RC structure with the assistance of machine learning techniques. Previously, the Artificial Neural Network (ANN) has been trained supported by Particle Swarm Optimization (PSO) to classify RC structures with reasonable accuracy. Though, keeping in mind the sensitivity in predicting the structural failure, more accurate models are still absent in the context of Machine Learning. Since the efficiency of multi-objective optimization over single objective optimization techniques is well established. Thus, the motivation of the current work is to employ a Multi-objective Genetic Algorithm (MOGA) to train the Neural Network (NN) based model. In the present work, the NN has been trained with MOGA to minimize the Root Mean Squared Error (RMSE) and Maximum Error (ME) toward optimizing the weight vector of the NN. The model has been tested by using a dataset consisting of 150 RC structure buildings. The proposed NN-MOGA based model has been compared with Multi-layer perceptron-feed-forward network (MLP-FFN) and NN-PSO based models in terms of several performance metrics. Experimental results suggested that the NN-MOGA has outperformed other existing well known classifiers with a reasonable improvement over them. Meanwhile, the proposed NN-MOGA achieved the superior accuracy of 93.33% and F-measure of 94.44%, which is superior to the other classifiers in the present study.

Skin Region Extraction Using Multi-Layer Neural Network and Skin-Color Model (다층 신경망과 피부색 모델을 이용한 피부 영역 검출)

  • Park, Sung-Wook;Park, Jong-Wook
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.16 no.2
    • /
    • pp.31-38
    • /
    • 2011
  • Skin color is a very important information for an automatic face recognition. In this paper, we proposed a skin region extraction method using the MLP(Multi-Layer Perceptron) and skin color model. We use the adaptive lighting compensation technique for improved performance of skin region extraction. Also, using an preprocessing filter, normally large areas of easily distinct non-skin pixels, are eliminated from further processing. Experimental results show that the proposed method has better performance than the conventional methods, and reduces processing time by 31~49% on average.