• Title/Summary/Keyword: neural network.

Search Result 11,759, Processing Time 0.043 seconds

Recurrent Neural Network with Backpropagation Through Time Learning Algorithm for Arabic Phoneme Recognition

  • Ismail, Saliza;Ahmad, Abdul Manan
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.1033-1036
    • /
    • 2004
  • The study on speech recognition and understanding has been done for many years. In this paper, we propose a new type of recurrent neural network architecture for speech recognition, in which each output unit is connected to itself and is also fully connected to other output units and all hidden units [1]. Besides that, we also proposed the new architecture and the learning algorithm of recurrent neural network such as Backpropagation Through Time (BPTT, which well-suited. The aim of the study was to observe the difference of Arabic's alphabet like "alif" until "ya". The purpose of this research is to upgrade the people's knowledge and understanding on Arabic's alphabet or word by using Recurrent Neural Network (RNN) and Backpropagation Through Time (BPTT) learning algorithm. 4 speakers (a mixture of male and female) are trained in quiet environment. Neural network is well-known as a technique that has the ability to classified nonlinear problem. Today, lots of researches have been done in applying Neural Network towards the solution of speech recognition [2] such as Arabic. The Arabic language offers a number of challenges for speech recognition [3]. Even through positive results have been obtained from the continuous study, research on minimizing the error rate is still gaining lots attention. This research utilizes Recurrent Neural Network, one of Neural Network technique to observe the difference of alphabet "alif" until "ya".

  • PDF

Speaker Identification Based on Incremental Learning Neural Network

  • Heo, Kwang-Seung;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.5 no.1
    • /
    • pp.76-82
    • /
    • 2005
  • Speech signal has various features of speakers. This feature is extracted from speech signal processing. The speaker is identified by the speaker identification system. In this paper, we propose the speaker identification system that uses the incremental learning based on neural network. Recorded speech signal through the microphone is blocked to the frame of 1024 speech samples. Energy is divided speech signal to voiced signal and unvoiced signal. The extracted 12 orders LPC cpestrum coefficients are used with input data for neural network. The speakers are identified with the speaker identification system using the neural network. The neural network has the structure of MLP which consists of 12 input nodes, 8 hidden nodes, and 4 output nodes. The number of output node means the identified speakers. The first output node is excited to the first speaker. Incremental learning begins when the new speaker is identified. Incremental learning is the learning algorithm that already learned weights are remembered and only the new weights that are created as adding new speaker are trained. It is learning algorithm that overcomes the fault of neural network. The neural network repeats the learning when the new speaker is entered to it. The architecture of neural network is extended with the number of speakers. Therefore, this system can learn without the restricted number of speakers.

Fuzzy Neural Network Using a Learning Rule utilizing Selective Learning Rate (선택적 학습률을 활용한 학습법칙을 사용한 신경회로망)

  • Baek, Young-Sun;Kim, Yong-Soo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.20 no.5
    • /
    • pp.672-676
    • /
    • 2010
  • This paper presents a learning rule that weights more on data near decision boundary. This learning rule generates better decision boundary by reducing the effect of outliers on the decision boundary. The proposed learning rule is integrated into IAFC neural network. IAFC neural network is stable to maintain previous learning results and is plastic to learn new data. The performance of the proposed fuzzy neural network is compared with performances of LVQ neural network and backpropagation neural network. The results show that the performance of the proposed fuzzy neural network is better than those of LVQ neural network and backpropagation neural network.

Prediction of strength development of fly ash and silica fume ternary composite concrete using artificial neural network (인공신경망을 이용한 플라이애시 및 실리카 흄 복합 콘크리트의 압축강도 예측)

  • Fan, Wei-Jie;Choi, Young-Ji;Wang, Xiao-Yong
    • Journal of Industrial Technology
    • /
    • v.41 no.1
    • /
    • pp.1-6
    • /
    • 2021
  • Fly ash and silica fume belong to industry by-products that can be used to produce concrete. This study shows the model of a neural network to evaluate the strength development of blended concrete containing fly ash and silica fume. The neural network model has four input parameters, such as fly ash replacement content, silica fume replacement content, water/binder ratio, and ages. Strength is the output variable of neural network. Based on the backpropagation algorithm, the values of elements in the hidden layer of neural network are determined. The number of neurons in the hidden layer is confirmed based on trial calculations. We find (1) neural network can give a reasonable evaluation of the strength development of composite concrete. Neural network can reflect the improvement of strength due to silica fume additions and can consider the reductions of strength as water/binder increases. (2) When the number of neurons in the hidden layer is five, the prediction results show more accuracy than four neurons in the hidden layer. Moreover, five neurons in the hidden layer can reproduce the strength crossover between fly ash concrete and plain concrete. Summarily, the neural network-based model is valuable for design sustainable composite concrete containing silica fume and fly ash.

A Water-saving Irrigation Decision-making Model for Greenhouse Tomatoes based on Genetic Optimization T-S Fuzzy Neural Network

  • Chen, Zhili;Zhao, Chunjiang;Wu, Huarui;Miao, Yisheng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.6
    • /
    • pp.2925-2948
    • /
    • 2019
  • In order to improve the utilization of irrigation water resources of greenhouse tomatoes, a water-saving irrigation decision-making model based on genetic optimization T-S fuzzy neural network is proposed in this paper. The main work are as follows: Firstly, the traditional genetic algorithm is optimized by introducing the constraint operator and update operator of the Krill herd (KH) algorithm. Secondly, the weights and thresholds of T-S fuzzy neural network are optimized by using the improved genetic algorithm. Finally, on the basis of the real data set, the genetic optimization T-S fuzzy neural network is used to simulate and predict the irrigation volume for greenhouse tomatoes. The performance of the genetic algorithm improved T-S fuzzy neural network (GA-TSFNN), the traditional T-S fuzzy neural network algorithm (TSFNN), BP neural network algorithm(BPNN) and the genetic algorithm improved BP neural network algorithm (GA-BPNN) is compared by simulation. The simulation experiment results show that compared with the TSFNN, BPNN and the GA-BPNN, the error of the GA-TSFNN between the predicted value and the actual value of the irrigation volume is smaller, and the proposed method has a better prediction effect. This paper provides new ideas for the water-saving irrigation decision in greenhouse tomatoes.

A Construction of Fuzzy Inference Network based on Neural Logic Network and its Search Strategy

  • Lee, Mal-rey
    • Proceedings of the Korea Society for Industrial Systems Conference
    • /
    • 2000.11a
    • /
    • pp.375-389
    • /
    • 2000
  • Fuzzy logic ignores some information in the reasoning process. Neural networks are powerful tools for the pattern processing, but, not appropriate for the logical reasoning. To model human knowledge, besides pattern processing capability, the logical reasoning capability is equally important. Another new neural network called neural logic network is able to do the logical reasoning. Because the fuzzy inference is a fuzzy logical reasoning, we construct fuzzy inference network based on the neural logic network, extending the existing rule- inference. network. And the traditional propagation rule is modified. For the search strategies to find out the belief value of a conclusion in the fuzzy inference network, we conduct a simulation to evaluate the search costs for searching sequentially and searching by means of search priorities.

  • PDF

Prediction of contact lengths between an elastic layer and two elastic circular punches with neural networks

  • Ozsahin, Talat Sukru;Birinci, Ahmet;Cakiroglu, A. Osman
    • Structural Engineering and Mechanics
    • /
    • v.18 no.4
    • /
    • pp.441-459
    • /
    • 2004
  • This paper explores the potential use of neural networks (NNs) in the field of contact mechanics. A neural network model is developed for predicting, with sufficient approximation, the contact lengths between the elastic layer and two elastic circular punches. A backpropagation neural network of three layers is employed. First contact problem is solved according to the theory of elasticity with integral transformation technique, and then the results are used to train the neural network. The effectiveness of different neural network configurations is investigated. Effect of parameters such as load factor, elastic punch radii and flexibilities that influence the contact lengths is also explored. The results of the theoretical solution and the outputs generated from the neural network are compared. Results indicate that NN predicted the contact length with high accuracy. It is also demonstrated that NN is an excellent method that can reduce time consumed.

Classification of Surface Defects on Cold Rolled Strip by Tree-Structured Neural Networks (트리구조 신경망을 이용한 냉연 강판 표면 결함의 분류)

  • Moon, Chang-In;Choi, Se-Ho;Kim, Gi-Bum;Joo, Won-Jong
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.31 no.6 s.261
    • /
    • pp.651-658
    • /
    • 2007
  • A new tree-structured neural network classifier is proposed for the automatic real-time inspection of cold-rolled steel strip surface defects. The defects are classified into 3 groups such as area type, disk type, area & line type in the first stage of the tree-structured neural network. The defects are classified in more detail into 11 major defect types which are considered as serious defects in the second stage of neural network. The tree-structured neural network classifier consists of 4 different neural networks and optimum features are selected for each neural network classifier by using SFFS algorithm and correlation test. The developed classifier demonstrates very plausible result which is compatible with commercial products having high world-wide market shares.

The Neural-Network Approach to Recognize Defect Pattern in LED Manufacturing

  • Chen, Wen-Chin;Tsai, Chih-Hung;Hsu, Shou-Wen
    • International Journal of Quality Innovation
    • /
    • v.7 no.3
    • /
    • pp.58-69
    • /
    • 2006
  • This paper presents neural network-based recognition system for automatic light emitting diode (LED) inspection. The back-propagation neural network (BPNN) is proposed and tested. The current-voltage (I-V) characteristic data of LED from the inspection process is used for the network training and testing. This study selects 300 random samples as network training and employs 100 samples as network testing. The experimental results show that if the classification work is done well, the accuracy of recognition is 100%, and the testing speed of the proposed recognition system is almost one half faster than the traditional inspection system does. The proposed neural-network approach is successfully demonstrated by real data sets and can be effectively developed as a recognition system for a practical application purpose.

Predictive Modeling of River Water Quality Factors Using Artificial Neural Network Technique - Focusing on BOD and DO- (인공신경망기법을 이용한 하천수질인자의 예측모델링 - BOD와 DO를 중심으로-)

  • 조현경
    • Journal of Environmental Science International
    • /
    • v.9 no.6
    • /
    • pp.455-462
    • /
    • 2000
  • This study aims at the development of the model for a forecasting of water quality in river basins using artificial neural network technique. Water quality by Artificial Neural Network Model forecasted and compared with observed values at the Sangju q and Dalsung stations in Nakdong river basin. For it, a multi-layer neural network was constructed to forecast river water quality. The neural network learns continuous-valued input and output data. Input data was selected as BOD, CO discharge and precipitation. As a result, it showed that method III of three methods was suitable more han other methods by statistical test(ME, MSE, Bias and VER). Therefore, it showed that Artificial Neural Network Model was suitable for forecasting river water quality.

  • PDF