• Title/Summary/Keyword: neural network.

Search Result 11,857, Processing Time 0.041 seconds

A Video Expression Recognition Method Based on Multi-mode Convolution Neural Network and Multiplicative Feature Fusion

  • Ren, Qun
    • Journal of Information Processing Systems
    • /
    • v.17 no.3
    • /
    • pp.556-570
    • /
    • 2021
  • The existing video expression recognition methods mainly focus on the spatial feature extraction of video expression images, but tend to ignore the dynamic features of video sequences. To solve this problem, a multi-mode convolution neural network method is proposed to effectively improve the performance of facial expression recognition in video. Firstly, OpenFace 2.0 is used to detect face images in video, and two deep convolution neural networks are used to extract spatiotemporal expression features. Furthermore, spatial convolution neural network is used to extract the spatial information features of each static expression image, and the dynamic information feature is extracted from the optical flow information of multiple expression images based on temporal convolution neural network. Then, the spatiotemporal features learned by the two deep convolution neural networks are fused by multiplication. Finally, the fused features are input into support vector machine to realize the facial expression classification. Experimental results show that the recognition accuracy of the proposed method can reach 64.57% and 60.89%, respectively on RML and Baum-ls datasets. It is better than that of other contrast methods.

Prediction of Daily Water Supply Using Neuro Genetic Hybrid Model (뉴로 유전자 결합모형을 이용한 상수도 1일 급수량 예측)

  • Rhee, Kyoung-Hoon;Kang, Il-Hwan;Moon, Byoung-Seok;Park, Jin-Geum
    • Journal of Environmental Impact Assessment
    • /
    • v.14 no.4
    • /
    • pp.157-164
    • /
    • 2005
  • Existing models that predict of Daily water supply include statistical models and neural network model. The neural network model was more effective than the statistical models. Only neural network model, which predict of Daily water supply, is focused on estimation of the operational control. Neural network model takes long learning time and gets into local minimum. This study proposes Neuro Genetic hybrid model which a combination of genetic algorithm and neural network. Hybrid model makes up for neural network's shortcomings. In this study, the amount of supply, the mean temperature and the population of the area supplied with water are use for neural network's learning patterns for prediction. RMSE(Root Mean Square Error) is used for a MOE(Measure Of Effectiveness). The comparison of the two models showed that the predicting capability of Hybrid model is more effective than that of neural network model. The proposed hybrid model is able to predict of Daily water, thus it can apply real time estimation of operational control of water works and water drain pipes. Proposed models include accidental cases such as a suspension of water supply. The maximum error rate between the estimation of the model and the actual measurement was 11.81% and the average error was lower than 1.76%. The model is expected to be a real-time estimation of the operational control of water works and water/drain pipes.

A Study on Optimal Neural Network Structure of Nonlinear System using Genetic Algorithm (유전 알고리즘을 이용한 비선형 시스템의 최적 신경 회로망 구조에 관한 연구)

  • Kim, Hong-Bok;Kim, Jeong-Keun;Kim, Min-Jung;Hwang, Seung-Wook
    • Journal of Navigation and Port Research
    • /
    • v.28 no.3
    • /
    • pp.221-225
    • /
    • 2004
  • This paper deals with a nonlinear system modelling using neural network and genetic algorithm Application q{ neural network to control and identification is actively studied because of their approximating ability of nonlinear function. It is important to design the neural network with optimal structure for minimum error and fast response time. Genetic algorithm is getting more popular nowadays because of their simplicity and robustness. in this paper, we optimize a neural network structure using genetic algorithm The genetic algorithm uses binary coding for neural network structure and searches for an optimal neural network structure of minimum error and fast response time. Through an extensive simulation, the optimal neural network structure is shown to be effective for identification of nonlinear system.

Implementation of Self-adaptive System using the Algorithm of Neural Network Learning Gain

  • Lee, Seong-Su;Kim, Yong-Wook;Oh, Hun;Park, Wal-Seo
    • International Journal of Control, Automation, and Systems
    • /
    • v.6 no.3
    • /
    • pp.453-459
    • /
    • 2008
  • The neural network is currently being used throughout numerous control system fields. However, it is not easy to obtain an input-output pattern when the neural network is used for the system of a single feedback controller and it is difficult to obtain satisfactory performance with when the load changes rapidly or disturbance is applied. To resolve these problems, this paper proposes a new mode to implement a neural network controller by installing a real object for control and an algorithm for this, which can replace the existing method of implementing a neural network controller by utilizing activation function at the output node. The real plant object for controlling of this mode implements a simple neural network controller replacing the activation function and provides the error back propagation path to calculate the error at the output node. As the controller is designed using a simple structure neural network, the input-output pattern problem is solved naturally and real-time learning becomes possible through the general error back propagation algorithm. The new algorithm applied neural network controller gives excellent performance for initial and tracking response and shows a robust performance for rapid load change and disturbance, in which the permissible error surpasses the range border. The effect of the proposed control algorithm was verified in a test that controlled the speed of a motor equipped with a high speed computing capable DSP on which the proposed algorithm was loaded.

Design and Implementation of Recurrent Time Delayed Neural Network Controller Using Fuzzy Compensator (퍼지 보상기를 사용한 리커런트 시간지연 신경망 제어기 설계 및 구현)

  • Lee, Sang-Yun;Shin, Woo-Jae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.13 no.3
    • /
    • pp.334-341
    • /
    • 2003
  • In this paper, we proposed a recurrent time delayed neural network(RTDNN) controller which compensate a output of neural network controller. Even if learn by neural network controller, it can occur an bad results from disturbance or load variations. So in order to adjust above case, we used the fuzzy compensator to get an expected results. And the weight of main neural network can be changed with the result of learning a inverse model neural network of plant, so a expected dynamic characteristics of plant can be got. As the results of simulation through the second order plant, we confirmed that the proposed recurrent time delayed neural network controller get a good response compare with a time delayed neural network(TDU) controller. We implemented the controller using the DSP processor and applied in a hydraulic servo system. And then we observed an experimental results.

The Possibility of Neural Network Approach to Solve Singular Perturbed Problems

  • Kim, Jee-Hyun;Cho, Young-Im
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.1
    • /
    • pp.69-76
    • /
    • 2021
  • Recentlly neural network approach for solving a singular perturbed integro-differential boundary value problem have been researched. Especially the model of the feed-forward neural network to be trained by the back propagation algorithm with various learning algorithms were theoretically substantiated, and neural network models such as deep learning, transfer learning, federated learning are very rapidly evolving. The purpose of this paper is to study the approaching method for developing a neural network model with high accuracy and speed for solving singular perturbed problem along with asymptotic methods. In this paper, we propose a method that the simulation for the difference between result value of singular perturbed problem and unperturbed problem by using neural network approach equation. Also, we showed the efficiency of the neural network approach. As a result, the contribution of this paper is to show the possibility of simple neural network approach for singular perturbed problem solution efficiently.

Mobile robot control by MNN using optimal EN (최적 EN를 사용한 MNN에 의한 Mobile Robot제어)

  • Choi, Woo-Kyung;Kim, Seong-Joo;Seo, Jae-Yong;Jeon, Hong-Tae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.13 no.2
    • /
    • pp.186-191
    • /
    • 2003
  • Skills in tracing of the MR divide into following, approaching, avoiding and warning and so on. It is difficult to have all these skills learned as neural network. To make this up for, skills consisted of each module, and Mobile Robot was controlled by the output of module adequate for the situation. A mobile Robot was equipped multi-ultrasonic sensor and a USB Camera, which can be in place of human sense, and the measured environment information data is learned through Modular Neural Network. MNN consisted of optimal combination of activation function in the Expert Network and its structure seemed to improve learning time and errors. The Gating Network(GN) used to control output values of the MNN by switching for angle and speed of the robot. In the paper, EN of Modular Neural network was designed optimal combination. Traveling with a real MR was performed repeatedly to verity the usefulness of the MNN which was proposed in this paper. The robot was properly controlled and driven by the result value and the experimental is rewarded with good fruits.

Neural Logic Network-Based Fuzzy Inference Network and its Search Strategy (신경논리망 기반의 퍼지추론 네트워크와 탐색 전략)

  • Lee, Heon-Joo;Kim, Jae-Ho
    • The Transactions of the Korea Information Processing Society
    • /
    • v.3 no.5
    • /
    • pp.1138-1146
    • /
    • 1996
  • Fuzzy logic ignores some informations in the reasoning process. Neural networks are powerful tools for the pattern processing. However, to model human knowledges, besides pattern processing capability, the logical reasoning capability is equally important. Another new neural network called neural logic network is able to do the logical reasoning. Because the fuzzy logical reasoning, we construct fuzzy inference net-work based on the neural logic network, extending the existing rule-inferencing network. And the traditional propagation rule is modified. For the search strategies to find out the belief value of a conclusion in the fuzzy inference network, we conduct a simulation to evaluate the search cost for searching sequentially and searching by means of priorities.

  • PDF

Stable Path Tracking Control of a Mobile Robot Using a Wavelet Based Fuzzy Neural Network

  • Oh, Joon-Seop;Park, Jin-Bae;Choi, Yoon-Ho
    • International Journal of Control, Automation, and Systems
    • /
    • v.3 no.4
    • /
    • pp.552-563
    • /
    • 2005
  • In this paper, we propose a wavelet based fuzzy neural network (WFNN) based direct adaptive control scheme for the solution of the tracking problem of mobile robots. To design a controller, we present a WFNN structure that merges the advantages of the neural network, fuzzy model and wavelet transform. The basic idea of our WFNN structure is to realize the process of fuzzy reasoning of the wavelet fuzzy system by the structure of a neural network and to make the parameters of fuzzy reasoning be expressed by the connection weights of a neural network. In our control system, the control signals are directly obtained to minimize the difference between the reference track and the pose of a mobile robot via the gradient descent (GD) method. In addition, an approach that uses adaptive learning rates for training of the WFNN controller is driven via a Lyapunov stability analysis to guarantee fast convergence, that is, learning rates are adaptively determined to rapidly minimize the state errors of a mobile robot. Finally, to evaluate the performance of the proposed direct adaptive control system using the WFNN controller, we compare the control results of the WFNN controller with those of the FNN, the WNN and the WFM controllers.

Optimized Polynomial Neural Network Classifier Designed with the Aid of Space Search Simultaneous Tuning Strategy and Data Preprocessing Techniques

  • Huang, Wei;Oh, Sung-Kwun
    • Journal of Electrical Engineering and Technology
    • /
    • v.12 no.2
    • /
    • pp.911-917
    • /
    • 2017
  • There are generally three folds when developing neural network classifiers. They are as follows: 1) discriminant function; 2) lots of parameters in the design of classifier; and 3) high dimensional training data. Along with this viewpoint, we propose space search optimized polynomial neural network classifier (PNNC) with the aid of data preprocessing technique and simultaneous tuning strategy, which is a balance optimization strategy used in the design of PNNC when running space search optimization. Unlike the conventional probabilistic neural network classifier, the proposed neural network classifier adopts two type of polynomials for developing discriminant functions. The overall optimization of PNNC is realized with the aid of so-called structure optimization and parameter optimization with the use of simultaneous tuning strategy. Space search optimization algorithm is considered as a optimize vehicle to help the implement both structure and parameter optimization in the construction of PNNC. Furthermore, principal component analysis and linear discriminate analysis are selected as the data preprocessing techniques for PNNC. Experimental results show that the proposed neural network classifier obtains better performance in comparison with some other well-known classifiers in terms of accuracy classification rate.