• Title/Summary/Keyword: multi-layer neural networks

Search Result 223, Processing Time 0.028 seconds

An Action Decision and Execution Method of Robotic Soccer System based on Neural Networks (신경회로망을 이용한 로봇축구 시스템의 행동결정 및 행동실행 방법)

  • Lee, Kyoung-Tae;Kim, Hak-Il;Kim, Choon-Woo
    • Proceedings of the KIEE Conference
    • /
    • 1998.11b
    • /
    • pp.543-545
    • /
    • 1998
  • Robotic soccer is multi-agent system playing soccer game under given rule. This system consists of three mobile robots, vision sensor, action decision module, action execution module and communication module. This paper presents new action decision method using multi-layer neural networks.

  • PDF

Control of temperature distribution in a thermal stratified tunnel by using neural networks (신경회로망을 이용한 열성층 풍동내의 온도 분포 제어)

  • 부광석;김경천
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1996.10b
    • /
    • pp.147-150
    • /
    • 1996
  • This paper describes controller design and implementation method for controlling the temperature distribution in a thermal stratified wind tunnel(TSWT) by using a neural network algorithm. It is impossible to derive a mathematical model of the relation between heat inputs and temperature outputs in the test section of the TSWT governed by a nonlinear turbulent flow. Thus inverse neural network models with a multi layer perceptron structure are used in a feedforward control loop and feedback control loop to generate an arbitrary temperature distribution in the test section of the TSWT.

  • PDF

New Approach to Optimize the Size of Convolution Mask in Convolutional Neural Networks

  • Kwak, Young-Tae
    • Journal of the Korea Society of Computer and Information
    • /
    • v.21 no.1
    • /
    • pp.1-8
    • /
    • 2016
  • Convolutional neural network (CNN) consists of a few pairs of both convolution layer and subsampling layer. Thus it has more hidden layers than multi-layer perceptron. With the increased layers, the size of convolution mask ultimately determines the total number of weights in CNN because the mask is shared among input images. It also is an important learning factor which makes or breaks CNN's learning. Therefore, this paper proposes the best method to choose the convolution size and the number of layers for learning CNN successfully. Through our face recognition with vast learning examples, we found that the best size of convolution mask is 5 by 5 and 7 by 7, regardless of the number of layers. In addition, the CNN with two pairs of both convolution and subsampling layer is found to make the best performance as if the multi-layer perceptron having two hidden layers does.

Estimating chlorophyll-A concentration in the Caspian Sea from MODIS images using artificial neural networks

  • Boudaghpour, Siamak;Moghadam, Hajar Sadat Alizadeh;Hajbabaie, Mohammadreza;Toliati, Seyed Hamidreza
    • Environmental Engineering Research
    • /
    • v.25 no.4
    • /
    • pp.515-521
    • /
    • 2020
  • Nowadays, due to various pollution sources, it is essential for environmental scientists to monitor water quality. Phytoplanktons form the end of the food chain in water bodies and are one of the most important biological indicators in water pollution studies. Chlorophyll-A, a green pigment, is found in all phytoplankton. Chlorophyll-A concentration indicates phytoplankton biomass directly. Therefore, Chlorophyll-A is an indirect indicator of pollutants, including phosphorus and nitrogen, and their refinement and control are important. The present study, Moderate Resolution Imaging Spectroradiometer (MODIS) satellite images were used to estimate the chlorophyll-A concentration in southern coastal waters in the Caspian Sea. For this purpose, Multi-layer perceptron neural networks (NNs) were applied which contained three and four feed-forward layers. The best three-layer NN has 15 neurons in its hidden layer and the best four-layer one has 5 in each. The three- and four- layer networks both resulted in similar root mean square errors (RMSE), 0.1($\frac{{\mu}g}{l}$), however, the four-layer NNs proved superior in terms of R2 and also required less training data. Accordingly, a four-layer feed-forward NN with 5 neurons in each hidden layer, is the best network structure for estimating Chlorophyll-A concentration in the southern coastal waters of the Caspian Sea.

The Study of the Financial Index Prediction Using the Equalized Multi-layer Arithmetic Neural Network (균등다층연산 신경망을 이용한 금융지표지수 예측에 관한 연구)

  • 김성곤;김환용
    • Journal of the Korea Society of Computer and Information
    • /
    • v.8 no.3
    • /
    • pp.113-123
    • /
    • 2003
  • Many researches on the application of neural networks for making financial index prediction have proven their advantages over statistical and other methods. In this paper, a neural network model is proposed for the Buying, Holding or Selling timing prediction in stocks by the price index of stocks by inputting the closing price and volume of dealing in stocks and the technical indexes(MACD, Psychological Line). This model has an equalized multi-layer arithmetic function as well as the time series prediction function of backpropagation neural network algorithm. In the case that the numbers of learning data are unbalanced among the three categories (Buying, Holding or Selling), the neural network with conventional method has the problem that it tries to improve only the prediction accuracy of the most dominant category. Therefore, this paper, after describing the structure, working and learning algorithm of the neural network, shows the equalized multi-layer arithmetic method controlling the numbers of learning data by using information about the importance of each category for improving prediction accuracy of other category. Experimental results show that the financial index prediction using the equalized multi-layer arithmetic neural network has much higher correctness rate than the other conventional models.

  • PDF

Multi-Layer Perceptron Based Ternary Tree Partitioning Decision Method for Versatile Video Coding (다목적 비디오 부/복호화를 위한 다층 퍼셉트론 기반 삼항 트리 분할 결정 방법)

  • Lee, Taesik;Jun, Dongsan
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.6
    • /
    • pp.783-792
    • /
    • 2022
  • Versatile Video Coding (VVC) is the latest video coding standard, which had been developed by the Joint Video Experts Team (JVET) of ITU-T Video Coding Experts Group (VCEG) and ISO/IEC Moving Picture Experts Group (MPEG) in 2020. Although VVC can provide powerful coding performance, it requires tremendous computational complexity to determine the optimal block structures during the encoding process. In this paper, we propose a fast ternary tree decision method using two neural networks with 7 nodes as input vector based on the multi-layer perceptron structure, names STH-NN and STV-NN. As a training result of neural network, the STH-NN and STV-NN achieved accuracies of 85% and 91%, respectively. Experimental results show that the proposed method reduces the encoding complexity up to 25% with unnoticeable coding loss compared to the VVC test model (VTM).

The Study of Neural Networks Using Orthogonal Function System (직교함수를 사용한 신경회로망에 대한 연구)

  • 권성훈;최용준;이정훈;손동설;엄기환
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 1999.11a
    • /
    • pp.214-217
    • /
    • 1999
  • In this paper we proposed a heterogeneous hidden layer consisting of both sigmoid functions and RBFs(Radial Basis Function) in multi-layered neural networks. Focusing on the orthogonal relationship between the sigmoid function and its derivative, a derived RBF that is a derivative of the sigmoid function is used as the RBF in the neural network. so the proposed neural network is called ONN's feasibility Neural Network). Identification results using a nonlinear. function confirm both the ONN's feasibility and characteristics by comparing with those obtained using a conventional neural network which has sigmoid function or RBF in hidden layer.

  • PDF

The Study on Hybrid Architectures of Fuzzy Neural Networks Modeling (퍼지뉴럴네트워크 모델링의 하이브리드 구조에 관한 연구)

  • Park, Byoung-Jun;Oh, Sung-Kwun;Jang, Sung-Whan
    • Proceedings of the KIEE Conference
    • /
    • 2001.07d
    • /
    • pp.2699-2701
    • /
    • 2001
  • The study is concerned with an approach to the design of a new category of fuzzy neural networks. The proposed Fuzzy Polynomial Neural Networks(FPNN) with hybrid multi-layer inference architecture is based on fuzzy neural networks(FNN) and polynomial neural networks(PNN) for model identification of complex and nonlinear systems. The one and the other are considered as premise and consequence part of FPNN respectively. We introduce two kinds of FPNN architectures, namely the generic and advanced types depending on the connection points (nodes) of the layer of FNN. Owing to the specific features of two combined architectures, it is possible to consider the nonlinear characteristics of process and to get output performance with superb predictive ability. The availability and feasibility of the FPNN is discussed and illustrated with the aid of two representative numerical examples. The results show that the proposed FPNN can produce the model with higher accuracy and predictive ability than any other method presented previously.

  • PDF

Multi-layer Neural Network with Hybrid Learning Rules for Improved Robust Capability (Robustness를 형성시키기 위한 Hybrid 학습법칙을 갖는 다층구조 신경회로망)

  • 정동규;이수영
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.8
    • /
    • pp.211-218
    • /
    • 1994
  • In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

  • PDF

A Study on the PTP Motion of Robot Manipulators by Neural Networks (신경 회로망에 의한 로보트 매니퓰레이터의 PTP 운동에 관한 연구)

  • Kyung, Kye-Hyun;Ko, Myoung-Sam;Lee, Bum-Hee
    • Proceedings of the KIEE Conference
    • /
    • 1989.07a
    • /
    • pp.679-684
    • /
    • 1989
  • In this paper, we describe the PTP notion of robot manipulators by neural networks. The PTP motion requires the inverse kinematic redline and the joint trajectory generation algorithm. We use the multi-layered Perceptron neural networks and the Error Back Propagation(EBP) learning rule for inverse kinematic problems. Varying the number of hidden layers and the neurons of each hidden layer, we investigate the performance of the neural networks. Increasing the number of learning sweeps, we also discuss the performance of the neural networks. We propose a method for solving the inverse kinematic problems by adding the error compensation neural networks(ECNN). And, we implement the neural networks proposed by Grossberg et al. for automatic trajectory generation and discuss the problems in detail. Applying the neural networks to the current trajectory generation problems, we can refute the computation time for trajectory generation.

  • PDF