• Title/Summary/Keyword: Multi layer network

Search Result 813, Processing Time 0.028 seconds

Multi-layer Neural Network with Hybrid Learning Rules for Improved Robust Capability (Robustness를 형성시키기 위한 Hybrid 학습법칙을 갖는 다층구조 신경회로망)

  • 정동규;이수영
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.8
    • /
    • pp.211-218
    • /
    • 1994
  • In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

  • PDF

Cross-Layer Cooperative Scheduling Scheme for Multi-channel Hybrid Ubiquitous Sensor Networks

  • Zhong, Yingji;Yang, Qinghai;Kwak, Kyung-Sup;Yuan, Dongfeng
    • ETRI Journal
    • /
    • v.30 no.5
    • /
    • pp.663-673
    • /
    • 2008
  • The multi-scenario topology of multi-channel hybrid ubiquitous sensor networks (USNs) is studied and a novel link auto-diversity cross-layer cooperative scheduling scheme is proposed in this paper. The proposed scheme integrates the attributes of the new performance evaluation link auto-diversity air-time metric and the topology space in the given multi-scenario. The proposed scheme is compared with other schemes, and its superiority is demonstrated through simulations. The simulation results show that relative energy consumption, link reception probability, and end-to-end blocking probability are improved. The addressing ratio of success with unchanged parameters and external information can be increased. The network can tolerate more hops to support reliable transportation when the proposed scheme is implemented. Moreover, the scheme can make the network stable. Therefore, the proposed scheme can enhance the average rate performance of the hybrid USN and stabilize the outage probability.

  • PDF

A Study on the Control of Recognition Performance and the Rehabilitation of Damaged Neurons in Multi-layer Perceptron (다층 퍼셉트론으 인식력 제어와 복원에 관한 연구)

  • 박인정;장호성
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.16 no.2
    • /
    • pp.128-136
    • /
    • 1991
  • A neural network of multi layer perception type, learned by error back propagation learning rule, is generally used for the verification or clustering of similar type of patterns. When learning is completed, the network has a constant value of output depending on a pattern. This paper shows that the intensity of neuron's out put can be controlled by a function which intensifies the excitatory interconnection coefficients or the inhibitory one between neurons in output layer and those in hidden layer. In this paper the value of factor in the function to control the output is derived from the know values of the neural network after learning is completed And also this paper show that the amount of an increased neuron's output in output layer by arbitary value of the factor is derived. For the applications increased recognition performance of a pattern than has distortion is introduced and the output of partially damaged neurons are first managed and this paper shows that the reduced recognition performance can be recovered.

  • PDF

Multi-layer Surveillance System based on Wireless Mesh Networks (무선 메쉬 네트워크 기반의 다층구조 감시 시스템 구축)

  • Yoon, Tae-Ho;Song, Yoo-Seoung
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.7 no.5
    • /
    • pp.209-217
    • /
    • 2012
  • In the present, Wireless Sensor Network(WSN) has been used for the purpose of the military operation with surveillance systems and for collecting useful information from the natural environment. Basically, low-power, easy deployment and low cost are the most important factors to be deployed for WSNs. Lots of researches have been studied to meet those requirements, especially on the node capacity and battery lifetime improvements. Recently, the study of wireless mesh networks applied into the surveillance systems has been proceeded as a solution of easy deployment. In this paper, we proposed large-scale intelligent multi-layer surveillance systems based on QoS assuring Wireless Mesh Networks and implemented them in the real testbed environment. The proposed system explains functions and operations for each subsystem as well as S/W and H/W architectures. Experimental results are shown for the implemented subsystems and the performance is satisfactory for the surveillance system. We can identify the possibility of the implemented multi-layer surveillance system to be used in practice.

Object Recognition Using the Edge Orientation Histogram and Improved Multi-Layer Neural Network

  • Kang, Myung-A
    • International Journal of Advanced Culture Technology
    • /
    • v.6 no.3
    • /
    • pp.142-150
    • /
    • 2018
  • This paper describes the algorithm that lowers the dimension, maintains the object recognition and significantly reduces the eigenspace configuration time by combining the edge orientation histogram and principle component analysis. By using the detected object region as a recognition input image, in this paper the object recognition method combined with principle component analysis and the multi-layer network which is one of the intelligent classification was suggested and its performance was evaluated. As a pre-processing algorithm of input object image, this method computes the eigenspace through principle component analysis and expresses the training images with it as a fundamental vector. Each image takes the set of weights for the fundamental vector as a feature vector and it reduces the dimension of image at the same time, and then the object recognition is performed by inputting the multi-layer neural network.

Position Control of the Robot Manipulator Using Fuzzy Logic and Multi-layer neural Network (퍼지논리와 다층 신경망을 이용한 로보트 매니퓰레이터의 위치제어)

  • 김종수;이홍기;전홍태
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.28B no.11
    • /
    • pp.934-940
    • /
    • 1991
  • The multi-layer neural network that has broadly been utilized in designing the controller of robot manipulator possesses the desirable characteristics of learning capacity, by which the uncertain variation of the dynamic parameters of robot can be handled adaptively, and parallel distributed processing that makes it possible to control on real-time. However the error back propagation algorithm that has been utilized popularly in the learning of the multi-layer neural network has the problem of its slow convergencs speed. In this paper, an approach to improve the convergence speed is proposed using fuzzy logic that can effectively handle the uncertain and fuzzy informations by linguistic level. The effectiveness of the proposed algorithm is demonstrated by computer simulation of PUMA 560 robot manipulator.

  • PDF

A Sloshing Analysis of Storage Tank using Multi-layer Perceptron Artificial Neural Network (다층퍼셉트론 인공신경망을 이용한 저장탱크 슬로싱해석)

  • Kim, Hyun-Soo;Lee, Young-Shin
    • Proceedings of the KSME Conference
    • /
    • 2004.04a
    • /
    • pp.491-496
    • /
    • 2004
  • The oscillation of the fluid caused by external forces is called sloshing, which occurs in moving vehicles with contained liquid masses, such as aircraft. cars and liquid rocket and so on. This sloshing effect could be a severe problem in vehicle stability and control. So, various baffles are used in order to reduce the sloshing. The Lagrangian, Eulerian and ALE numerical method is widely used on the analysis of sloshing presently. But, these numerical methods are needed so many CPU time. In this study, for the reduction of the sloshing analysis time, me multi.layer perceptron artificial neural network is introduced and analysis results are presented.

  • PDF

Searching a global optimum by stochastic perturbation in error back-propagation algorithm (오류 역전파 학습에서 확률적 가중치 교란에 의한 전역적 최적해의 탐색)

  • 김삼근;민창우;김명원
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.3
    • /
    • pp.79-89
    • /
    • 1998
  • The Error Back-Propagation(EBP) algorithm is widely applied to train a multi-layer perceptron, which is a neural network model frequently used to solve complex problems such as pattern recognition, adaptive control, and global optimization. However, the EBP is basically a gradient descent method, which may get stuck in a local minimum, leading to failure in finding the globally optimal solution. Moreover, a multi-layer perceptron suffers from locking a systematic determination of the network structure appropriate for a given problem. It is usually the case to determine the number of hidden nodes by trial and error. In this paper, we propose a new algorithm to efficiently train a multi-layer perceptron. OUr algorithm uses stochastic perturbation in the weight space to effectively escape from local minima in multi-layer perceptron learning. Stochastic perturbation probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the EGP learning gets stuck to it. Addition of new hidden nodes also can be viewed asa special case of stochastic perturbation. Using stochastic perturbation we can solve the local minima problem and the network structure design in a unified way. The results of our experiments with several benchmark test problems including theparity problem, the two-spirals problem, andthe credit-screening data show that our algorithm is very efficient.

  • PDF

Convolutional Neural Network Based Multi-feature Fusion for Non-rigid 3D Model Retrieval

  • Zeng, Hui;Liu, Yanrong;Li, Siqi;Che, JianYong;Wang, Xiuqing
    • Journal of Information Processing Systems
    • /
    • v.14 no.1
    • /
    • pp.176-190
    • /
    • 2018
  • This paper presents a novel convolutional neural network based multi-feature fusion learning method for non-rigid 3D model retrieval, which can investigate the useful discriminative information of the heat kernel signature (HKS) descriptor and the wave kernel signature (WKS) descriptor. At first, we compute the 2D shape distributions of the two kinds of descriptors to represent the 3D model and use them as the input to the networks. Then we construct two convolutional neural networks for the HKS distribution and the WKS distribution separately, and use the multi-feature fusion layer to connect them. The fusion layer not only can exploit more discriminative characteristics of the two descriptors, but also can complement the correlated information between the two kinds of descriptors. Furthermore, to further improve the performance of the description ability, the cross-connected layer is built to combine the low-level features with high-level features. Extensive experiments have validated the effectiveness of the designed multi-feature fusion learning method.

One-chip determinism multi-layer neural network on FPGA

  • Suematsu, Ryosuke;Shimizu, Ryosuke;Aoyama, Tomoo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.89.4-89
    • /
    • 2002
  • $\textbullet$ Field Programmable Gate Array $\textbullet$ flexible hardware $\textbullet$ neural network $\textbullet$ determinism learning $\textbullet$ multi-valued logic $\textbullet$ disjunctive normal form $\textbullet$ multi-dimensional exclusive OR

  • PDF