• 제목/요약/키워드: neural learning scheme

검색결과 260건 처리시간 0.026초

A Reinforcement Learning with CMAC

  • Kwon, Sung-Gyu
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제6권4호
    • /
    • pp.271-276
    • /
    • 2006
  • To implement a generalization of value functions in Adaptive Search Element (ASE)-reinforcement learning, CMAC (Cerebellar Model Articulation Controller) is integrated into ASE controller. ASE-reinforcement learning scheme is briefly studied to discuss how CMAC is integrated into ASE controller. Neighbourhood Sequential Training for CMAC is utilized to establish the look-up table and to produce discrete control outputs. In computer simulation, an ASE controller and a couple of ASE-CMAC neural network are trained to balance the inverted pendulum on a cart. The number of trials until the controllers are established and the learning performance of the controllers are evaluated to find that generalization ability of the CMAC improves the speed of the ASE-reinforcement learning enough to realize the cartpole control system.

Evolutionary Computing Driven Extreme Learning Machine for Objected Oriented Software Aging Prediction

  • Ahamad, Shahanawaj
    • International Journal of Computer Science & Network Security
    • /
    • 제22권2호
    • /
    • pp.232-240
    • /
    • 2022
  • To fulfill user expectations, the rapid evolution of software techniques and approaches has necessitated reliable and flawless software operations. Aging prediction in the software under operation is becoming a basic and unavoidable requirement for ensuring the systems' availability, reliability, and operations. In this paper, an improved evolutionary computing-driven extreme learning scheme (ECD-ELM) has been suggested for object-oriented software aging prediction. To perform aging prediction, we employed a variety of metrics, including program size, McCube complexity metrics, Halstead metrics, runtime failure event metrics, and some unique aging-related metrics (ARM). In our suggested paradigm, extracting OOP software metrics is done after pre-processing, which includes outlier detection and normalization. This technique improved our proposed system's ability to deal with instances with unbalanced biases and metrics. Further, different dimensional reduction and feature selection algorithms such as principal component analysis (PCA), linear discriminant analysis (LDA), and T-Test analysis have been applied. We have suggested a single hidden layer multi-feed forward neural network (SL-MFNN) based ELM, where an adaptive genetic algorithm (AGA) has been applied to estimate the weight and bias parameters for ELM learning. Unlike the traditional neural networks model, the implementation of GA-based ELM with LDA feature selection has outperformed other aging prediction approaches in terms of prediction accuracy, precision, recall, and F-measure. The results affirm that the implementation of outlier detection, normalization of imbalanced metrics, LDA-based feature selection, and GA-based ELM can be the reliable solution for object-oriented software aging prediction.

공진화를 이용한 신경회로망의 구조 최적화 (Structure optimization of neural network using co-evolution)

  • 전효병;김대준;심귀보
    • 전자공학회논문지S
    • /
    • 제35S권4호
    • /
    • pp.67-75
    • /
    • 1998
  • In general, Evoluationary Algorithm(EAs) are refered to as methods of population-based optimization. And EAs are considered as very efficient methods of optimal sytem design because they can provice much opportunity for obtaining the global optimal solution. This paper presents a co-evolution scheme of artifical neural networks, which has two different, still cooperatively working, populations, called as a host popuation and a parasite population, respectively. Using the conventional generatic algorithm the host population is evolved in the given environment, and the parastie population composed of schemata is evolved to find useful schema for the host population. the structure of artificial neural network is a diagonal recurrent neural netork which has self-feedback loops only in its hidden nodes. To find optimal neural networks we should take into account the structure of the neural network as well as the adaptive parameters, weight of neurons. So we use the genetic algorithm that searches the structure of the neural network by the co-evolution mechanism, and for the weights learning we adopted the evolutionary stategies. As a results of co-evolution we will find the optimal structure of the neural network in a short time with a small population. The validity and effectiveness of the proposed method are inspected by applying it to the stabilization and position control of the invered-pendulum system. And we will show that the result of co-evolution is better than that of the conventioal genetic algorithm.

  • PDF

온라인 학습 신경망 조직을 이용한 내고장성 제어계의 설계 (A Design of a Fault Tolerant Control System Using On-Line Learning Neural Networks)

  • Younghwan An
    • 소음진동
    • /
    • 제8권6호
    • /
    • pp.1181-1192
    • /
    • 1998
  • 본 연구에서는 신경조직망을 이용한 항공제어계의 내고장성 성능에 대해 관점을 두었다. 이 내고장성 제어계는 감지기와 작동기의 고장 발견. 확인 그리고 보완으로 이루어진다 SFDIA는 주 신경조직망과 n개의 국소 신경조직망으로 이루어지는데, 여분의 감지기 없이 n개의 감지기로 내고장성 능력을 성취함을 목적으로 한다. 또한, AFDIA는 같은 주 신경조직망과 세개의 신경조직망 제어기들로 구성되며. 이 제어기들은 평형을 유지하는 역할을 하며 고장으로 인한 pitching. rolling. 그리고 yawing moment를 상쇄하는 기능을 한다. 본 연구에서는 특히 잘못된 경보와 고장 확인의 성능이 떨어짐이 없이 SFDIA와 AFDIA의 효과적인 통합 기능을 수행하는데 중점을 두었으며 여러 가지 작동기와 감지기의 고장에 대한 연구 결과가 제시되었다.

  • PDF

The Modeling of Chaotic Nonlinear System Using Wavelet Based Fuzzy Neural Network

  • Oh, Joon-Seop;You, Sung-Jin;Park, Jin-Bae;Choi, Yoon-Ho
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.635-639
    • /
    • 2004
  • In this paper, we present a novel approach for the structure of Fuzzy Neural Network(FNN) based on wavelet function and apply this network structure to the modeling of chaotic nonlinear systems. Generally, the wavelet fuzzy model(WFM) has the advantage of the wavelet transform by constituting the fuzzy basis function(FBF) and the conclusion part to equalize the linear combination of FBF with the linear combination of wavelet functions. However, it is very difficult to identify the fuzzy rules and to tune the membership functions of the fuzzy reasoning mechanism. Neural networks, on the other hand, utilize their learning capability for automatic identification and tuning. Therefore, we design a wavelet based FNN structure(WFNN) that merges these advantages of neural network, fuzzy model and wavelet transform. The basic idea of our wavelet based FNN is to realize the process of fuzzy reasoning of wavelet fuzzy system by the structure of a neural network and to make the parameters of fuzzy reasoning be expressed by the connection weights of a neural network. And our network can automatically identify the fuzzy rules by modifying the connection weights of the networks via the gradient descent scheme. To verify the efficiency of our network structure, we evaluate the modeling performance for chaotic nonlinear systems and compare it with those of the FNN and the WFM.

  • PDF

Path Tracking Control Using a Wavelet Based Fuzzy Neural Network for Mobile Robots

  • Oh, Joon-Seop;Park, Yoon-Ho
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제4권1호
    • /
    • pp.111-118
    • /
    • 2004
  • In this paper, we present a novel approach for the structure of Fuzzy Neural Network(FNN) based on wavelet function and apply this network structure to the solution of the tracking problem for mobile robots. Generally, the wavelet fuzzy model(WFM) has the advantage of the wavelet transform by constituting the fuzzy basis function(FBF) and the conclusion part to equalize the linear combination of FBF with the linear combination of wavelet functions. However, it is very difficult to identify the fuzzy rules and to tune the membership functions of the fuzzy reasoning mechanism. Neural networks, on the other hand, utilize their learning capability for automatic identification and tuning. Therefore, we design a wavelet based FNN structure(WFNN) that merges these advantages of neural network, fuzzy model and wavelet transform. The basic idea of our wavelet based FNN is to realize the process of fuzzy reasoning of wavelet fuzzy system by the structure of a neural network and to make the parameters of fuzzy reasoning be expressed by the connection weights of a neural network. And our network can automatically identify the fuzzy rules by modifying the connection weights of the networks via the gradient descent scheme. To verify the efficiency of our network structure, we evaluate the tracking performance for mobile robot and compare it with those of the FNN and the WFM.

3차원 물체의 인식 성능 향상을 위한 감각 융합 신경망 시스템 (Neural Network Approach to Sensor Fusion System for Improving the Recognition Performance of 3D Objects)

  • 동성수;이종호;김지경
    • 대한전기학회논문지:시스템및제어부문D
    • /
    • 제54권3호
    • /
    • pp.156-165
    • /
    • 2005
  • Human being recognizes the physical world by integrating a great variety of sensory inputs, the information acquired by their own action, and their knowledge of the world using hierarchically parallel-distributed mechanism. In this paper, authors propose the sensor fusion system that can recognize multiple 3D objects from 2D projection images and tactile informations. The proposed system focuses on improving recognition performance of 3D objects. Unlike the conventional object recognition system that uses image sensor alone, the proposed method uses tactual sensors in addition to visual sensor. Neural network is used to fuse the two sensory signals. Tactual signals are obtained from the reaction force of the pressure sensors at the fingertips when unknown objects are grasped by four-fingered robot hand. The experiment evaluates the recognition rate and the number of learning iterations of various objects. The merits of the proposed systems are not only the high performance of the learning ability but also the reliability of the system with tactual information for recognizing various objects even though the visual sensory signals get defects. The experimental results show that the proposed system can improve recognition rate and reduce teeming time. These results verify the effectiveness of the proposed sensor fusion system as recognition scheme for 3D objects.

신경회로망 기반의 적응제어기를 이용한 AUV의 운동 제어 (Motion Control of an AUV Using a Neural-Net Based Adaptive Controller)

  • 이계홍;이판묵;이상정
    • 한국해양공학회지
    • /
    • 제16권1호
    • /
    • pp.8-15
    • /
    • 2002
  • This paper presents a neural net based nonlinear adaptive controller for an autonomous underwater vehicle (AUV). AUV's dynamics are highly nonlinear and their hydrodynamic coefficients vary with different operational conditions, so it is necessary for the high performance control system of an AUV to have the capacities of learning and adapting to the change of the AUV's dynamics. In this paper a linearly parameterized neural network is used to approximate the uncertainties of the AUV's dynamic, and the basis function vector of network is constructed according to th AUV's physical properties. A sliding mode control scheme is introduced to attenuate the effect of the neural network's reconstruction errors and the disturbances in AUV's dynamics. Using Lyapunov theory, the stability of the presented control system is guaranteed as well as the uniformly boundedness of tracking errors and neural network's weights estimation errors. Finally, numerical simulations for motion control of an AUV are performed to illustrate the effectiveness of the proposed techniques.

An Adaptive Tracking Control for Robotic Manipulators based on RBFN

  • Lee, Min-Jung;Jin, Tae-Seok
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제7권2호
    • /
    • pp.96-101
    • /
    • 2007
  • Neural networks are known as kinds of intelligent strategies since they have learning capability. There are various their applications from intelligent control fields; however, their applications have limits from the point that the stability of the intelligent control systems is not usually guaranteed. In this paper we propose an adaptive tracking control for robot manipulators using the radial basis function network (RBFN) that is e. kind of neural networks. Adaptation laws for parameters of the RBFN are developed based on the Lyapunov stability theory to guarantee the stability of the overall control scheme. Filtered tracking errors between actual outputs and desired outputs are discussed in the sense of the uniformly ultimately boundedness(UUB). Additionally, it is also shown that parameters of the RBFN are bounded. Experimental results for a SCARA-type robot manipulator show that the proposed adaptive tracking controller is adaptable to the environment changes and is more robust than the conventional PID controller and the neuro-controller based on the multilayer perceptron.

Human activity classification using Neural Network

  • Sharma, Annapurna;Lee, Young-Dong;Chung, Wan-Young
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 2008년도 춘계종합학술대회 A
    • /
    • pp.229-232
    • /
    • 2008
  • A Neural network classification of human activity data is presented. The data acquisition system involves a tri-axial accelerometer in wireless sensor network environment. The wireless ad-hoc system has the advantage of small size, convenience for wearability and cost effectiveness. The system can further improve the range of user mobility with the inclusion of ad-hoc environment. The classification is based on the frequencies of the involved activities. The most significant Fast Fourier coefficients, of the acceleration of the body movement, are used for classification of the daily activities like, Rest walk and Run. A supervised learning approach is used. The work presents classification accuracy with the available fast batch training algorithms i.e. Levenberg-Marquardt and Resilient back propagation scheme is used for training and calculation of accuracy.

  • PDF