• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2001년도 ICCAS
• /
• pp.71.2-71
• /
• 2001

This paper deals with nonlinear system modelling using neural network and genetic algorithm. Application of neural network to control and identification is actively studied because of their approximating ability of nonlinear function. It is important to design the neural network with optimal structure for minimum error and fast response time. Genetic algorithm is getting more popular nowadays because of their simplicity and robustness. In this paper, We optimize neural network structure using genetic algorithm. The genetic algorithm uses binary coding for neural network structure and search for optimal neural network structure of minimum error and response time. Through extensive simulation, Optimal neural network structure is shown to be effective for ...

• 제어로봇시스템학회논문지
• /
• 제10권12호
• /
• pp.1295-1304
• /
• 2004

In this paper, the Bayesian recurrent neural network is proposed to predict time series data. A neural network predictor requests proper learning strategy to adjust the network weights, and one needs to prepare for non-linear and non-stationary evolution of network weights. The Bayesian neural network in this paper estimates not the single set of weights but the probability distributions of weights. In other words, the weights vector is set as a state vector of state space method, and its probability distributions are estimated in accordance with the particle filtering process. This approach makes it possible to obtain more exact estimation of the weights. In the aspect of network architecture, it is known that the recurrent feedback structure is superior to the feedforward structure for the problem of time series prediction. Therefore, the recurrent neural network with Bayesian inference, what we call Bayesian recurrent neural network (BRNN), is expected to show higher performance than the normal neural network. To verify the proposed method, the time series data are numerically generated and various kinds of neural network predictor are applied on it in order to be compared. As a result, feedback structure and Bayesian learning are better than feedforward structure and backpropagation learning, respectively. Consequently, it is verified that the Bayesian reccurent neural network shows better a prediction result than the common Bayesian neural network.

• 대한전기학회논문지:시스템및제어부문D
• /
• 제53권12호
• /
• pp.804-810
• /
• 2004

There are two important things for the general purpose neural network processor. The first is a capability to build various structures of neural network, and the second is to be able to support suitable learning method for that neural network. Some way to process various learning algorithms is required for on-chip learning, because the more neural network types are to be handled, the more learning methods need to be built into. In this paper, an improved hardware structure is proposed to compute various kinds of learning algorithms flexibly. The hardware structure is based on the existing modular neural network structure. It doesn't need to add a new circuit or a new program for the learning process. It is shown that rearrangements of the existing processing elements can produce several neural network learning modules. The performance and utilization of this module are analyzed by comparing with other neural network chips.

• 문화기술의 융합
• /
• 제9권1호
• /
• pp.649-654
• /
• 2023

본 논문은 그래프 합성곱 신경망을 이용한 신경망 구조 탐색 모델 설계를 제안한다. 딥 러닝은 블랙박스로 학습이 진행되는 특성으로 인해 설계한 모델이 최적화된 성능을 가지는 구조인지 검증하지 못하는 문제점이 존재한다. 신경망 구조 탐색 모델은 모델을 생성하는 순환 신경망과 생성된 네트워크인 합성곱 신경망으로 구성되어있다. 통상의 신경망 구조 탐색 모델은 순환신경망 계열을 사용하지만 우리는 본 논문에서 순환신경망 대신 그래프 합성곱 신경망을 사용하여 합성곱 신경망 모델을 생성하는 GC-NAS를 제안한다. 제안하는 GC-NAS는 Layer Extraction Block을 이용하여 Depth를 탐색하며 Hyper Parameter Prediction Block을 이용하여 Depth 정보를 기반으로 한 spatial, temporal 정보(hyper parameter)를 병렬적으로 탐색합니다. 따라서 Depth 정보를 반영하기 때문에 탐색 영역이 더 넓으며 Depth 정보와 병렬적 탐색을 진행함으로 모델의 탐색 영역의 목적성이 분명하기 때문에 GC-NAS대비 이론적 구조에 있어서 우위에 있다고 판단된다. GC-NAS는 그래프 합성곱 신경망 블록 및 그래프 생성 알고리즘을 통하여 기존 신경망 구조 탐색 모델에서 순환 신경망이 가지는 고차원 시간 축의 문제와 공간적 탐색의 범위 문제를 해결할 것으로 기대한다. 또한 우리는 본 논문이 제안하는 GC-NAS를 통하여 신경망 구조 탐색에 그래프 합성곱 신경망을 적용하는 연구가 활발히 이루어질 수 있는 계기가 될 수 있기를 기대한다.

• 한국항해항만학회지
• /
• 제28권5호
• /
• pp.435-441
• /
• 2004

본 논문은 비선형성을 많이 내포하고 있어 수학적으로 모델링 하기 어려운 선박용 안정화 위성 안테나 시스템을 모델링하기 위해서, 신경 회로망의 오차 및 응답시간을 최소로 하는 최적 구조 신경 회로망 모델을 도출하고 이를 적용하고자 한다. 오차와 응답시간을 최소화하기 위해 유전알고리즘을 이용하여 신경 회로망 구조를 설계하였다. 안테나 시스템으로부터 얻어진 입출력 데이터에 거하여 본 논문에서 제안한 식별기를 이용하여 안테나 시스템을 식별하였으며, 실제 선박의 운동 성분에 대해서도 시스템을 잘 표현할 수 있는 최적 구조 신경 회로 기반 시스템 식별기를 얻을 수 있었다. 실제 실험을 통해서, 최적 신경회로망 구조가 안테나 시스템 식별에 효과적인 것을 알 수 있었다.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2004년도 ICCAS
• /
• pp.635-639
• /
• 2004

In this paper, we present a novel approach for the structure of Fuzzy Neural Network(FNN) based on wavelet function and apply this network structure to the modeling of chaotic nonlinear systems. Generally, the wavelet fuzzy model(WFM) has the advantage of the wavelet transform by constituting the fuzzy basis function(FBF) and the conclusion part to equalize the linear combination of FBF with the linear combination of wavelet functions. However, it is very difficult to identify the fuzzy rules and to tune the membership functions of the fuzzy reasoning mechanism. Neural networks, on the other hand, utilize their learning capability for automatic identification and tuning. Therefore, we design a wavelet based FNN structure(WFNN) that merges these advantages of neural network, fuzzy model and wavelet transform. The basic idea of our wavelet based FNN is to realize the process of fuzzy reasoning of wavelet fuzzy system by the structure of a neural network and to make the parameters of fuzzy reasoning be expressed by the connection weights of a neural network. And our network can automatically identify the fuzzy rules by modifying the connection weights of the networks via the gradient descent scheme. To verify the efficiency of our network structure, we evaluate the modeling performance for chaotic nonlinear systems and compare it with those of the FNN and the WFM.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• 제4권1호
• /
• pp.111-118
• /
• 2004

In this paper, we present a novel approach for the structure of Fuzzy Neural Network(FNN) based on wavelet function and apply this network structure to the solution of the tracking problem for mobile robots. Generally, the wavelet fuzzy model(WFM) has the advantage of the wavelet transform by constituting the fuzzy basis function(FBF) and the conclusion part to equalize the linear combination of FBF with the linear combination of wavelet functions. However, it is very difficult to identify the fuzzy rules and to tune the membership functions of the fuzzy reasoning mechanism. Neural networks, on the other hand, utilize their learning capability for automatic identification and tuning. Therefore, we design a wavelet based FNN structure(WFNN) that merges these advantages of neural network, fuzzy model and wavelet transform. The basic idea of our wavelet based FNN is to realize the process of fuzzy reasoning of wavelet fuzzy system by the structure of a neural network and to make the parameters of fuzzy reasoning be expressed by the connection weights of a neural network. And our network can automatically identify the fuzzy rules by modifying the connection weights of the networks via the gradient descent scheme. To verify the efficiency of our network structure, we evaluate the tracking performance for mobile robot and compare it with those of the FNN and the WFM.

• 한국자동차공학회논문집
• /
• 제15권5호
• /
• pp.48-55
• /
• 2007

A bushing component of a vehicle suspension system is tested to capture the nonlinear behavior of rubber bushing element using the MTS 3-axes rubber test machine. The results of the tests are used to model the artificial neural network bushing model. The performances from the neural network model usually are dependent on the structure of the neural network. In this paper, maximum error, peak error, root mean square error, and error-to-signal ratio are employed to evaluate the performances of the neural network bushing model. A simple simulation is carried out to show the usefulness of the developed procedure.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2003년도 하계종합학술대회 논문집 Ⅲ
• /
• pp.1565-1568
• /
• 2003

In this paper, we propose modular network to solve difficult and complex problems that are seldom solved with multi-layer neural network. The structure of modular neural network in researched by Jacobs and Jordan is selected in this paper. Modular network consists of several expert networks and a gating network which is composed of single-layer neural network or multi-layer neural network. We propose modular network structure using recurrent neural network, since the state of the whole network at a particular time depends on an aggregate of previous states as well as on the current input. Finally, we show excellence of the proposed network compared with modular network.

• 한국지능시스템학회:학술대회논문집
• /
• 한국퍼지및지능시스템학회 2000년도 춘계학술대회 학술발표 논문집
• /
• pp.195-198
• /
• 2000

We propose a new wavelet neural network structure, for which we apply new recurrent nodes to the network, in this paper for the dynamic system identification and control. We will construct the wavelet neural network by using wavelet frame function. The function does not have the best approximation property, but it may be possible to apply some modification to the structure of the network because the constriction of orthogonality is loosened a little. This wavelet neural network we propose can obtain previous state information by its structure of the network without any addition of input, though the conventional wavelet network needs additional previous state input for the improvement of the dynamic performance. In numerical experience, the performance of the new wavelet neural network we propose in the nonlinear system with uncertainity of parameter Is equal to that of the wavelet network which used the additional previous information input, superior to that of the conventional wavelet network.