• 한국경영과학회:학술대회논문집
• /
• 한국경영과학회 1995년도 추계학술대회발표논문집; 서울대학교, 서울; 30 Sep. 1995
• /
• pp.325-333
• /
• 1995

Back-propagation is the most widely used algorithm for supervised learning in multi-layer feed-forward networks. However, back-propagation is very slow in convergence. In this paper, a new weight initialization method, called rough map initialization, in multi-layer perceptrons is proposed. To overcome the long convergence time, possibly due to the random initialization of the weights of the existing multi-layer perceptrons, the rough map initialization method initialize weights by utilizing relationship of input-output features with singular value decomposition technique. The results of this initialization procedure are compared to random initialization procedure in encoder problems and xor problems.

• 제어로봇시스템학회논문지
• /
• 제17권8호
• /
• pp.777-782
• /
• 2011

Neural network technique is widely employed in the fields of signal processing, control systems, pattern recognition, etc. Learning of neural networks is an important procedure to accomplish dynamic system modeling. This paper presents a novel learning approach for differential neural network models based on the Kalman-Bucy filter theory. We construct an augmented state vector including original neural state and parameter vectors and derive a state estimation rule avoiding gradient function terms which involve to the conventional neural learning methods such as a back-propagation approach. We carry out numerical simulation to evaluate the proposed learning approach in nonlinear system modeling. By comparing to the well-known back-propagation approach and Kalman-Bucy filtering, its superiority is additionally proved under stochastic system environments.

• 한국정밀공학회:학술대회논문집
• /
• 한국정밀공학회 1997년도 춘계학술대회 논문집
• /
• pp.133-139
• /
• 1997

This paper presents a new approach to the dynamic control technique for track vehicle system using neural network-fuzzy control method. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is propored a learning controller consisting of two neural network-fuzzy based on independent resoning and a connection net with fixed weights to simply the neural network-fuzzy. The performance of the proposed controller is shown by simulation for trajectory tracking of the speed and azimuth of a track vehicle

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 1992년도 하계학술대회 논문집 A
• /
• pp.231-235
• /
• 1992

A new algorithm is proposed to identify the structure and the parameters of the nonlinear discrete-time plant with only the unknown dynamics and the weak informations about its structure. The proposed algorithm is constructed with the compensation method of weghing values using its previous derivatives and with the efficient technique updating self-learning coefficients. The result in this application is thought to prove the effectiveness of the algorithm proposed in this paper and its superiority to the conventional ones.

• 한국공작기계학회:학술대회논문집
• /
• 한국공작기계학회 1999년도 추계학술대회 논문집 - 한국공작기계학회
• /
• pp.142-147
• /
• 1999

This paper presents a new approach to the dynamic control technique for track vehicle system using neural network-fuzzy control method. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by simulation for trajectory tracking of the speed and azimuth of a track vehicle.

• 전자공학회논문지B
• /
• 제31B권7호
• /
• pp.119-128
• /
• 1994

In this paper, we propose a method for facial feature extraction and recognition algorithm using neural networks. First we extract a face part from the background image based on the knowledge that it is located in the center of an input image and that the background is homogeneous. Then using vertical and horizontal projections. We extract features from the separated face image using knowledge base of human faces. In the recognition step we use the back propagation algorithm of the neural networks and in the learning step to reduce the computation time we vary learning and momentum rates. Our technique recognizes 6 women and 14 men correctly.

• 한국경영과학회지
• /
• 제20권3호
• /
• pp.17-29
• /
• 1995

Recently, neural network models have been employed as an alternative to regression analysis for point estimation or function fitting in various field. Thus far, however, no theoretical or empirical guides seem to exist for selecting the tool which the most suitable one for a specific function-fitting problem. In this paper, we evaluate performance of three major function-fitting techniques, regression analysis and two neural network models, back-propagation and linear-Hebbian-learning neural networks. The functions to be fitted are simple linear ones of a single independent variable. The factors considered are size of noise both in dependent and independent variables, portion of outliers, and size of the data. Based on comutational results performed in this study, some guidelines are suggested to choose the best technique that can be used for a specific problem concerned.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 1995년도 하계학술대회 논문집 B
• /
• pp.953-955
• /
• 1995

Studied on identification of nonlinear system with unknown variables and adaptive control were successful. We need a mathmatical model when control a dynamic system using adaptive control technique, but it is very difficult due to its nonlinearity. In this paper, we described about performance improvement of error back-propagation algorithm and learning algorithm of non-linear dynamic system. We examined the proposed back-propagation learn algorithm for through an experiment.

• Computers and Concrete
• /
• 제6권3호
• /
• pp.203-223
• /
• 2009

Regression analysis (RA) can establish an explicit formula to predict the strength of High-Performance Concrete (HPC); however, the accuracy of the formula is poor. Back-Propagation Networks (BPNs) can establish a highly accurate model to predict the strength of HPC, but cannot generate an explicit formula. Genetic Operation Trees (GOTs) can establish an explicit formula to predict the strength of HPC that achieves a level of accuracy in between the two aforementioned approaches. Although GOT can produce an explicit formula but the formula is often too complicated so that unable to explain the substantial meaning of the formula. This study developed a Backward Pruning Technique (BPT) to simplify the complexity of GOT formula by replacing each variable of the tip node of operation tree with the median of the variable in the training dataset belonging to the node, and then pruning the node with the most accurate test dataset. Such pruning reduces formula complexity while maintaining the accuracy. 404 experimental datasets were used to compare accuracy and complexity of three model building techniques, RA, BPN and GOT. Results show that the pruned GOT can generate simple and accurate formula for predicting the strength of HPC.

• 한국정보처리학회논문지
• /
• 제4권12호
• /
• pp.3063-3068
• /
• 1997

일반적인 역전파(Back Propagation)의 알고리즘을 다층 다항식 고차 뉴럴네트워크에 적용하여 위치 변환 패턴에 있어 정확한 인식을 할 수 있도록 네트워크의 구조를 개선했다. 본 논문의 목적은 다층 다항식 고차 뉴럴네트워크를 이용하여 여러 가지 패턴 인식이 가능한 이유를 자세히 논한다. 실제 예로는 일정한 문자 인식의 예제로 변형된 영문자 T-C 패턴을 가지고 실험했으며, 네트워크의 일반성(Generalization)을 측정하기 위해서는 거울반사 대칭(Mirror Symmetry)문제를 시뮬레이션 했다. 그 결과 종래의 모델보다 기술적인 우수성을 확인 할 수가 있었다. 본 연구가 제안한 방식에 의한 위치 변환된 T-C 패턴에 대하여서는 90%의 인식율을 얻을 수 있었으며, 일반성의 실험에서 거울반사 대칭(Mirror Symmetry)에 대한 인식율은 70％를 얻었다. 이 실험결과는 종래의 모델에서는 구하기 어려운 인식율이며 기존 연구와 비교한 결과 본 제안 방식의 기술적 우위성을 확연히 판단 할 수 있다.