• Korean Journal of Mathematics
• /
• 제30권1호
• /
• pp.131-146
• /
• 2022

This is an expository article about the gradients in deep neural network. It is hard to find a place where gradients in a deep neural network are dealt in details in a systematic and mathematical way. We review and compute the gradients and Jacobians to derive formulas for gradients which appear in the backpropagation and implement them in vectorized forms in Python.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1990년도 한국자동제어학술회의논문집(국제학술편); KOEX, Seoul; 26-27 Oct. 1990
• /
• pp.1256-1258
• /
• 1990

A large number of trainings are requested for the artificial neural network using the backpropagation algorithm. It is shown that one dimensional search technique is effective to reduce the number of trainings through some numerical simulations.

• 한국경영과학회:학술대회논문집
• /
• 대한산업공학회/한국경영과학회 1991년도 춘계공동학술대회 발표논문 및 초록집; 전북대학교, 전주; 26-27 Apr. 1991
• /
• pp.303-304
• /
• 1991

• 대한전기학회논문지
• /
• 제39권12호
• /
• pp.1306-1316
• /
• 1990

A controller using a multilayer neural network is proposed to the dynamic control of a PUMA 560 robot arm. This controller is developed based on an error back-propagation (BP) neural network. Since the neural network can model an arbitrary nonlinear mapping, it is used as a commanded feedforward torque generator. A Proportional Derivative (PD) feedback controller is used in parallel with the feedforward neural network to train the system. The neural network was trained by the current state of the manipulator as well as the PD feedback error torque. No a priori knowledge on system dynamics is needed and this information is rather implicitly stored in the interconnection weights of the neural network. In another experiment, the neural network was trained with the current, past and future positions only without any use of velocity sensors. Form this thim window of position values, BP network implicitly filters out the velocity and acceleration components for each joint. Computer simulation demonstrates such powerful characteristics of the neurocontroller as adaptation to changing environments, robustness to sensor noise, and continuous performance improvement with self-learning.

• 전자공학회논문지B
• /
• 제32B권12호
• /
• pp.1652-1662
• /
• 1995

In this paper, a hybrid neural network is proposed to improve the learning ability of a neural network. The union of the characteristics of a Self-Organizing Neural Network model and of multi-layer perceptron model using the backpropagation learning method gives us the advantage of reduction of the learning error and the learning time. In learning process, the proposed hybrid neural network reduces the number of nodes in hidden layers to reduce the calculation time. And this proposed neural network uses the fuzzy feedback values, when it updates the responding region of each node in the hidden layer. To show the effectiveness of this proposed hybrid neural network, the boolean function(XOR, 3Bit Parity) and the solution of inverse kinematics are used. Finally, this proposed hybrid neural network is applied to the visual tracking control of a PUMA560 robot, and the result data is presented.

• Journal of Biosystems Engineering
• /
• 제23권6호
• /
• pp.621-628
• /
• 1998

In order to develop an inspection algorithm for an automatic eggshell inspection system, acoustic impulse response with neural network method was studied. An improved error backpropagation algorithm was selected as a loaming rule of neural network, and three layer network was chosen for the neural network architecture. Acoustic signals in time domain and theirs power spectrum were studied as the input to the neural network. The classification feasibility and success rate were investigated in terms of statistical analysis and neural network approach. As a result, the success rate was 95% with the statistical model having five independent variables. Among the neural network models studied, the power spectrum of acoustic signal as the input with 64 input neurons and the two impact data showed the success rate of 95.5% which was slightly higher than of statistical analysis.

• 한국정보과학회:학술대회논문집
• /
• 한국정보과학회 2008년도 한국컴퓨터종합학술대회논문집 Vol.35 No.1 (A)
• /
• pp.116-117
• /
• 2008

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2002년도 ICCAS
• /
• pp.46.2-46
• /
• 2002

Plasma processing plays a crucial role in fabricating integrated circuits (ICs). Manufacturing ICs in a cost effective way, it is increasingly demanded a computer model that predicts plasma properties to unknown process inputs. Physical models are limited in the prediction accuracy since they are subject to many assumptions. Expensive computation time is another hindrance that prevents their widespread used in manufacturing site. To circumvent these difficulties inherent in physical models, neural networks have been used to learn nonlinear plasma data [1]. Among many types of networks, a backpropagation neural network (BPNN) is the most widely used architecture. Many training variables are...

• 한국지능정보시스템학회:학술대회논문집
• /
• 한국지능정보시스템학회 2000년도 추계정기학술대회:지능형기술과 CRM
• /
• pp.427-436
• /
• 2000

The prediction of stock price index is a very difficult problem because of the complexity of the stock market data it data. It has been studied by a number of researchers since they strong1y affect other economic and financial parameters. The movement of stock price index has a series of change points due to the strategies of institutional investors. This study presents a two-stage forecasting model of stock price index using change-point detection and artificial neural networks. The basic concept of this proposed model is to obtain Intervals divided by change points, to identify them as change-point groups, and to use them in stock price index forecasting. First, the proposed model tries to detect successive change points in stock price index. Then, the model forecasts the change-point group with the backpropagation neural network (BPN). Fina1ly, the model forecasts the output with BPN. This study then examines the predictability of the integrated neural network model for stock price index forecasting using change-point detection.

• Structural Engineering and Mechanics
• /
• 제18권4호
• /
• pp.441-459
• /
• 2004

This paper explores the potential use of neural networks (NNs) in the field of contact mechanics. A neural network model is developed for predicting, with sufficient approximation, the contact lengths between the elastic layer and two elastic circular punches. A backpropagation neural network of three layers is employed. First contact problem is solved according to the theory of elasticity with integral transformation technique, and then the results are used to train the neural network. The effectiveness of different neural network configurations is investigated. Effect of parameters such as load factor, elastic punch radii and flexibilities that influence the contact lengths is also explored. The results of the theoretical solution and the outputs generated from the neural network are compared. Results indicate that NN predicted the contact length with high accuracy. It is also demonstrated that NN is an excellent method that can reduce time consumed.