• Title/Summary/Keyword: Modified Error Function

Search Result 183, Processing Time 0.023 seconds

Improving the Water Level Prediction of Multi-Layer Perceptron with a Modified Error Function

  • Oh, Sang-Hoon
    • International Journal of Contents
    • /
    • v.13 no.4
    • /
    • pp.23-28
    • /
    • 2017
  • Of the total economic loss caused by disasters, 40% are due to floods and floods have a severe impact on human health and life. So, it is important to monitor the water level of a river and to issue a flood warning during unfavorable circumstances. In this paper, we propose a modified error function to improve a hydrological modeling using a multi-layer perceptron (MLP) neural network. When MLP's are trained to minimize the conventional mean-squared error function, the prediction performance is poor because MLP's are highly tunned to training data. Our goal is achieved by preventing overspecialization to training data, which is the main reason for performance degradation for rare or test data. Based on the modified error function, an MLP is trained to predict the water level with rainfall data at upper reaches. Through simulations to predict the water level of Nakdong River near a UNESCO World Heritage Site "Hahoe Village," we verified that the prediction performance of MLP with the modified error function is superior to that with the conventional mean-squared error function, especially maximum error of 40.85cm vs. 55.51cm.

Improved Error Backpropagation Algorithm using Modified Activation Function Derivative (수정된 Activation Function Derivative를 이용한 오류 역전파 알고리즘의 개선)

  • 권희용;황희영
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.41 no.3
    • /
    • pp.274-280
    • /
    • 1992
  • In this paper, an Improved Error Back Propagation Algorithm is introduced, which avoids Network Paralysis, one of the problems of the Error Backpropagation learning rule. For this purpose, we analyzed the reason for Network Paralysis and modified the Activation Function Derivative of the standard Error Backpropagation Algorithm which is regarded as the cause of the phenomenon. The characteristics of the modified Activation Function Derivative is analyzed. The performance of the modified Error Backpropagation Algorithm is shown to be better than that of the standard Error Back Propagation algorithm by various experiments.

  • PDF

Analysis of Optical Transfer Function and Phase Error of the Modified Triangular Interferometer

  • Kim, Soo-Gil;Ryeom, Jeong-Duk
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.21 no.1
    • /
    • pp.10-18
    • /
    • 2007
  • We synthesize and analyze the optical transfer function(OTF) of the modified triangular interferometer(MTI) using two-pupil synthesis method and we present the optimal MTI, which can obtain any bipolar function by combining a wave plate and a linear polarizer. Also, we analyze its potential phase error sources caused by polarization components.

Error propagation effects for explicit pseudodynamic algorithms

  • Chang, Shuenn-Yih
    • Structural Engineering and Mechanics
    • /
    • v.10 no.2
    • /
    • pp.157-164
    • /
    • 2000
  • This paper discusses the error propagation characteristics of the Newmark explicit method, modified Newmark explicit method and ${\alpha}$-function dissipative explicit method in pseudodynamic tests. The Newmark explicit method is non-dissipative while the ${\alpha}$-function dissipative explicit method and the modified Newmark explicit method are dissipative and can eliminate the spurious participation of high frequency responses. In addition, error propagation analysis shows that the modified Newmark explicit method and the ${\alpha}$-function dissipative explicit method possess much better error propagation properties when compared to the Newmark explicit method. The major disadvantages of the modified Newmark explicit method are the positive lower stability limit and undesired numerical dissipation. Thus, the ${\alpha}$-function dissipative explicit method might be the most appropriate explicit pseudodynamic algorithm.

Improving the Error Back-Propagation Algorithm of Multi-Layer Perceptrons with a Modified Error Function (역전파 학습의 오차함수 개선에 의한 다층퍼셉트론의 학습성능 향상)

  • 오상훈;이영직
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.6
    • /
    • pp.922-931
    • /
    • 1995
  • In this paper, we propose a modified error function to improve the EBP(Error Back-Propagation) algorithm of Multi-Layer Perceptrons. Using the modified error function, the output node of MLP generates a strong error signal in the case that the output node is far from the desired value, and generates a weak error signal in the opposite case. This accelerates the learning speed of EBP algorothm in the initial stage and prevents overspecialization for training patterns in the final stage. The effectiveness of our modification is verified through the simulation of handwritten digit recognition.

  • PDF

Modified Raised-Cosine Interpolation and Application to Image Processing (변형된 상승여현 보간법의 제안과 영상처리에의 응용)

  • 하영호;김원호;김수중
    • Journal of the Korean Institute of Telematics and Electronics
    • /
    • v.25 no.4
    • /
    • pp.453-459
    • /
    • 1988
  • A new interpolation function, named modified raised-cosine interpolation, is proposed. This function is derived from the linear combination of weighted triangular and raised-cosine functions to reduce the effect of side lobes which incur the interpolation error. Interpolation error reduces significantly for higher-order convolutional interpolation functions of linear operators, but at the expense of resolution error due to the attenuation of main lobe. However, the proposed interpolation function enables us to reduce the side lobes as well as to preserve the main lobe. To prove practicality, this function is applied in image reconstruction and enlargement.

  • PDF

ANN Synthesis Models Trained with Modified GA-LM Algorithm for ACPWs with Conductor Backing and Substrate Overlaying

  • Wang, Zhongbao;Fang, Shaojun;Fu, Shiqiang
    • ETRI Journal
    • /
    • v.34 no.5
    • /
    • pp.696-705
    • /
    • 2012
  • Accurate synthesis models based on artificial neural networks (ANNs) are proposed to directly obtain the physical dimensions of an asymmetric coplanar waveguide with conductor backing and substrate overlaying (ACPWCBSO). First, the ACPWCBSO is analyzed with the conformal mapping technique (CMT) to obtain the training data. Then, a modified genetic-algorithm-Levenberg-Marquardt (GA-LM) algorithm is adopted to train ANNs. In the algorithm, the maximal relative error (MRE) is used as the fitness function of the chromosomes to guarantee that the MRE is small, while the mean square error is used as the error function in LM training to ensure that the average relative error is small. The MRE of ANNs trained with the modified GA-LM algorithm is less than 8.1%, which is smaller than those trained with the existing GA-LM algorithm and the LM algorithm (greater than 15%). Lastly, the ANN synthesis models are validated by the CMT analysis, electromagnetic simulation, and measurements.

A Modified Error Function to Improve the Error Back-Propagation Algorithm for Multi-Layer Perceptrons

  • Oh, Sang-Hoon;Lee, Young-Jik
    • ETRI Journal
    • /
    • v.17 no.1
    • /
    • pp.11-22
    • /
    • 1995
  • This paper proposes a modified error function to improve the error back-propagation (EBP) algorithm for multi-Layer perceptrons (MLPs) which suffers from slow learning speed. It can also suppress over-specialization for training patterns that occurs in an algorithm based on a cross-entropy cost function which markedly reduces learning time. In the similar way as the cross-entropy function, our new function accelerates the learning speed of the EBP algorithm by allowing the output node of the MLP to generate a strong error signal when the output node is far from the desired value. Moreover, it prevents the overspecialization of learning for training patterns by letting the output node, whose value is close to the desired value, generate a weak error signal. In a simulation study to classify handwritten digits in the CEDAR [1] database, the proposed method attained 100% correct classification for the training patterns after only 50 sweeps of learning, while the original EBP attained only 98.8% after 500 sweeps. Also, our method shows mean-squared error of 0.627 for the test patterns, which is superior to the error 0.667 in the cross-entropy method. These results demonstrate that our new method excels others in learning speed as well as in generalization.

  • PDF

A Modified Mesh Generation Algorithm Using Pollution Error (Pollution error를 이용한 개선된 요소생성 알고리즘)

  • 유형선;장준환
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2001.10a
    • /
    • pp.34-42
    • /
    • 2001
  • In this paper, we study on a modified mesh generation method based on the pollution error estimate. This method is designed for the control of the pollution error in any patch of elements of interest. It is a well-known fact that the pollution error estimates are much more than the local one. Reliable a posteriori error estimation is possible by controlling the pollution error in the patch through proper design of the mesh outside the patch. This design is possible by equally distributing the pollution error indicators over the mesh outside the patch. The conventional feedback pollution-adaptive mesh generation algorithm needs many iterations. Therefore, the solution time is significant. But we use the remeshing scheme in the proposed method. We will also show that the pollution error reduces less than the local error.

  • PDF

Convergence Analysis of the Modified Adaptive Sign (MAS) Algorithm Using a Mixed Norm Error Criterion

  • Lee, Young-Hwan
    • The Journal of the Acoustical Society of Korea
    • /
    • v.16 no.3E
    • /
    • pp.62-68
    • /
    • 1997
  • In this paper, a modified adaptive sign (MAS) algorithm based on a mixed norm error criterion is proposed. The mixed norm error criterion of be minimized is constructed as a combined convex function of the mean-absolute error and the mean-absolute error to the third power. A convergence analysis of the MAS algorithm is also presented. Under a set of mild assumptions, a set of nonlinear evolution equations that characterizes the statistical mean and mean-squared behavior of the algorithm is derived. Computed simulations are carried out to verify the validity of our derivations.

  • PDF