• Title/Summary/Keyword: evaluation error

Search Result 2,498, Processing Time 0.026 seconds

Estimation Method of Predicted Time Series Data Based on Absolute Maximum Value (최대 절대값 기반 시계열 데이터 예측 모델 평가 기법)

  • Shin, Ki-Hoon;Kim, Chul;Nam, Sang-Hun;Park, Sung-Jae;Yoo, Sung-Soo
    • Journal of Energy Engineering
    • /
    • v.27 no.4
    • /
    • pp.103-110
    • /
    • 2018
  • In this paper, we introduce evaluation method of time series prediction model with new approach of Mean Absolute Percentage Error(hereafter MAPE) and Symmetric Mean Absolute Percentage Error(hereafter sMAPE). There are some problems using MAPE and sMAPE. First MAPE can't evaluate Zero observation of dataset. Moreover, when the observed value is very close to zero it evaluate heavier than other methods. Finally it evaluate different measure even same error between observations and predicted values. And sMAPE does different evaluations are made depending on whether the same error value is over-predicted or under-predicted. And it has different measurement according to the each sign, even if error is the same distance. These problems were solved by Maximum Mean Absolute Percentage Error(hereafter mMAPE). we used the absolute maximum of observed value as denominator instead of the observed value in MAPE, when the value is less than 1, removed denominator then solved the problem that the zero value is not defined. and were able to prevent heavier measurement problem. Also, if the absolute maximum of observed value is greater than 1, the evaluation values of mMAPE were compared with those of the other evaluations. With Beijing PM2.5 temperature data and our simulation data, we compared the evaluation values of mMAPE with other evaluations. And we proved that mMAPE can solve the problems that we mentioned.

Performance Evaluation of HNCP Home Network Using Stochastic Activity Network Models (Stochastic Activity Network 모델을 이용한 HNCP 홈 네트워트 성능 평가)

  • 이재민;명관주;이감록;전요셉;권욱현
    • Proceedings of the IEEK Conference
    • /
    • 2003.11c
    • /
    • pp.183-186
    • /
    • 2003
  • In this paper, performance evaluation of HNCP home network is using stochastic activity network models is proposed. HNCP is a home network protocol for controling and monitoring home appliances using power line communication. a CSMA/CA with packet drop method is used in HNCP MAC layer. Using the proposed stochastic activity network models. performances of HNCP home networks with error-free environment and error environment are evaluated.

  • PDF

Design and Performance Evaluation of Self-Localization with Landmarks

  • Masaki, Sano;Yoon, Ji-Sup
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.155.1-155
    • /
    • 2001
  • The main contribution of this research is that it gives:(1) a rational criterion to select the best self-localizing method for a particular situation, and (2) an appropriate arrangement of the landmarks to minimize the error. In this paper, the authors propose a set of indices to evaluate the accuracy of the self-localizing methods, and the indices are derived from a sensitivity which is defined as the ratio of the localizing error to sensor error. And then, we compare the accuracy of self-localizing a mobile robot with landmarks based on the indices, and propose a rational way to minimize the localizing error.

  • PDF

Evaluation for Ratio Error of Voltage Transformer Comparator using Standard Resistors (표준저항기를 이용한 전압변성기 비교기의 비오차 평가)

  • Han, Sang-Gil;Kim, Yoon-Hyoung;Jung, Jae-Kap;Han, Sang-Ok
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.57 no.4
    • /
    • pp.412-416
    • /
    • 2008
  • We have developed the calibration technique of the VT comparator using nonreactive standard resistors, which evaluates both accuracy and linearity of the VT comparator by comparing experimental values with theoretical values. The correction values of VT comparator obtained by using both our method and wide ratio error VT are consistent within the expanded uncertainty. Furthermore the specification for ratio error of VT comparator have been revaluated.

A Study on Reliability Evaluation of Application Software using Binomial-Type Model (이항형 모형을 이용한 응용 소프트웨어 의 신뢰성 평가에 관한 연구)

  • 조성건;이상철
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.15 no.25
    • /
    • pp.53-62
    • /
    • 1992
  • Computer software users develop and utilize their application software by themselves since Processing methods are different by quantity and qualify of the information The developed model needs input data and error numbers generated during the testing phases. However. total error numbers of the existing model and each error time was needed as data for developing the new model. But, maximum likelihood estimation must be used to exponential model of binomial-type and estimating of parameters by using the searched data. Parameter estimation can be done with trial and error or simulation.

  • PDF

Configuration of PID tuning simulator for evaluation of marine engineer's ability (기관사의 해기능력 평가용 PID 제어 튜닝 시뮬레이터의 구성)

  • Choi, Soon-Man
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.33 no.8
    • /
    • pp.1268-1274
    • /
    • 2009
  • Various evaluation systems using simulators have been adopted widely for the purpose of training and examination, including marine engineering education area. This paper suggests a PC based evaluation scoring system for simulators where the operation ability of machineries and background knowledges of trainees or examinees are able to be assessed relatively. The scores are based on the 100 point resulted from their responses for a given evaluation scenario under a PID tuning simulation. The mistakes they make during the operation time are integrated firstly to get error sum, and the error sum is transformed secondly to 100 point score according to a formula where the knowledge level of examinee's groups can be compensated and considered reasonably. The implementation result of evaluation system for the given control loop is described and analyzed to show the effectiveness of the suggested configuration as an evaluation tool.

A Grading Method for Student′s Achievements Based on the Clustering Technique (클러스터링에 기반한 학업성적의 등급화 방법)

  • Park, Eun-Jin;Chung, Hong;Jang, Duk-Sung
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.12 no.2
    • /
    • pp.151-156
    • /
    • 2002
  • There are two methods in evaluation student s achievement. The two evaluation methods are absolute evaluation and relative evaluation. They have much advantages respectively, but also have some limitations such as being too stereotyped or causing overcompetition among learners. This paper suggests a new evaluation method which evaluates student s achievements by considering the score distribution and the frequency The proposed method classifies the scores into several clusters considering the goodness. This approach calculates the goodness by applying the RE(relaxation error), and grades the achievement scores based on the goodness. The suggested method can avoid the problem of grading caused by the narrow gap of scores because it sets a standard for grading by the calculated goodness considering the score distribution and frequency of occurrence. The method can differentiate achievements of a school from those of others, and that it is useful for selecting advanced students and dull ones, and for evaluation of classes based on student s achievement.

A General Method for Error Probability Computation of UWB Systems for Indoor Multiuser Communications

  • Durisi, Giuseppe;Tarable, Alberto;Romme, Jac;Benedetto, Sergio
    • Journal of Communications and Networks
    • /
    • v.5 no.4
    • /
    • pp.354-364
    • /
    • 2003
  • A general method for the evaluation of the symbol error probability (SER) of ultra wideband (UWB) systems with various kind of modulation schemes (N-PAM, M-PPM, Bi-Orthogonal), in presence of multipath channel, multiuser and strong narrowband interference, is presented. This method is shown to be able to include all the principal multiaccess techniques proposed so far for UWB, time hopping (TH), direct sequence (DS) and optical orthogonal codes (OOC). A comparison between the performance of these multiple access and modulation techniques is given, for both ideal Rake receiver and minimum mean square error (MMSE) equalizer. It is shown that for all the analyzed multiple access schemes, a Rake receiver exhibits a high error floor in presence of narrowband interference (NBI) and that the value of the error floor is in-fluenced by the spectral characteristics of the spreading code. As expected, an MMSE receiver offers better performance, representing a promising candidate for UWB systems. When the multiuser interference is dominant, all multiple access techniques exhibit similar performance under high-load conditions. If the number of users is significantly lower than the spreading factor, then DS outperforms both TH and OOC. Finally 2PPM is shown to offer better performance than the other modulation schemes in presence of multiuser interference; increasing the spreading factor is proposed as a more effective strategy for SER reduction than the use of time diversity.

Comparison of Regression Models for Estimating Ventilation Rate of Mechanically Ventilated Swine Farm (강제환기식 돈사의 환기량 추정을 위한 회귀모델의 비교)

  • Jo, Gwanggon;Ha, Taehwan;Yoon, Sanghoo;Jang, Yuna;Jung, Minwoong
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.62 no.1
    • /
    • pp.61-70
    • /
    • 2020
  • To estimate the ventilation volume of mechanically ventilated swine farms, various regression models were applied, and errors were compared to select the regression model that can best simulate actual data. Linear regression, linear spline, polynomial regression (degrees 2 and 3), logistic curve, generalized additive model (GAM), and gompertz curve were compared. Overfitting models were excluded even when the error rate was small. The evaluation criteria were root mean square error (RMSE) and mean absolute percentage error (MAPE). The evaluation results indicated that degree 3 exhibited the lowest error rate; however, an overestimation contradiction was observed in a certain section. The logistic curve was the most stable and superior to all the models. In the estimation of ventilation volume by all of the models, the estimated ventilation volume of the logistic curve was the smallest except for the model with a large error rate and the overestimated model.

An Evaluation of the Uncertainty of Pressure Measurement Systems (압력 측정 시스템의 불확도 평가)

  • 최주호;홍성수
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.5 no.1
    • /
    • pp.15-23
    • /
    • 2002
  • Uncertainty components and evaluation of the system of pressure measurement are presented in this paper. Since early in 1980s, measurement uncertainty is getting more important due to ISO/IEC 17025, which is established for international test and calibration laboratories. Up to now it is true that accuracy, precision, error and etc. have been commonly used in industry to define the amount of error to the products and equipment, but these terms ought to be united into uncertainity in the future. This paper describes how to indicate measurement uncertainty and types of measurement errors, and then shows the evaluation result of measurement system using piezoelectric pressure transducers.