• Title/Summary/Keyword: Measure of evaluation

Search Result 3,397, Processing Time 0.027 seconds

Correlation Analysis of PESQ and MOS Evaluation for HMM-based Synthetic Korean Speech (HMM 기반의 한국어 합성음에 대한 PESQ 및 MOS 평가의 상관도 분석)

  • Lin, Cang-Song;Bae, Keun-Sung
    • Phonetics and Speech Sciences
    • /
    • v.2 no.1
    • /
    • pp.71-75
    • /
    • 2010
  • The PESQ is an objective speech quality evaluation measure that is known to have a high correlation with a subjective speech quality measure such as MOS. To examine whether it could be useful as an objective quality measure of synthetic speech, we carried out both subjective evaluation tests with MOS and DMOS and an objective evaluation test with PESQ for HMM-based Korean synthetic speech signals and analyzed the correlation between them. Experimental results have shown that the PESQ has correlations of 0.87 with MOS and 0.92 with DMOS. It means that the PESQ holds much promise for evaluating the quality of synthetic Korean speech.

  • PDF

Application of fuzzy measure and fuzzy integrals model to evaluation of human interface

  • Sohn, Young-Sun;Onisawa, Takehisa
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.787-790
    • /
    • 1997
  • This paper proposes a method which selects essential elements in a human evaluation model using the Choquet integral based on fuzzy measures, and applies the model to the evaluation of human interface. Three kinds of concepts are defined to select essential elements. Increment Degree implies the increment degree from fuzzy measures of composed elements to the fuzzy measure of a combined element. Average of Increment Degree of an element means the relative possibility of superadditivity of the fuzzy measure of each combined element. Necessity Degree means the selection degree of each combined element as a result of the human evaluation. A task experiment, which consists of a static work and two dynamic works, is performed by the use of some human interfaces. In the experiment, (1) a warning sound which gives an attention to subjects, (2) a color vision which can be distinguished easily or not, (3) the size of working area and (4) a response of confirmation that is given from an interface, are considered as human interface elements. Subjects answer the questionnaire after the experiment. From the data of the questionnaire, fuzzy measures are identified and are applied to the proposed model. Effectiveness of the proposed model is confirmed by the comparison of human interface elements extracted from the proposed model and those from the questionnaire.

  • PDF

Comparison of evaluation measures for classification models on binary data (이진자료 분류모형에 대한 평가측도의 특성 비교)

  • Kim, Byungsoo;Kwon, Soyoung
    • The Korean Journal of Applied Statistics
    • /
    • v.32 no.2
    • /
    • pp.291-300
    • /
    • 2019
  • This study investigates the characteristics of evaluation measures for classification models on a binary response variable in order to evaluate their suitability for use. Six measures are considered: Accuracy, Sensitivity, Specificity, Precision, F-measure, and the Heidke's skill score (HSS). Evaluation measures are reformulated using x(ratio of actually 1), y(ratio predicted by 1), z(ratio of both actual and predicted by 1) from the confusion matrix. We suggest two necessary conditions to assess the suitability of the evaluation measures. The first condition is that the measure function is constant for x and y in the case of a random model. The second condition is that the measure function is increasing for z and decreasing for x and y. Since only HSS satisfies the two conditions, that is always appropriate as an evaluation measure for the classification model on the binary response variable, and the other measures should be used within a limited range.

Calculation of Objective Quality-Evaluation-Index for Mosaic Imagery (모자이크 영상의 객관적 품질평가지수 산정 방법)

  • Woo, Hee-Sook;Noh, Myoung-Jong;Park, June-Ku;Cho, Woo-Sug;Kim, Byung-Guk
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.17 no.3
    • /
    • pp.33-40
    • /
    • 2009
  • This paper proposes the assessment method for objective quality-evaluation-index of mosaic images. Quality assessment was evaluated using seam-line method and similarity and contrast of adjacent images. The evaluation measure was calculated based on selected evaluation criteria and compared with human visual inspection. It was found that quantitative quality evaluation measure showed that the evaluation results were similar to human visual check. Conclusively experimental results proved that proposed evaluation measure could be used for quantitative and objective quality assessment of mosaic images.

  • PDF

Developing a Measurement Scale for User Evaluations of Internet Portal Sites (인터넷 포털 사이트에 대한 사용자 평가측정 도구의 개발)

  • 김현경;이문규;김해룡
    • The Journal of Society for e-Business Studies
    • /
    • v.6 no.3
    • /
    • pp.127-148
    • /
    • 2001
  • As the Internet service is expanding rapidly, portal sites, a gateway tn the net, are attracting increasing attention these days. As the Internet service has expanded rapidly, so has the interest for portal sites,, which serve as a gateway to the net. Despite the tendency, however, research on a measure by which to evaluate the quality of portal sites or development of such measures has not been fully pursued. As online services, faced with profitability, are considering 'charge per view', the development of a set of quality evaluation measures for portal services will prove to become a valuable instrument in constructing competitive strategies that are vital for survival and growth of a firm. In that regard, this study aims to develop a set of evaluation measures for Internet portal sites by empirically investigating the most common offline measures for quality of services, SERVQUAL, retail SERVQUAL and other evaluation measures for IT-related online services. Moreover, the study offers the strategic implications of the defined measures.

  • PDF

On Evaluation Algorithm for Hierarchical Structure of Attributes with Interaction Relationship (상호연관성을 지닌 계층구조형문제의 평가 알고리즘)

  • Lee C.Y.;Lee S.T.
    • Journal of Korean Port Research
    • /
    • v.7 no.1
    • /
    • pp.5-12
    • /
    • 1993
  • In complex decision making such as ill-defined system, one of the main problem is how to treat ambiguous aspect of the decision making. According to the complexity and ambiguity of the objective systems, many types of evaluation attributes are necessary for the rational decision and the relationship among the attributes become complex and fuzzy. Fuzzy integral is very effective to evalute the complex system with interaction between attributes but how to save the evaluation efforts in the decision making process of grading the membership of the objects or alternative is the problem to be tackled. Because the more object there are to evaluate, the number of decisions to made increase exponentially. Therefore, this paper aimes to propose a new evaluation algorithm based on fuzzy integral which can save the evaluator's efforts in decision making process. The proposed algorithm is constructed as follows : First, compose the fuzzy measure by introducing AHP(Analytical Hierachy Process) & mutual interaction coefficient. Second, generate fuzzy measure value of monotone family set for calculating the fuzzy integral. The effectiveness of the proposed algorithm is investigated through the example and sensitivity of interaction coefficient is illustrated.

  • PDF

Measure of Evaluation for Non-Normal Process Capability (비정규 공정능력 평가의 측도)

  • 김홍준;김진수;전창희
    • Journal of the Korea Safety Management & Science
    • /
    • v.2 no.2
    • /
    • pp.41-55
    • /
    • 2000
  • The main objective of this paper is to propose a measure of evaluation for non-normal process capability. If a process is not normally distributed, but normal-based techniques are used, serious errors can result. Our approach to solve this problem is that the Pearson system, the Johnson system, and the Burr system are selected for estimating a measure of process capability using the percentage nonconforming. In this paper, we found that the Pearson system and the Johnson system were a conparatively reasonable methods to calculate out of specification by example.

  • PDF

The Single Effect Evaluation System for Analyzing the Effectiveness of R&D Project (R&D프로젝트의 효과분석을 위한 단독효과평가체계)

  • Gwon Cheol Sin;Park Jun Ho;Gang Il Jung
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2003.05a
    • /
    • pp.966-971
    • /
    • 2003
  • [ $\lceil\;Cost Effectiveness Analysis\;\rfloor$ ] has been widely used to evaluate effectiveness of R&D resources. But, almost of cost effectiveness evaluation systems have some problems, especially estimating method of effect on R&D project is very rough and imprecise. To solve this problem, we have designed new single effect evaluation system, which are able to apply the distribution of order statistics and to transform relative measure into absolute measure for getting single effect.

  • PDF

Development of a Scale for Alcohol Drinking Prevention Behavior in Early Elementary School Based on Ajzen's Theory of Planned Behavior (초등학교 저학년 학생의 음주예방행위 예측변수 측정도구 개발 - Ajzen의 계획적 행위이론 기반 -)

  • Kim, Younkyoung;Lee, Chong Mi;Kang, Seo Young
    • Journal of Korean Academy of Nursing
    • /
    • v.50 no.2
    • /
    • pp.210-227
    • /
    • 2020
  • Purpose: This study aimed to develop a scale to measure variables related to alcohol drinking prevention behavior in early elementary school, based on the theory of planned behavior. Methods: A scale was developed to measure variables related to alcohol drinking prevention behavior. Initial items for direct evaluation were constructed through a literature review, and those for belief-based indirect measure were generated through interviews with 30 second- and third-grade elementary school students. The collected data from 286 third-grade elementary school students were then subjected to item analysis, exploratory and confirmative factor analysis, criterion-related validity testing, and internal consistency assessment. Results: The final scale consisted of 35 items. Intention, attitudes, subjective norms, and perceived behavioral control explained 82.7% of the variance; behavioral beliefs, normative beliefs, and control beliefs explained 65.6% of the variance; and evaluation of outcome, motivation to comply, and power of control beliefs explained 72.8% of the variance. The confirmatory factor analysis indicated that the theoretical models had a satisfactory goodness of fit. Criterion-related validity was confirmed between the direct evaluation variables and the indirect measure variables (attitudes r=.64, p<.001; subjective norms r=.39, p<.001; perceived behavioral control r=.62, p<.001). Cronbach's α was .89 for the direct evaluation variables and .93 for the indirect measure variables. Conclusion: The scale developed in this study is valid and reliable. It could be used to measure and explain variables related to alcohol drinking prevention behavior in early elementary school.

A Quality Measure for Supplier Selection (공급자선정을 위한 품질척도)

  • 변재현
    • Journal of Korean Society for Quality Management
    • /
    • v.26 no.1
    • /
    • pp.1-10
    • /
    • 1998
  • Su, pp.ier quality plays a major role in the evaluation of su, pp.iers, making it very necessary to develop a proper quality measure useful in selecting su, pp.iers that is able to meet quality specification of the customer. In this paper, we present a measure of the overall quality performance which is a weighted geometric mean of the process capability indices of the quality characteristics of a su, pp.ier. This measure can be used both as a measure of su, pp.ier selection for the customer and as a measure for the self-analysis of the quality performance for the su, pp.ier.

  • PDF