• Journal of the Korea Society of Computer and Information
• /
• v.20 no.12
• /
• pp.169-174
• /
• 2015

Permutation p-values are provided for the agreement measures for multivariate interval data among many raters. Three agreement measures, Berry and Mielke's measure, Janson and Olsson's measure, and Um's measure are described and compared. Exact and resampling permutation methods are utilized to compute p-values and empirical quantile limits for three measures. Comparisons of p-values demonstrate that resampling permutation methods provide close approximations to exact p-values, and Berry and Mielke's measure and Um's measure show similar performance in terms of measuring agreement.

• Journal of the Korean Data and Information Science Society
• /
• v.15 no.1
• /
• pp.263-271
• /
• 2004

This article presents a new measure of chance-corrected interobserver agreement among multivariate ratings of many observers. Modifying an approach by Berry and Mielke, a new agreement measure is proposed. The important modificaton is to use the volume of simplex composed of data points as the disagreement masure. The proposed measure accounts agreement for multivariate interval observations among many observers. Hypothetical and real-life data sets are analyzed for illustrative purpose.

• Journal of the Korean Data and Information Science Society
• /
• v.16 no.3
• /
• pp.621-628
• /
• 2005

This article addresses the problem of measuring a joint agreement between multiple raters and a standard set of responses. A new agreement measure based on Um's approach is proposed. The proposed agreement measure is used for multivariate interval responses. Comparison is made between the proposed measure and other corresponding agreement measures using hypothetical data set.

• The Korean Journal of Applied Statistics
• /
• v.20 no.1
• /
• pp.117-132
• /
• 2007

In a $2\times2$ table showing binary agreement between two raters, it is known that Cohen's $\kappa$, a chance-corrected measure of agreement, has two paradoxes. $\kappa$ is substantially sensitive to raters' classification probabilities(marginal probabilities) and does not satisfy conditions as a chance-corrected measure of agreement. However, $\kappa$ and other established measures have a reasonable and similar value when each marginal distribution is close to 0.5. The objectives of this paper are to present a new measure of agreement, H, which resolves paradoxes of $\kappa$ by adjusting unbalanced marginal distributions and to compare the proposed measure with established measures through some examples.

• Journal of the Korean Data and Information Science Society
• /
• v.15 no.4
• /
• pp.957-963
• /
• 2004

A new agreement measure for multivariate interval data by different sets of raters is proposed. The proposed approach builds on Um's multivariate extension of Cohen's kappa. The proposed measure is compared with corresponding earlier measures based on Berry and Mielke's approach and Janson and Olsson approach, respectively. Application of the proposed measure is exemplified using hypothetical data set.

• Journal of the Korean Data and Information Science Society
• /
• v.17 no.2
• /
• pp.529-536
• /
• 2006

Investigators use either Euclidean distance or volume of a simplex defined composed of data points as agreement index to measure chance-corrected agreement among observers for multivariate interval data. The agreement coefficient proposed by Um(2004) is based on a volume of a simplex and does not depend on the variables' measuring units. We consider a comparison of Um(2004)'s agreement coefficient with others based on two unit-free distance measures, Pearson distance and Mahalanobis distance. Comparison among them is made using hypothetical data set.

• Communications for Statistical Applications and Methods
• /
• v.10 no.2
• /
• pp.341-352
• /
• 2003

Collecting data through experiment, the observers are an import source of measurement error and the inference on the measure of agreement, say kappa, is necessary. The models commonly used are complicated general mixture model, which have many nuisance parameters. Orthogonalization of parameters reduce the effect of nuisance parameter. Orthogonalization of estimating function gives the same effect as the parameter orthogonalization. In this study, the method for orthogonalization of estimating equation is studied and applied to the Beta-binomial model to examine the properties of the estimate of kappa. As a result, the likelihood function is insensitive to the change of the nuisance parameter and bias is smaller than the result of m.1.e. when kappa has extreme values

• Communications for Statistical Applications and Methods
• /
• v.16 no.5
• /
• pp.753-762
• /
• 2009

A measure of agreement H in$2{\times}2$ contingency table was proposed by Park and Park (2007) to resolve the two paradoxes of k. In this study, we generalize H to where the number of categories is greater than two and derive its asymptotic large-sample variance. We also explain the relationships between k's paradoxes and marginal distributions. Using some examples of $3{\times}3$ contingency tables, the behaviors of H and other measures of agreement are compared.

• The Korean Journal of Applied Statistics
• /
• v.25 no.5
• /
• pp.719-731
• /
• 2012

Agreement analysis is conducted to assess reliability among rating results performed repeatedly on the same subjects by one or more raters. The kappa statistic is commonly used when rating scales are categorical. The simple and weighted kappa statistics are used to measure the degree of agreement between two raters, and the generalized kappa statistics to measure the degree of agreement among more than two raters. In this paper, we compare the performance of four different generalized kappa statistics proposed by Fleiss (1971), Conger (1980), Randolph (2005), and Gwet (2008a). We also examine how sensitive each of four generalized kappa statistics can be to the marginal probability distribution as to whether marginal balancedness and/or homogeneity hold or not. The performance of the four methods is compared in terms of the relative bias and coverage rate through simulation studies in various scenarios with different numbers of raters, subjects, and categories. A real data example is also presented to illustrate the four methods.

• Journal of Fisheries and Marine Sciences Education
• /
• v.9 no.2
• /
• pp.99-120
• /
• 1997

The official talks on the amendment of the Korean - Japanese Fisheries Agreement which was concluded in 1965 are under way since 1996. The convention area of the existing fisheries agreement is the high sea, but it should be changed to the exclusive economic zone(EEZ) for the newly amended fisheries agreement. Accordingly, the fundamental policies to be embodied within the amended fisheries agreement are summarized as follows : 1. One of the basic doctrine of the new agreement should be the formulation of a device of international cooperation for the fishery development as well as the conservation and management of the fishery resources. 2. The preparation of the future-oriented international relationship which reflects the specific character of the fishery relationship between both countries. 3. The existing fishery results of both parties should be protected on the ground of the reciprocity principle. 4. Both parties should reach an agreement upon the joint conservation and management measures for the transboundary fishery resources. 5. In consideration of the difficulty of EEZ delimitation between both countries, a provisional fisheries agreement can be an alternative measure.