• Title/Summary/Keyword: Rater

Search Result 351, Processing Time 0.029 seconds

Study of Validity and Interrater Reliability of Korean Version of the Peabody Developmental Motor Scale 2 (한글판 Peabody Developmental Motor Scale 2의 타당도와 검사자간 신뢰도 연구)

  • Lee, Ji-Ho;Kim, Kyeong-Mi;Chang, Moon-Young;Hong, Eunkyoung
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.17 no.3
    • /
    • pp.14-25
    • /
    • 2019
  • Objective : This study aims to verify the content validity and inter-rater reliability of the Korean version of the Peabody Developmental Motor Scale 2 (PDMS-2) and to identify the concurrent validity by comparing it with the Korean version of the Bruininks-Oseretsky Test of Motor Proficiency-2 (BOT-2). Methods : PDMS-2 was translated by the researcher and an eighth-year clinical occupational therapist. The content consistency of the Korean version of the PDMS-2 was verified by three professors with experience using it. After the verification of the content consistency of the PDMS-2 by the five clinical occupational therapists and the additional revision, the Korean version of the PDMS-2 was completed. The researcher and another occupational therapist evaluated the Korean version of PDMS-2 in 50 children and measured the inter-rater reliability. Concurrent validity was measured by comparing the results of the Korean version of PDMS-2 and Korean version of BOT-2. Results : The content consistency test showed overall agreement of mean 3.45, and the content understanding test showed a high level of understanding of mean 3.69. The inter-rater reliability and concurrent validity of the Korean version of the PDMS-2 showed a statistically significant correlation. Conclusion : The Korean version of the PDMS-2 showed high content understanding, reliability, and validity. It can assist clinicians and researchers who work in fields related to child treatment or development.

Analysis on the effects that affect the organizational achievement by each factor of the multi-rater feedback system of public enterprises (공기업 다면평가제도의 각 요인별 조직성과에 미치는 영향 분석)

  • Kang, Jae-An;Cho, Sung-sook
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.10 no.9
    • /
    • pp.2424-2434
    • /
    • 2009
  • This study, centering on public enterprises, has been conducted from 4 different perspectives such as grasping the effects that the factor precedent of the multi-rater feedback affects on the usefulness of evaluation and the effects that the usefulness of evaluation affects on the organizational achievement, checking on whether there is any discrepancy among the effects affecting on the usefulness of evaluation in accordance with the degree of advance training on the evaluation system, and being what kind of effects the usefulness of valuation that the appraised eventually understand affects on the organizational achievement. As result of the study, the factor precedent that are confidence of the appraisers and the support from CEO reasonably affected on the usefulness of evaluation, but the standard referred to evaluation was not reasonable. It became resultantly clear that the confidence of the appraisers held the effect of control from the verification of whether there is the effect of control between the factor precedent and the usefulness of evaluation in accordance with the degree of advance training. However, it turned out that the standard referred to evaluation and the support from CEO held no effect of control. As result, It was possible to confirm that the usefulness of evaluation in this study affects directly or indirectly to the organizational achievement such as organizational immersion, job satisfaction, self development opportunity, and organizational revitalization as influenced by the prior factors, and the advance training was partially effective on the adjusting effect.

A Study on the Project Manager's Reaction to R&D Evaluation and Its Influencing Factors (연구과제 평가에 대한 과제책임자의 반응과 그 영향요인에 관한 연구)

  • 김인철;한도희
    • Journal of Korea Technology Innovation Society
    • /
    • v.3 no.2
    • /
    • pp.48-60
    • /
    • 2000
  • An effort has been made in this paper to measure the project manager's reaction to R&D project evaluation and present the useful information related to rebuilding an R&D evaluation system. Results of this study show that project manager's reaction is related to the selection of reasonable items for evaluation, the rater's expertise, the project manager's participation in evaluation process and so on. Accordingly, managers of the research institute have to set up the evaluation system after deeply considering these results.

  • PDF

Permutation P-values for Inter-rater Agreement Measures

  • Um, Yonghwan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.12
    • /
    • pp.169-174
    • /
    • 2015
  • Permutation p-values are provided for the agreement measures for multivariate interval data among many raters. Three agreement measures, Berry and Mielke's measure, Janson and Olsson's measure, and Um's measure are described and compared. Exact and resampling permutation methods are utilized to compute p-values and empirical quantile limits for three measures. Comparisons of p-values demonstrate that resampling permutation methods provide close approximations to exact p-values, and Berry and Mielke's measure and Um's measure show similar performance in terms of measuring agreement.

A Robust Heteroscadastic Test for ARCH Models

  • Kim, Sahm-Yeong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.15 no.2
    • /
    • pp.441-447
    • /
    • 2004
  • Li and Mak (1994) developed a test statistic for detecting the non-linearity and the heteroscedasticity of the time series data. But it is well known that the test statistic may be very sensitive in case of heavy-tailed distributions of the errors. Jiang et al.(2001) suggested the robust method for ARCH models but the calculation procedures for the estimation are very complicated. We suggested the robust method based on Huber's function and our method works quite well rater than the Li and Mak(1994). Also our method is relatively easy to calculate the test statistic.

  • PDF

Inter-rater reliability on the Functional Reach Test (기능적 뻗기 검사의 측정자 간 신뢰도)

  • Choi, Wonji;No, Hyolyun
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2019.05a
    • /
    • pp.381-382
    • /
    • 2019
  • 본 연구는 기능적 뻗기 검사의 측정자 간 신뢰도를 알아보기 위하여 실시하였다. 본 연구에 참가한 대상자는 총 46명(남 20명, 여 26명)이었고 기능적 뻗기 검사는 두 곳의 실험실에서 이루어졌고 측정자는 총 6명이었다. 같은 장소의 실험실에서 이루어진 검사의 측정자간 신뢰도는 높게 나타났으나 장소가 다른 곳에서 이루어진 검사의 측정자 간 신뢰도는 아주 낮게 나타났다. 따라서 기능적 뻗기 검사의 신뢰도를 확보하기 위하여서는 측정자들의 명확한 기준의 정리가 필요할 것으로 보인다.

  • PDF

Development of a Premature Infant Pain Scale (PIPS) (미숙아 통증지표(Premature Infant Pain Scale) 개발)

  • Kim, Mi-Soon;Kim, Mi-Jin;Ham, Eun-Ha;Kim, Kyoung-Mi
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.13 no.3
    • /
    • pp.510-519
    • /
    • 2006
  • Purpose: To develop and validate a scale suitable and efficient scale for use in clinical practice as to assess pain in premature infants. Method: Pain indicators identified by observation of preform infants. A cohort of preform infants was studied prospectively to determine the construct validity, inter-rater reliability, and internal consistency of the scale. The PIPS uses four indicators of pain: corrected gestational age, heart rate, oxygen saturation, behavioral state. The validation study included 45 premature infants with gestational age of 37 weeks or less. Results: The inter-rater reliability of the PIPS was acceptable, with Pearson correlations ranging from.720 to.970. Internal consistency was high: Cronbach's alpha coefficients ranged from.551 to.653. There was a strong correlation between the PIPS and PIPP scores (each researcher's r=.743, each indicator's r=.914). Although gestational age showed no association between these factors and the sum, the other variables were positively associated with the sum. Time needed to calculate PIPS scores is was less than Premature Infant Pain Profile (PIPP) scores(p<.000). Conclusion: The validation data suggest that the PIPS is appropriate and efficient for assessing pain in premature infants. Further studies are required about to determine appropriate interventions for each pain score on the PIPS.

  • PDF

A Method to Evaluate Rate of 'Soft-Hard' In a Drawing (그림의 '부드러운-딱딱한' 정도의 평가 방법)

  • Yoon, Seok-Hoon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.10 no.12
    • /
    • pp.3963-3970
    • /
    • 2009
  • This study proposes a method to evaluate the level of 'soft-hard' of color quantitatively by evaluating the shape with edge sharpness automatically and by evaluating color in the color image scale in a drawing in art therapy using a computer. The dependent variable is the rank for the color experts to rate the level of 'soft-hard'. The mean and standard deviation of Value(V), and Chroma(C), colors, main color, clusters, length of edge, and sharp line rate of edge are considered as the independent variable. The appropriate independent variables to explain the dependent variable are selected through the step wise regression analysis. The inter-rater reliability of two raters is checked and the validity of developed system is verified by the rank correlations coefficient between the ranks of rater's and system's. This system can be used to evaluate of the shape or color in a drawing objectively and quantitatively for art therapy assessment, and to give the useful information to the fashion, textile, interior industry as well as color psychology and art therapy.

The Reliability and Validity of Korean Pediatric Functional Muscle Testing in Children with Motor Disorder

  • Seo, Hye-Jung;Kim, Joong-Hwi
    • The Journal of Korean Physical Therapy
    • /
    • v.28 no.4
    • /
    • pp.232-242
    • /
    • 2016
  • Purpose: This study was conducted to develop a Korean version of the pediatric functional muscle test (K-PFMT) for children with motor developmental disorders, and to verify its reliability and validity. Methods: The subjects were 40 children, aged below 5 years. Each was scored on the K-PFMT by 14 physical therapists to determine inter-rater reliability and internal consistency. Additionally, 3 of the 14 therapists tested 20 children again one or two weeks later to determine test-retest reliability. The internal consistency was calculated by Cronbach's alpha. The inter-rater and test-retest reliability were calculated using the intraclass correlation coefficient (ICC). One-way ANOVA and the paired t-test were used to compare differences among the three evaluator groups and between the test and retest group. Concurrent validity was evaluated by Pearson's correlation with a total score of GMFM. Results: Chronbach's alpha was over 0.98 for each test item and 0.99 for the total items. There was no significant differences in the score of K-PFMT among the three evaluator groups except for a few items. The test-retest ICC was from 0.89 to 1.00 and from 0.82 to 1.00, respectively. There was no significant difference between the test and retest group, except for a few items. There were high significant correlations between K-PFMT and GMFM. Conclusion: This study showed that a K-PFMT with relatively high reliability and validity was successfully developed. The K-PFMT will be a useful tool for measurement of muscle strength of children with motor developmental disorder.

Reliability and Concurrent Validity of Korean Version of the Trunk Control Measurement Scale (K-TCMS) for Children with Cerebral Palsy

  • Ko, Jooyeon;Jung, Jeewoon
    • The Journal of Korean Physical Therapy
    • /
    • v.29 no.1
    • /
    • pp.16-26
    • /
    • 2017
  • Purpose: This study was conducted to develop a Korean version of the trunk control measurement scale (TCMS) and examine the reliability and concurrent validity of the K-TCMS in children with cerebral palsy. Methods: Subjects for the study were 23 children with cerebral palsy (CP)(mean age: 84.70 months) recruited from one CP clinic. For the interrater and test-retest reliabilities, four raters (A, B, C, D) measured the K-TCMS two times using video clips with an interval of two weeks. For the concurrent validity, the Korean version of the gross motor function measure (K-GMFM) was chosen. Inter-rater reliability and test-retest reliability of the three K-TCMS subscale (static sitting balance, dynamic sitting balance and dynamic reaching) scores and the total scores were investigated using the intra-correlation coefficient ($ICC_{3,1}$). Spearman's correlation coefficient (r) was calculated to investigate the concurrent validity. Results: The inter-rater reliability of the K-TCMS subscales and total scores were all high ($ICC_{3,1}=0.968-0.992$). For the test-retest reliability, $ICC_{3,1}=0.827-0.962$. The concurrent validity between the K-TCMS's total and three subscale scores and K-GMFM's total score were r=0.600-0.667. Conclusion: The results suggest that the K-TCMS can be used in clinical and research settings as a standardized tool for CP children. The K-TCMS might be also useful for selecting treatment goals and planning interventions for children with cerebral palsy.