• 대한통합의학회지
• /
• 제9권1호
• /
• pp.193-202
• /
• 2021

Purpose : The purpose of this study is to examine inter-and intra-rater reliabilities of myotonometric measurements of tone, elasticity and stiffness for the erector spinae muscles of the young and the elderly populations. Methods : A total of 102 (69 young adults from K university and 33 older adults from the D community center in Daejeon) were enrolled in this study. The two different raters measured each side of the erector spinae muscles at prone position. After each rater performed first measurement for a subject, 30 minutes of rest was given. The same rater then repeated the second myometric measurement on the subject. The collected data on the tone, elasticity, and stiffness of the erector spinae were analyzed using intraclass correlation coefficient (ICC) to determine inter- and intra- rater reliabilities. Results : The inter-and intra-rater reliabilities of the myotonometric measurement of the erector spinae for the total subjects were excellent (ICC > 0.9, p < 0.001). Within each of the elderly group and the young group, inter- and intra-rater reliabilities were also excellent (ICC > 0.8~0.9 / p < 0.001, ICC > 0.75~0.9 / p < 0.001, each). Conclusion : The measurement of muscle tone, elasticity, and stiffness for the erector spinae muscles using the myotonometer had excellent reliability. It was confirmed that a highly reliable myometric measurement on the erector spinae can be obtained regardless of whether it is from young or elderly people. This suggests that the myotonometer can be a useful tool to measure muscular properties of the erector spinae of the young and old as an evaluative instrument.

• 대한한방내과학회지
• /
• 제34권3호
• /
• pp.231-239
• /
• 2013

Objectives : This study was performed to evaluate inter-rater and intra-rater reliability of interpretation and reproducibility of a pulse analyser (MAXMAC27-Plus). Methods : 38 of 40 volunteers completed the pulse analysis consecutively. Three Korean medical doctors who had at least 2 years of clinical experience interpreted the pulse waves for 3 aspects of size, depth and shape, then inter-rater reliability and crude agreement was obtained. Reinterpretation was done 2 weeks later and intra-rater reliability and crude agreement was obtained. Intra-rater reliability and crude agreement between 1st and 2nd measurement was calculated. Cohen's weighted kappa for size, Cohen's kappa for depth and shape were used as statistical analysis. Results : Inter-rater reliability of size, depth and shape among 3 raters was 0.598, 0.604, and 0.312, respectively, showing moderate to substantial agreement. Average intra-rater reliability between 1st and 2nd interpretation of size, depth and shape was 0.806, 0.705, and 0.638, respectively, showing substantial to almost perfect agreement. However, intra-rater reliability between consecutive measurements of size, depth and shape was 0.221, 0.121, and 0.194, respectively, which showed only poor to fair agreement. Conclusions : Intra-rater and inter-rater reliability of one pulse wave showed relatively high concordance. Training by a clinical expert may effect better concordance among raters. Test-retest reliability showed poor agreement. Improvement of measurement technique and device performance will be needed.

• 한국융합학회논문지
• /
• 제11권11호
• /
• pp.443-450
• /
• 2020

본 연구는 구강점막욕창의 시각적 감별도구에 대한 신뢰성을 평가하기 위한 연구이다. 연구의 절차는 개발단계와 평가단계로, 개발단계에서는 자료수집, 자문단의 타당도와 신뢰도 평가, 최종도구개발이 수행되었으며, 평가단계에서 대상자들에게 9장의 사진도구를 평가하게 하였다. 세 군에서 측정자 간 신뢰도를 구한 결과, 상처 전문간호사군에서는 Krippendorff's alpha 가 .75이었고, 중환자 전문간호사군에서는 .70이었다. 치과의사군에서의 Cohen's weighted kappa값은 .78 로 나타났다. 측정자 내 신뢰도를 살펴본 결과, 중환자실 일반간호사군들의 intra-rater reliability는 .73으로 나타났다. 신뢰도가 입증된 9장의 사진은 실제 중환자실과 같은 구강점막욕창 위험을 가진 환자를 돌보는 임상환경에서 교육용으로 활용될 수 있을 것으로 보인다.

• The Journal of Korean Physical Therapy
• /
• 제30권1호
• /
• pp.29-34
• /
• 2018

Purpose: This study aimed to systematically analyze the reliability and validity of Korean versions of mobility and gait assessment tools for patients with stroke. Methods: Two reviewers conducted an independent literature search and systematically reviewed the literature. Literature published until June of 2017 was searched using search engines for electronic databases. The 2 reviewers reviewed the title and abstract of each article. Among the articles examined, we read the full text of those judged to be suitable for our study. We classified the selected data into research methods and results. The determination was made through mutual agreement. Results: The reviewers selected 5 articles related to the purpose of this study. The DGI was found to be moderately associated with BBS, 10MWT, and TUG in intra-rater reliability (ICC=0.92), inter-rater reliability (ICC=0.88), and concurrent validity tests. The FGA demonstrated a high level of reliability with intra-rater (ICC=0.92-0.95) and inter-rater reliability (ICC=0.91, 0.95). The intra-rater reliability of the RMI was high at ICC=0.98. Its concurrent validity showed a high association with STREAM and BI. The intra-rater reliability of the MAS was ICC=0.75-0.99. Its inter-rater reliability was very high, exceeding 0.99. The inter-rater reliability of the Tinetti-gait Scale was ICC=0.91, and its concurrent validity was moderately associated with the DGI, 10WMT, OLST, FM-L/E, and STS. Conclusion: The results of this study revealed that the reliability and validity of the Korean versions of the mobility and gait assessment tools were high.

• 대한물리의학회지
• /
• 제16권2호
• /
• pp.45-52
• /
• 2021

PURPOSE: This study examined the imaging procedure of pectoralis minor muscle thickness and assessed the intra- and inter-rater reliability of the muscle thickness measured by two raters using rehabilitative ultrasound imaging (RUSI) in healthy individuals. METHODS: Fifteen participants (aged 21 - 28, seven females, and eight males) were involved in the study. The primary rater palpated the coracoid process and the fourth rib, defined as the width of the index finger lateral to the sternum to avoid breast tissues, and lined the two landmarks. The second examiner checked 1 / 3 (1st point) and 1 / 2 (2nd point) of the line length as measurement points. The two raters obtained right side muscle images of the participants at a standardized sitting position using RUSI with a 7.5 MHz linear transducer at 40mm depth. For intra-rater reliability, the principal rater took three images per point and tried to take one more with an interval. For the inter-rater reliability, the other rater performed the same tasks as the principal rater on the same day. The reliability was analyzed using the intra-class correlation coefficient (ICC), the standard error of the measurement (SEM), and Bland and Altman plots. RESULTS: The reliability at all points was excellent for the same rater (ICC_3,1 = .973 - .978, SEM = .042 - .046), and between raters (ICC_2,1 = .939 - .959, SEM = .059 - .097). CONCLUSION: These findings show that the RUSI could be reliable for examining the pectoralis minor muscle thickness in healthy individuals at all measurement sites.

• 대한음성학회지:말소리
• /
• 제65호
• /
• pp.1-11
• /
• 2008

This study explored the perception of transplanted Korean prosody by NE (Native speakers of English) and NK (Native speakers of Korean) listeners. The Korean utterances of various sentence types produced by NE and NK were employed to transplant the original Korean prosody contours to the Korean utterances read by NE. Then, other NE and NK were instructed to rate the transplanted prosodic components. Results showed that the interactions between the two rater groups with the three factors (e.g., transplantation types & rater groups, sentence types & rater groups, sentence length & rater groups) turned out to be meaningful. Both rater groups preferred the combined effect of transplanted prosodic components (e.g. DP, DPI) to that of individual transplantation (e.g. I, D, P). Compared to NK, NE were more sensitive to duration change than pitch change whereas NK showed equal preference to the both. In sentence types such as De, Ex, Im, and Ta, NE perceived higher similarity than NK.

• 동서간호학연구지
• /
• 제26권1호
• /
• pp.91-99
• /
• 2020

Purpose: The study aims to assess the inter-rater reliability of the Korean Triage and Acuity Scale between the research nurses and the triage nurses. Methods: Interrater reliability was measured on 400 adult (≧15) and 400 pediatric (<15) patients who visited the emergency medical center from January 4 to June 30, 2018. Results: The study result showed that the inter-rater reliability of the Korean Triage and Acuity Scale was substantial, with κ=.73 (95% Confidence interval= .68-.78) and 77.0 percent agreement. The inter-rater of Pediatric Korean Triage and Acuity Scale was also substantial, with κ=.76 (95% Confidence interval= .71-.82) and 83.8 percent agreement. Conclusion: Although the inter-rater reliability of the Korean Triage and Acuity Scale was acceptable, the percent agreement was lower than the desirable level (<80.0%). It was confirmed that Pediatric Korean Triage and Acuity Scale had an acceptable level of inter-rater reliability and percent agreement for clinical use. Efforts should be made to improve the reliability in the future.

• 한국전문물리치료학회지
• /
• 제20권3호
• /
• pp.74-80
• /
• 2013

The purpose of this study was to determine the reliability of distance measurements from the medial border of the scapula to the spinous process of the thoracic vertebrae when obtained using tape and photography measurements. The study included 20 healthy subjects (10 males, 10 females); for a total of 40 scapula measurements. The distance measurements made using tape or photography methods were conducted with the subject in a standing position. Repeated tape and photography measurements were conducted in two sessions on different days by two examiners to assess the inter-rater and intra-rater reliability of the two methods. The reliability of scapular distance measured using tape and photography methods was tested using intraclass correlation coefficients (ICC(3,1)) and the standard error of measurement (SEM). The inter-rater reliability of the tape measurement method was excellent (ICC=.77) and the intra-rater reliability was fair to good (ICC=.74). The inter-rater and intra-rater reliabilities of the photography measurement method were excellent (ICC=.76 and .76 respectively). Our results suggest that photography measurement is an objective and qualitative measurement tool for scapular distance measurements.

• The Journal of Korean Physical Therapy
• /
• 제21권4호
• /
• pp.31-36
• /
• 2009

Purpose: Pusher syndrome in stroke patients is the tendency to push strongly toward the paretic side with the non-affected limbs. The purpose of this study was to estimated inter-rater and intra-rater reliability of the Scale for Contraversive Pushing (SCP). Methods: Fourteen patients in the acute phase after stroke onset were diagnosed with pusher syndrome. Two physical therapists randomly assessed the same patients on different occasions on the same day. Almost all patients were assessed on more than one day. The inter-rater and intra-rater reliability of the SCP was estimated by calculation of the intraclass correlation coefficient (ICC). Results: The intra-rater reliability of the SCP ranged from 0.87 to 0.97; the inter-rater reliability of the SCP ranged from 0.71 to 0.99 in sitting and standing positions. These results show good reliability for the calculated variables. Conclusion: The results provide support for the use of the SCP in assessing pusher syndrome based on its reliability in stroke patients. It may use the standardized clinical assessments in clinical implication.

• 한국어교육
• /
• 제28권1호
• /
• pp.173-196
• /
• 2017

Writing is a subjective and performative activity. Writing ability has multi-facets and compoundness. To understand the examinees's writing ability accurately and provide effective writing scores, raters first ought to have the competency regarding assessment. Therefore, this study is significant as a fundamental research about rater's characteristics on the TOPIK writing assessment. 150 scripts of the 47th TOPIK examinees were selected randomly, and were further rated independently by 20 raters. The many-facet Rasch model was used to generate individualized feedback reports on each rater's relative severity and consistency with respect to particular categories of the rating scale. This study was analyzed using the FACETS ver 3.71.4 program. Overfit and misfit raters showed many difficulties for noticing the difference between assessment factors and interpreting the criteria. Writing raters appear to have much confusion when interpreting the assessment criteria, and especially, overfit and misfit teachers interpret the criteria arbitrarily. The main reason of overfit and misfit is the confusion about assessment factors and criteria in finding basis for scoring. Therefore, there needs to be more training and research is needed for raters based on this type of writing assessment characteristics. This study is recognized significantly in that it collectively examined writing assessment characteristics of writing raters, and visually confirmed the assessment error aspects of writing assessment.