• 대한간호학회지
• /
• 제38권3호
• /
• pp.474-482
• /
• 2008

Purpose: The purposes of this study were; 1) to test the validity and reliability of the Korean version of Rantz's Observable Indicators of Nursing Home Care Quality Instrument (ONHQ) and 2) to evaluate the quality of Korean nursing homes. Methods: The study employed a three-phase methodological research design. 1) The original instrument of Rantz's. ONHQ was translated into Korean and modified by Korean nursing home experts. 2) A pilot study using the modified instrument was done in 20 nursing homes to examine inter-rater reliability. 3) The validity and reliability were tested.in 98 nursing homes. Results: Seven factors were extracted through factor analysis: 'communication', 'care delivery', 'grooming', 'odor, 'environment-basics', 'environment-access', and 'environment-homelike'. These factors explained 86.07% of the total variance. Cronbach's alpha coefficient of the 30 items was .97 indicating a high internal consistency of the instrument. Inter-rater reliability according to Kappa was .82. The average score of nursing home quality was 112.07 indicating an average range of quality level. Conclusion: The Korean version of the ONHQ was identified as a tool with a high degree of validity and reliability. This tool can be effectively used to assess the quality of nursing homes by professions as well as family members.

• Child Health Nursing Research
• /
• 제10권3호
• /
• pp.321-331
• /
• 2004

Purpose: To develop an Infant Developmental Assesment Scale appropriate for Korean infants that includes cultural context. Method: The total sample included 990 infants aged birth to 24months. The developmental tests were conducted at hospital well baby clinic, daycare centers, public health centers and homes located in city, urban and rural areas. Item analysis was done to examine content validity of the scale. Test responses were analyzed by SPSS to examine the inter-rater reliability, and construct validity. Result: Based on the naturalistic observation and analysis of other developmenta l instruments, 260 Korean infant developmental items were created. The mean score of the developmental quotient of 966 infants was 101.63±10.89. Correlation coefficient of inter-rater reliability was .99. In addition, 84.6％ of total items showed Kappa .70 and above. The development quotient was significantly different depending upon the residential area and father's occupation, therefore, construct validity using known group technique was supported. Conclusion: The developed instrument can be used to assess the development of handicapped infants, as well as normal infant's general abilities and to study individual differences within the normal range for Korean.

• Journal of Yeungnam Medical Science
• /
• 제35권1호
• /
• pp.63-69
• /
• 2018

Background: Kinovea software that tracking semi-automatically the motion in video screen has been used to study motion-related tasks in several studies. However, the validation of this software in open field test to assess locomotor activity have not been studied yet. Therefore, this study aimed to examine the reliability and validity of this software in analyzing locomotor activities. Methods: Thirty male Institute Cancer Research mice were subjected in this study. The results examined by this software and the classical method were compared. Test-retest reliability and inter-rater reliability were analyzed with Pearson's correlation coefficient and intraclass correlation coefficient (ICC). The validity of this software was analyzed with Pearson's correlation coefficient. Results: This software showed good test-retest reliability (ICC=0.997, 95% confidence interval [CI]=0.975-0.994, p<0.001). This software also showed good inter-rater reliability (ICC=0.987, 95% CI=0.973-0.994, p<0.001). Furthermore, in three analyses for the validity of this software, there were significant correlations between two methods (Pearson's correlation coefficient=0.928-0.972, p<0.001). In addition, this software showed good reliability and validity in the analysis locomotor activity according to time interval. Conclusion: This study showed that this software in analyzing drug-induced locomotor activity has good reliability and validity. This software can be effectively used in animal study using the analysis of locomotor activity.

• Physical Therapy Rehabilitation Science
• /
• 제10권3호
• /
• pp.379-386
• /
• 2021

Objective: The purpose of this study was to systematically review the trunk impairment scale that are used to assess the trunk control of stroke patients. Design: A systematic review Methods: Stroke subjects were categorized as acute, subacute, chronic. In this systematic review, the studies published between 2000 and 2020 were selected. A literature search using the keywords 'QUADAS', 'stroke', 'trunk impairment scale'. Data sources included RISS, GOOGLE Scholar and DBpia. We assessed the quality of assessment tools using Quality Assessment of Diagnostic Accuracy Studies tool. Results: We reviewed 18 studies. 7 of the 18 studies reported reliability results, 10 reported validity results. The QUADAS tool quality evaluation of 17 literatures extracted except for one randomized control test among 18 literatures showed a range of 3 to 13 points. 5 of the 18 studies are presented with the Cronbach alpha coefficient indicating reliability using internal consistency, all of which are more than 0.8. All studies that presented test-retest reliability, intra-rater reliability, and inter-rater reliability showed high agreement with an intra-class correlation coefficient of 0.75 or more. Conclusions: A systematic review of the study of the application of the trunk impairment scale for stroke patients will help provide criteria for future studies and application of the trunk impairment scale in clinical practice.

• The Journal of Korean Physical Therapy
• /
• 제32권6호
• /
• pp.335-340
• /
• 2020

Purpose: This study was performed to investigate the influence of the condition with and without external support on the strength of hip flexor in supine position in subjects without core stabilization. Hip flexor muscles are very functional in the hip joint structures. Therefore, it is essential to evaluate the strength of hip flexor in a clinical and precise way. Methods: Twenty subjects participated in this study. The double bent leg-lower test was used to evaluate subjects without core stabilization. The strength of hip flexor muscles was evaluated in supine position, both with and without external support condition. The paired t-test was used to compare the strength of hip flexor muscles according to external support. The level of statistical significance was at α=0.05. The intra-rater reliability of the repeated measures of hip flexor strength was estimated by calculating the intra-class correlation coefficients (ICC). Results: In subjects without core stabilization, the strength of hip flexor in supine was greater with external support than that without external support (p<0.05). In addition, the intra-rater reliability with an ICC (3, 1) of the strength measurement of hip flexor with external support was higher than that without external support. Conclusion: In subjects without core stabilization, the condition with external support can contribute to the strength of hip flexor in supine position and the strength measurement of hip flexor should be considered with the condition with and without external support.

• Clinics in Shoulder and Elbow
• /
• 제25권4호
• /
• pp.321-327
• /
• 2022

Background: Scapular dyskinesis is considered a risk factor for the shoulder pain that may warrant screening for prevention. Clinicians of all experience screen scapular dyskinesis using the scapular dyskinesis test yes-no classification (Y-N), yet its reliability in asymptomatic individuals is unknown. We aimed to establish Y-N's intra- and inter-reliability between students and expert physical therapists. Methods: We utilized a cross-sectional design using consecutive asymptomatic subjects. Six students and two experts rated 100 subjects using the Y-N. Cohen's kappa (κ) and Krippendorff's alpha (K-α) were calculated to determine intra- and inter-rater reliability. Results: Intra- and inter-rater values for experts were κ=0.92 (95% confidence interval [CI], 0.91-0.93) and 0.85 (95% CI, 0.84-0.87) respectively; students were κ=0.77 (95% CI, 0.75-0.78) and K-α=0.63 (95% CI, 0.58-0.67). Conclusions: The Y-N is reliable in detecting scapular dyskinesis in asymptomatic individuals regardless of experience.

• 한국전문물리치료학회지
• /
• 제18권3호
• /
• pp.67-75
• /
• 2011

The purpose of this study was to assess the agreement of manual muscle testing (MMT) and test-retest reliability of a hand held dynamometer for the posterior gluteus medius muscle, with and without lumbar stabilization, using a pressure biofeedback unit for patients with low back pain. The pressure biofeedback unit was used to minimize the substitute motion of the lumbopelvic region during hip abduction in patients lying on their side. Fifteen patients with low back pain participated in this study. A tester determined the MMT grades of the posterior gluteus medius with and without the pressure biofeedback unit. Active hip abduction range of motion with an inclinometer and the strength of their posterior gluteus medius using a hand held dynamometer were measured with and without the pressure biofeedback unit in the MMT position. The agreement of the grade of muscle strength in the MMT, and intra-rater reliability of both the active hip abduction range of motion and the strength of posterior gluteus medius were analyzed using the weighted kappa and intraclass correlation coefficient (ICC), respectively. The agreement of MMT with the pressure biofeedback unit (weighted kappa=.92) was higher than the MMT (weighted kappa=.34)(p<.05). The inclinometer with pressure biofeedback unit measurement of the active hip abduction range of motion had an excellent intra-rater reliability (ICC=.90). Also, the hand held dynamometer with pressure biofeedback unit measure of strength of the posterior gluteus medius had a good intra-rater reliability (ICC=.85). Therefore, the test for muscle strength with pressure biofeedback unit will be a reliable method for the determination of the MMT grades or amount of posterior gluteus medius muscle strength and the measurement of the range of motion for hip abduction in patients with low back pain.

• Journal of Korean Neurosurgical Society
• /
• 제59권6호
• /
• pp.577-583
• /
• 2016

Objective : The inter-rater reliability of the modified Knosp's classification was measured before the analysis. The clinical validity of the parasellar extension grading system was evaluated by investigating the extents of resection and complication rates among the grades in the endoscopic endonasal transsphenoidal surgery (EETS) for pituitary adenomas. Methods : From November 2008 to August 2015, of the 286 patients who underwent EETS by the senior author, 208 were pituitary adenoma cases (146 non-functioning pituitary adenomas, 10 adrenocorticotropic hormone-secreting adenomas, 31 growth hormone-secreting adenomas, 17 prolactin-secreting adenomas, and 4 thyroid-stimulating hormone-secreting adenomas; 23 microadenomas, 174 macroadenomas, and 11 giant adenomas). Two neurosurgeons and a neuroradiologist independently measured the degree of parasellar extension on the preoperative sellar MRI according to the modified Knosp's classification. Inter-rater reliability was statistically assessed by measuring the intraclass correlation coefficient. The extents of resection were evaluated by comparison of the pre- and post-operative MR images; the neurovascular complications were assessed by reviewing the patients' medical records. The extent of resection was measured in each parasellar extension grade; thereafter, their statistical differences were calculated. Results : The intraclass correlation coefficient value of reliability across the three raters amounted to 0.862. The gross total removal (GTR) rates achieved in each grade were 70.0, 69.8, 62.9, 21.4, 37.5, and 4.3% in Grades 0, 1, 2, 3A, 3B, and 4, respectively. A significant difference in the extent of resection was observed only between Grades 2 and 3A. In addition, significantly higher complication rates were observed in the groups above Grade 3A. Conclusion : Although the modified Knosp's classification system appears to be complex, its inter-rater reliability proves to be excellent. Regarding the clinical validity of the parasellar extension grading system, Grades 3A, 3B, and 4 have a negative predictive value for the GTR rate, with higher complication rates.

• Journal of Preventive Medicine and Public Health
• /
• 제43권6호
• /
• pp.479-485
• /
• 2010

Objectives: The Korean Genome and Epidemiology Study (KoGES), a multicenter-based multi-cohort study, has collected information on body composition using two different bioelectrical impedence analysis (BIA) machines. The aim of the study was to evaluate the possibility of whether the test values measured from different BIA machines can be integrated through statistical adjustment algorithm under excellent inter-rater reliability. Methods: We selected two centers to measure inter-rater reliability of the two BIA machines. We set up the two machines side by side and measured subjects' body compositions between October and December 2007. Duplicated test values of 848 subjects were collected. Pearson and intra-class correlation coefficients for inter-rater reliability were estimated using results from the two machines. To detect the feasibility for data integration, we constructed statistical compensation models using linear regression models with residual analysis and R-square values. Results: All correlation coefficients indicated excellent reliability except mineral mass. However, models using only duplicated body composition values for data integration were not feasible due to relatively low $R^2$ values of 0.8 for mineral mass and target weight. To integrate body composition data, models adjusted for four empirical variables that were age, sex, weight and height were most ideal (all $R^2$ > 0.9). Conclusions: The test values measured with the two BIA machines in the KoGES have excellent reliability for the nine body composition values. Based on reliability, values can be integrated through algorithmic statistical adjustment using regression equations that includes age, sex, weight, and height.

• 한국과학교육학회지
• /
• 제30권2호
• /
• pp.275-290
• /
• 2010

중학생의 과학탐구활동 수행평가 시 총체적 채점과 분석적 채점의 신뢰도를 비교 분석하였으며, 분석적 채점을 하는 경우에는 신뢰도 확보를 위하여 채점척도의 수준을 어느 정도로 분석적으로 해야 하는지를 조사하였다. 중학생들이 작성한 4개의 과학탐구과제에 대한 활동지를 두 명의 채점자가 총체적 채점 방식, 분석적 채점 방식, 분석적 채점 중 채점척도를 2, 3, 4~7수준으로 다르게 하여 채점하였다. 총체적 채점 방식은 과제 간 내적 일치도가 높게 나타났으며, 분석적 채점 방식은 채점자간 신뢰도가 높게 나타났다. 또한 채점척도 3수준의 경우는 4~7수준의 경우와 활동간 내적 일치도와 채점자간의 신뢰도가 유사하게 나타났으나, 능력추정치별 학생의 분포, 문항곤란도 및 문항특성곡선의 경우 채점척도 3수준의 경우가 적절한 것으로 나타났다. 이러한 연구 결과는 과학탐구활동 수행평가 시 총체적 채점 방식을 선택하는 경우는 과제 간 내적일치도를 높일 수 있으며 분석적 채점 방식에 비해 낮게 나타나는 채점자 간 일치도를 높이기 위한 채점자간 협의등 방안이 필요하다는 것을 시사한다. 또한 분석적 채점 방식을 선택하는 경우는 채점척도 3수준으로 충분히 신뢰도를 확보할 수 있다는 점을 시사한다.