• Korean Journal of Human Ecology
• /
• v.3 no.2
• /
• pp.90-100
• /
• 2000

Statistical reliability in the sensory evaluation measures the agreement of judgements for several observers. Kendall's coefficient of concordance for multiple rankings. and coefficient of consistence and coefficient of agreement for paired comparisons are frequently used as the standard reliability measures. The main idea and the computational formula of these coefficients in various situations are explained in detail with some real (cloth designing) examples. Moreover a user-friendly computer program called as MultPair is introduced. We expect that this expository paper and the computer program give a practical help to the researchers who use the sensory evaluation techniques.

• International Journal of Internet, Broadcasting and Communication
• /
• v.10 no.3
• /
• pp.65-72
• /
• 2018

The purpose of this study was to assess the intra-tester and inter-tester reliability and validity of elbow flexion range of motion using a smart phone used by the general public. Thirty-one general people participated in this study. The range of motion in active elbow flexion was measured with a goniometer and smart phone over two times by two observers. The intra-taster and inter-tester reliability were evaluated using the intraclass correlation coefficient(ICC). The validity was measured by Pearson's correlation coefficient. The intra-observer reliability was good in all measured items ICC>0.900. The inter-observer reliability was high with ICC>0.806. All correlation coefficients of android app and goniometer were greater than 0.868 and showed a significant positive correlation (p<0.01). The range of motion measurement with a smart phone showed acceptable reliability. Therefore, using a smartphone to measure the range of motion of the elbow joint could provide convenience and economic benefits.

• Geomechanics and Engineering
• /
• v.29 no.6
• /
• pp.599-614
• /
• 2022

In this study, the reliability analysis of internal and external stabilities of Reinforced Soil Walls (RSWs) under static and seismic loads are investigated so that it can help the geotechnical engineers to perform the design more realistically. The effect of various variables such as angle of internal soil friction, soil specific gravity, tensile strength of the reinforcements, base friction, surcharge load and finally horizontal earthquake acceleration are examined assuming the variables uncertainties. Also, the correlation coefficient impact between variables, sensitivity analysis, mean change, coefficient of variation and type of probability distribution function were evaluated. In this research, external stability (sliding, overturning and bearing capacity) and internal stability (tensile rupture and pull out) in both static and seismic conditions were investigated. Results of this study indicated sliding as the predominant failure mode in the external stability and reinforcing rupture in the internal stability. First-Order Reliability Method (FORM) are applied to estimate the reliability index (or failure probability) and results are validated using the Monte Carlo Simulation (MCS) method. The results showed among all variables, the internal friction angle and horizontal earthquake acceleration have dominant impact on the both reinforced soil wall internal and external stabilities limit states. Also, the type of probability distribution function affects the reliability index significantly and coefficient of variation of internal friction angle has the greatest influence in the static and seismic limits states compared to the other variables.

• Integrative Medicine Research
• /
• v.7 no.2
• /
• pp.136-140
• /
• 2018

Background: The Sasang constitutional analysis tool (SCAT) is an integrated Sasang constitutional analysis system developed by the Korea Institute of Oriental Medicine. This study aimed to evaluate the reliability of a questionnaire for measuring personality and pathophysiological symptoms that is one of the components of the SCAT. Methods: In this study, data were collected from university students in their twenties. Tests were administered twice, with an interval of 4 weeks between tests. Test-retest data from 176 students were collected and used for analysis. Internal consistency reliability was analyzed by using Cronbach's alpha coefficient, and test-retest reliability was analyzed by using Spearman's rank correlation coefficient. Results: Cronbach's alpha coefficient was 0.788 for personality, 0.511 for eating habits, 0.718 for digestion, 0.667 for heat- or cold-wise penchant, and 0.612 for water ingestion. Spearman's rank correlation coefficients, which were used to assess correlations between test and retest results, ranged from 0.444 to 0.828. Conclusion: The internal consistency and test-retest reliability of the SCAT questionnaire were found to be satisfactory.

• The Journal of Korean Physical Therapy
• /
• v.19 no.5
• /
• pp.29-41
• /
• 2007

Purpose: The aim of this study was to examine the validity and reliability on Psychometric Arthritis Impact Measurement Scale-Short Form (AIMS-SF) in patients with knee osteoarthritis(OA). Methods: The sample consisted of 62 patients who had received physical therapy at the physical therapy units of the Andong Medical Center, Sungso Hospital, Ahn Orthopedic Surgery Clinic, and St. Luke Clinic in Andong city in June 2006. Questionnaire on the AIMS-SF was recruited by 5 physical therapists. The internal structure and reliability of the scales were evaluated by means of item-internal consistency(Cronbach's alpha coefficient: ${\alpha}$), item-discriminant validity, Pearson's relation coefficient. To explore construct validity we conducted a principal component factor analysis with varimax rotation analysis. The criterion for factor extraction was an eigenvalue >1.0. Results: 62 OA patients's an average $age{\pm}standard$ deviation was $53.8{\pm}14.4$ years (range: $40{\sim}81$ yr). The internal consistency reliability of 11 items, as estimated by Cronbach's ${\alpha}$ coefficient, was high ranging $0.60{\sim}0.78$ (except for 0.40 for mobility level and -0.48 for mood). The internal consistency reliability of item-each scale was also high $0.82{\sim}0.93$ (except for 0.48 for mood). Of 11 items, the item-discriminant validity on 6 items was high (${\alpha}$ coefficient range: $0.11{\sim}0.25$), however, others (0.57 for tension level, 0.48 for arthritis pain, 0.41 for walking and bending, and 0.40 for work) were a little low. The construct validity by factor analysis was a little low. Conclusion: In conclusion, the results reported here confirm the validity and reliability of the AIMS-SF in patients with OA of the knee. The Collection of information on health status using this instrument was acceptable to patients. A further prospective multi-center study will be necessary to prove the construct validity.

• Journal of Korean Tunnelling and Underground Space Association
• /
• v.21 no.6
• /
• pp.875-885
• /
• 2019

This paper is aimed to suggest the coefficient of variation of the total load on the segment lining and the coefficient of variation of earth pressure in reliability based design of shield tunnel. For this purpose, the statistical characteristics of weathered soil and weathered rock were calculated by analyzing the site survey data of the domestic urban section. The coefficient of variation could be estimated by applying these values to Terzaghi's theory using MCS technique. As a result, the coefficient of variation of rock load for weathered soil and weathered rock was 0.08~0.14. The coefficient of variation for the total load acting on the tunnel was LC1 = 0.38, LC2 = 0.33, and LC3 = 0.37. The proposed coefficients of variation can be used in the reliability-based design of shield tunnel segments.

• The Journal of Korean Physical Therapy
• /
• v.33 no.4
• /
• pp.187-192
• /
• 2021

Purpose: The purpose of the current study was to determine the intra- and inter-rater reliability of muscle thickness measurement of the TA using ultrasonography (US) conducted at different inward pressures of approximately 0.5 kg, 1.0 kg, and no pressure control. Methods: Twenty healthy subjects were recruited for this study. Two different examiners measured the thicknesses of the dominant TA of each subject randomly to assess the intra- and inter-rater reliability. The measurement values were analyzed using the intra-class correlation coefficient (ICC) with a 95% confidence interval, standard error of measurement, minimal detectable change, and coefficient of variance. Results: All intra-rater reliability ICC values showed high reliability above 0.9. Inter-rater reliability ICC values showed high reliability above 0.9 with 0.5 and 1.0 kg of inward pressure. In contrast, Inter-rater reliability ICC values showed poor reliability (0.23) with no pressure control of inward pressure. Conclusion: The findings showed that maintaining consistent inward pressure is essential for reliable results when the muscle thickness of the TA is measured by different examiners in a clinical setting.

• The Journal of the Society of Korean Medicine Diagnostics
• /
• v.17 no.1
• /
• pp.29-44
• /
• 2013

Objectives This study is aimed at assessing the reliability of the Pattern identification questionnaire (PIQ) developed by Korea Institute of Oriental Medicine and examining the validity of the PIQ by comparing the pattern identification scores of different groups. Methods We conducted a survey of 258 participants (79 teachers and 179 graduate students at one School of Korean Medicine) using self-reported questionnaire and all the samples were retested. The test-retest reliability was assessed by Kappa coefficient(${\kappa}$) and Pearson correlation coefficient. Also we compared the differences in pattern identification scores according to sex, age and occupation. Results 1. One of 116 questions are impossible to calculate; 22 of them (18.97%) scored under 0.4 in ${\kappa}$; 90(77.59%) ranged from 0.4 to 0.8 in ${\kappa}$; and three questions (3.58%) scored 0.8 or over in ${\kappa}$. 2. Pearson correlation coefficients between test score and retest score of all pattern identification items are 0.4 or over. 3. The mean score for pattern identification in women was generally higher than that in men, particularly in patterns of blood-deficiency, blood-stasis, yang-deficiency and kidney disease. 4. The mean score for pattern identification in the graduate student group was generally higher than that in the teacher group. Conclusion In test-retest reliability, the PIQ showed relatively high reliability. The mean pattern identification score showed differences in regards to retaining knowledge about Korean medicine. Therefore, future research involving modification of questionnaire items and confirming the validity of this questionnaire is required.

• Journal of the Korean Academy of Child and Adolescent Psychiatry
• /
• v.33 no.3
• /
• pp.67-72
• /
• 2022

Objectives: This study investigated the reliability and validity of the Korean version of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) Level 2 Cross-Cutting Symptom Measure-Patient-Reported Outcomes Measurement Information System (PROMIS)-Depression and the Irritability for parents of children aged 6-17 years. Methods: Participants were 190 children diagnosed with depressive disorder (n=14), anxiety disorder (n=21), attention-deficit/hyperactivity disorder (ADHD; n=111), ADHD with anxious depression (n=13), and tic disorder with somatic symptoms (n=31). Patients were 8-15 years of age. The participants' mothers completed the Korean versions of the DSM-5 Level 2 Cross-Cutting Symptom Measure-PROMIS Depression and Irritability (Affective Reactivity Index, ARI), and the Korean Child Behavior Checklist (K-CBCL). Using these data, we calculated the reliability coefficient and examined the concurrent and discriminant validity of the PROMIS Depression and the Irritability (ARI) scales for assessing depression and irritability in children. Results: The reliability coefficient of the PROMIS Depression scale (Cronbach's α) was 0.93. The correlation coefficient with the K-CBCL DSM emotional problem score was 0.71. The PROMIS Depression scale significantly discriminated children with depressive disorders from those with other conditions. The reliability coefficient of the Irritability (ARI) scale was 0.91, suggesting its high reliability. Conclusion: Our results suggest that the Korean version of the DSM-5 Level 2 Cross-Cutting Symptom Measure for Depression and Irritability Scales for parents of children aged 6-17 years is reliable and valid and may be an efficient alternative to the K-CBCL.

• Journal of Convergence for Information Technology
• /
• v.10 no.11
• /
• pp.148-155
• /
• 2020

The purpose of the study was to test the reliability and validity of the Korean version of Pittsburgh Sleep Quality Index (PSQI-K) and to examine the cutoff point of the PSQI-K for screening insomnia among young adults. The subjective quality and patterns of sleep in 64 participants were measured using PSQI-K and Fitbit Charge 3^TM. The properties of the instrument were analyzed using Cronbach's alpha coefficient for the internal consistency reliability, factor analysis for the construct validity, and Spearman's rho correlation coefficient for the correlation between the PSQI-K total scores and Fitbit tracker scores. The Cronbach's alpha coefficient of the PSQI-K was 0.69. The Spearman's rho correlation coefficient between the PSQI-K and Fitbit tracker was higher than 0.67. A cutoff point of ≥6.0 had a sensitivity of 0.93 and a specificity of 0.84. In conclusion, the PSQI-K is a reliable and valid instrument to evaluate sleep disturbance in Korean young adults.