• The Journal of Korean Academy of Sensory Integration
• /
• v.14 no.1
• /
• pp.1-8
• /
• 2016

Objective : The purpose of this study was to determine the reliability of Test of Playfulness (ToP) in Attention Deficit Hyperactivity Disorder (ADHD) children. Methods : Twenty ADHD children participated in this study. To determine inter-rater reliability, two raters was evaluated by Test of Playfulness scores and analyzed Kappa coefficient and total agreement and intraclass correlation coefficient (ICC). Results : Total agreement was the range of 75%~95% and the Kappa coefficients was the range of. 45~1.00. Analyzing inter-rater reliability by ICC showed very high reliability: Intrinsic motivation was .96, internal control was .98, suspension of reality was .90, framing was .98, total score was .99. Conclusion : A reliability of Test of Playflness of children with ADHD showed that high. On the basis of this study, it will provide availability for clinical evaluation of children with ADHD, and basic study on the play of children with ADHD.

• Physical Therapy Korea
• /
• v.19 no.4
• /
• pp.55-60
• /
• 2012

The trochanteric prominence angle test (TPAT) has been used to measure the femoral anteversion angle between the tibial crest and the vertical line. However, the exact anatomical reference of the tibial crest has not yet been identified in the literature. Thus, the purposes of this research were twofold: first, to compare the femoral anteversion angle measured at three different anatomical references of the tibial crest (the proximal tibial crest, the proximal third of tibial crest, and the proximal half of tibial crest) and, second, to determine inter-and intra-rater reliabilities of the femoral anteversion angle measured at these three different anatomical references of the tibial crest during the TPAT. We recruited 14 healthy subjects, and a total of 28 legs were examined. The TPAT was measured using a digital inclinometer. A 1-way repeated-measure analysis of variance was used to compare the femoral anteversion angle measured at three different anatomical references of the tibial crest, and intraclass correlation coefficients (ICCs) were calculated to determine reliability. The femoral anteversion angle measured at the proximal tibial crest was significantly higher than that at the proximal third of the tibial crest and the proximal half of the tibial crest. The inter-and intra-rater reliabilities of femoral anteversion angle were measured at three anatomic references of the tibial crest were all found to be high during the TPAT (ICC=.9 0~.98). In conclusion, clinicians should recognize that the different degrees of the femoral anteversion angle could be measured when different anatomical references of the tibial crest were used, and that reliabilities were high when an exact anatomical reference of the tibial crest was used during the TPAT.

• The Journal of Korean Academic Society of Nursing Education
• /
• v.22 no.4
• /
• pp.549-558
• /
• 2016

Purpose: The purpose of this study was to develop and validate a Nursing Competency Scale in Simulation (NCSS) for nursing students. Methods: A preliminary version of the NCSS of 14 items was derived from the literature. A panel of seven experts reviewed the preliminary version for content validation and developed 15 items scale. A convenient sample of 195 nursing students completed the survey and two evaluators measured the performances of nine teams in a simulation scenario with NCSS. The data were analyzed using exploratory factor analysis, descriptive statistics, independent t-test and Cronbach's alpha. Intraclass correlation coefficient (ICC) was used in order to estimate the degree of inter-rater reliability. Results: An exploratory factor analysis demonstrated that two factor structures of the NCSS explained 51.1% of the total variance. Two factors were named psychosocial skills and cognitive and psychomotor skills. The mean scores of NCSS between third and 4th grade were significantly different providing support for its known-group validity. Cronbach's alpha was .90 and ranged from .79 to .88. The overall ICC for inter-rater agreement was 0.89 (95% CI 0.03 to 0.98). Conclusion: This scale shows preliminary evidence for validity and reliability. It could be a useful instrument for measuring learning outcome in simulation for nursing students' clinical competency.

• Physical Therapy Korea
• /
• v.10 no.1
• /
• pp.51-62
• /
• 2003

The purpose of this study was to compare the relative accuracy of a range of computer-based analysis with respect to EMG onset determined visually by an experienced examiner. Ten healthy students (6 male, 4 female) were recruited and three times randomly selected trials of isometric contraction of wrist flexion and extension were evaluated using four technique. These methods were compared which varied in terms of EMG processing, threshold value and the number of samples for which the mean must exceed the defined threshold, and beyond 7% of maximum amplitude. To identify determination of onset time, ICCs(Intraclass Correlation Coefficients) was used and inter-rater arid intra-rater reliability ranged good in visually derived onset values. The results of this study present that in wrist flexion and extension, the reliability of the inter and intra-examiner muscle contraction onset times through visual analysis showed beyond .971 with ICCs. The reliability of the muscle contraction onset time decision through visual reading, tested with computer analysis, showed a relationship of all the selected analysis methods with ICCs .859 and .871. The objective computer-based analysis comparing with visual reading at the same time is the effective and qualitative data analysis method, considering the specificity of each study method.

• Journal of the Korean Society of Laryngology, Phoniatrics and Logopedics
• /
• v.18 no.2
• /
• pp.96-101
• /
• 2007

Laryngopharyngeal reflux (LPR) is the retrograde movement of gastric contents into the larynx, pharynx, and upper aero-digestive tract. LPR differs from gastroesophageal reflux in that it is often not associated with heartburn and regurgitation symptoms. Otolaryngological manifestations of acid reflux include a wide range of pharyngeal and laryngeal symptoms. Belafsky et al. developed a useful self-administered tool, the reflux symptom index (RSI), for assessing the degree of LPR symptoms. Patients are asked to use a 0 to 5 point scale to grade the following symptoms: 1) hoarseness or voice problems; 2) throat clearing; 3) excess throat mucus or postnasal drip ; 4) difficulty swallowing; 5) coughing after eating or lying down; 6) breathing difficulties ; 7) troublesome or annoying cough; 8) sensation of something sticking or a lump in the throat; 9) heartburn, chest pain, indigestion or stomach acid coming up. A RSI score greater than 13 is considered abnormal. As there is no validated instrument to document the physical findings and severity of LPR, Belafsky et al. developed an eight-item clinical severity scale for judging laryngoscopic finding, the reflux finding score (RFS). They rated eight LPR-associated findings on a scale from 0 to 4 : subglottic edema, ventricular obliteration, erythema/hyperemia, vocal-fold edema, diffuse laryngeal edema, posterior commissure hypertrophy, granuloma/granulation tissue, and thick endolaryngeal mucus. A RFS score of greater than 7 was found to suggest LPR-associated laryngitis. Although both indices (RSI and RFS) are widely used, there is some controversy about their validity (sensitivity and specificity) and reliability (intra-rater and inter-rater) in LPR diagnosis and treatment. We discuss the validity and reliability of RSI and RFS with literature review.

• Journal of the Korean Society of Physical Medicine
• /
• v.8 no.1
• /
• pp.137-145
• /
• 2013

PURPOSE: The purpose of this study is to examine assessment of test-retest reliability for 13 items of pediatric balance scales, then the intrarater reliability among the raters. METHODS: Study participants included 6 children with spastic cerebral palsy who could walk. Raters were consist of seventy-four, 2nd year physical therapy major students. The children's ability to achieve physical balance was wideotaped for PBS items. The raters watched the tapes and evlauated each child twice. Test-retest reliability was analyzed using the Spearman correlation, and interrater reliability was analyzed using the Kendall's coefficient of concordance for ranks. RESULTS: The total PBS scores averaged 49.22 and 50.06 for first and second tests. Test-retest reliability of PBS individual items were between low and high. The low itmes were 3 items, and high were 4 itmes. Interrater reliability were low agreement. CONCLUSION: Based on the study, the pediatric balance scale is an effective evaluating tool for measuring functional balance of school age child. However, the agreement of students or beginner's interpretation is necessary in conjunction to this study results. On top of that, it is important to provide detailed explanation and repetitive training, which improves the analysis reliability. Also, each category subscores level for the pediatric balance scale must be examined carefully in conjunction to performing test, only after improving match quality via preceding practice.

• Korean Journal of Adult Nursing
• /
• v.25 no.1
• /
• pp.24-32
• /
• 2013

Purpose: The aim of the study was to identify the most appropriate fall-risk assessment tool for neurological patients in an acute care setting. Methods: This descriptive study compared the reliability and validity of three fall-risk assessment tools (Morse Fall Scale, MFS; St Thomas's Risk Assessment Tool in Falling Elderly Inpatients, STRATIFY; Hendrich II Fall Risk Model, HFRM II). We assessed patients who were admitted to the Department of Neurology, Neurosurgery, and Rehabilitation at Asan Medical Center between July 1 and October 31, 2011, using a constructive questionnaire including general and clinical characteristics, and each item from the three tools. We analyzed inter-rater reliability with the kappa value, and the sensitivity, specificity, predictive value, and the area under the curve (AUC) of the three tools. Results: The analysis included 1,026 patients, and 32 falls occurred during this study. Inter-rater reliability was above 80% in all three tools. and the sensitivity was 50.0% (MFS), 84.4%(STRATIFY), and 59.4%(HFRM II). The AUC of the STRATIFY was 82.8. However, when the cutoff point was regulated as not 50 but 40 points, the AUC of the MFS was higher at 83.7. Conclusion: These results suggest that the STRATIFY may be the best tool for predicting falls for acute neurological patients.

• The Journal of Information Systems
• /
• v.27 no.2
• /
• pp.1-28
• /
• 2018

Purpose More than 7.6 million mobile apps could be approved on both Apple iTunes Store and Google Play. For managing those existed Apps, Apple Inc. established twenty-four primary categories, as well as Google Play had thirty-three primary categories. However, all of their categorizations have appeared more and more problems in managing and classifying numerous apps, such as app miscategorized, cross-attribution problems, lack of categorization keywords index, etc. The purpose of this study focused on introducing individual information cognitive processing as the classification criteria to update the current categorization on Apple iTunes Store. Meanwhile, we tried to observe the effectiveness of the new criteria from a classification process on Apple iTunes Store. Design/Methodology/Approach A research approach with four research stages were performed and a series of mixed methods was developed to identify the feasibility of adopting individual information cognitive processing as categorization criteria. By using machine-learning techniques with Term Frequency-Inverse Document Frequency and Singular Value Decomposition, keyword lists were extracted. By using the prior research results related to car app's categorization, we developed individual information cognitive processing. Further keywords extracting process from the extracted keyword lists was performed. Findings By TF-IDF and SVD, keyword lists from more than five thousand apps were extracted. Furthermore, we developed individual information cognitive processing that included a categorization teaching process and learning process. Three top three keywords for each category were extracted. By comparing the extracted results with prior studies, the inter-rater reliability for two different methods shows significant reliable, which proved the individual information cognitive processing to be reliable as criteria of categorization on Apple iTunes Store. The updating suggestions for Apple iTunes Store were discussed in this paper and the results of this paper may be useful for app store hosts to improve the current categorizations on app stores as well as increasing the efficiency of app discovering and locating process for both app developers and users.

• The Journal of Korean Physical Therapy
• /
• v.27 no.4
• /
• pp.175-182
• /
• 2015

Purpose: The purposes of this study were to develop the Korean version of the trunk impairment scale (K-TIS) and to examine reliability and responsiveness of the K-TIS in patients with stroke. Methods Subjects of the study were 51 stroke patients (mean age: 57.78 years) recruited from two stroke clinics. For the interrater and test-retest reliability, two raters measured the K-TIS two times using video clips with an interval of 2 weeks. For the responsiveness, intensive physical therapy training was provided to all participants 2 times a day for one month or three months depending on the onset of the stroke and the admission rules of the two clinics. Inter-rater reliability and test-retest reliability of the K-TIS three subscales (static sitting balance, dynamic sitting balance, and coordination) scores and total scores were examined using intra-correlation coefficient ($ICC_{3,1}$) and Pearson's correlation coefficient (r). To examine responsiveness, the minimally important difference (MID) was calculated with effect size. Results: Inter-rater reliability of the K-TIS subscales and total scores were all high (ICC3,1=0.920-0.983 and r=0.924-0.984). For the test-retest reliability, $ICC_{3,1}$=0.805-0.901 and r=0.806-0.903, and the MID for acute and post-acute as well as chronic stroke patients remained in the mean change range. Conclusion: It is suggested that the K-TIS might be used for clinical and research purposes as a standardized tool for stroke patients. In addition, it can also be useful in establishment of treatment goal(s) and planning treatment program(s) for patients with stroke.

• Safety and Health at Work
• /
• v.9 no.2
• /
• pp.140-143
• /
• 2018

Background: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. Methods: The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Results: Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. Conclusion: These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.