• Title/Summary/Keyword: Intra-Class Correlation Coefficient

Search Result 70, Processing Time 0.023 seconds

Comparative Simulation Studies on Generalized Binomial Models (일반화 이항모형의 적합도 평가)

  • Baik, E.J.;Kim, K.Y.
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.4
    • /
    • pp.507-516
    • /
    • 2011
  • Comparative studies on generalized binomial models (Moon, 2003; Ng, 1989; Paul, 1985; Kupper and Haseman, 1978; Griffiths, 1973) are restrictive in that the models compared are rather limited and MSE of the estimates is the only measure considered for the model adequacy. This paper is aimed to report simulation results which provide possible guidelines for selecting a proper model. We examine Pearson type of goodness-of-fit statistic to its degrees of freedom and AIC for the overall model quality. MSE and Bias of the individual estimates are also considered as the component fit measures. Performance of some models varies widely for a certain range of the parameter space while most of the models are quite competent. Our evaluation shows that the Extended Beta-Binomial model (Prentice, 1986) turns out to be particularly favorable in the point that it provides consistently excellent fit almost all over the values of the intra-class correlation coefficient and the probability of success.

The Clinical Application of modified Emory Functional Ambulation Profile for Chronic Stroke Patients (만성 편마비 환자의 modified Emory Functional Ambulation Profile의 임상 적용)

  • Kim, Seong-Yeol;Lee, Je-Hoon;An, Seung-Heon
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.5 no.4
    • /
    • pp.655-666
    • /
    • 2010
  • Purpose : The examine the reliability and validity of the modified Emory Functional Ambulation Profile(mEFAP) for assessing gait function in chronic stroke patients. Methods : A total of 45 stroke patients, who had a stroke more than 6 months, participated in the study. Reliability was determined by Intra-class Correlation Coefficient($ICC_{3,1}$), including Bland and Altman method (Standard Error of Measurement: SEM, Small Real Differences: SRD). Validity was examined by correlating results to the gait ability(mEFAP, Modified Motor Assessment Scale-Gait(MMAS-G), Scandinavian Stroke Scale-Gait(SSS-G), Functional Ambulation Category(FAC), 10m Waking Test(10m WT)), and Fugl Meyer-Lower/Extremity(FM-L/E), Berg Balance Scale(BBS). Results : Inter-rater reliability for the total mEFAP was High($ICC_{2,1}$=.998), and absolute reliability were excellent (SEM: 1.75, SRD: 4.85). Subjects without assistance factor performed better on all tests than did subjects who had stroke. There were significant correlations between the mEFAP and MMAS-G, SSS-G, FAC(r=-.66~-.79), 10 m WT(r=-.86), and FM-L/E, BBS(r=-.72~-.78), indicating good validity. Increased times on the mEFAP correlated with poor performance on the gait ability, motor function of lower extremity, BBS and slow gait speeds on the 10 m WT in stroke patients. Conclusion : The mEFAP can be administered easily and comprehensively. It is a reliable gait assessment tool for patients with stroke and correlated with known of function, the mEFAP may be a clinically useful measure of ambulation.

Study on Reliability and Validity of the 'Qi Blood Yin Yang Deficiency Questionnaire' (기혈음양허손 변증 설문지의 신뢰도 및 타당도 기초연구)

  • Kim, Ji Hye;Ku, Bon Cho;Kim, Jung Eun;Kim, Yoon Sik;Kim, Keun Ho
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.28 no.3
    • /
    • pp.346-354
    • /
    • 2014
  • The study was performed to determine the reliability and validity of the 'Qi Blood Yin Yang Deficiency Questionnaire (Qi Blood Yin Yang DQ)' for the 100 subjects with chronic fatigue. After 100 subjects respond to the 'Qi Blood Yin Yang DQ', Korean medical doctor classified the subjects into 4 groups such as Qi deficiency group, Blood deficiency group, Yin deficiency group and Yang deficiency group. 100 subjects were retested in the same way after 3 weeks. The reliability and the validity of the questionnaire were inspected. Internal consistency of the 'Qi Blood Yin Yang DQ' was excellent (Cronbach alpha 0.916). Test-retest reliability was good (intra-class correlation coefficient 0.699). Construct validity analyzed by exploratory factor analysis produced 4 factors, which were selected from eigenvalues that are greater than 1.0. The 'Qi Blood Yin Yang DQ' consisted of 4 factors. The factor 1, 2, 3 and 4 showed 'Qi deficiency', 'Yin deficiency', 'Yang deficiency' and 'Blood deficiency' respectively. The 'Qi Blood Yin Yang DQ' restructured in this study may provide a fundamental questionnaire and a further study is required for a more advanced, standardized and statistically proven questionnaire.

CT-based quantitative evaluation of radiation-induced lung fibrosis: a study of interobserver and intraobserver variations

  • Heo, Jaesung;Cho, Oyeon;Noh, O Kyu;O, Young-Taek;Chun, Mison;Kim, Mi-Hwa;Park, Hae-Jin
    • Radiation Oncology Journal
    • /
    • v.32 no.1
    • /
    • pp.43-47
    • /
    • 2014
  • Purpose: The degree of radiation-induced lung fibrosis (RILF) can be measured quantitatively by fibrosis volume (VF) on chest computed tomography (CT) scan. The purpose of this study was to investigate the interobserver and intraobserver variability in CT-based measurement of VF. Materials and Methods: We selected 10 non-small cell lung cancer patients developed with RILF after postoperative radiation therapy (PORT) and delineated VF on the follow-up chest CT scanned at more than 6 months after radiotherapy. Three radiation oncologists independently delineated VF to investigate the interobserver variability. Three times of delineation of VF was performed by two radiation oncologists for the analysis of intraobserver variability. We analysed the concordance index (CI) and inter/intra-class correlation coefficient (ICC). Results: The median CI was 0.61 (range, 0.44 to 0.68) for interobserver variability and the median CIs for intraobserver variability were 0.69 (range, 0.65 to 0.79) and 0.61(range, 0.55 to 0.65) by two observers. The ICC for interobserver variability was 0.974 (p < 0.001) and ICCs for intraobserver variability were 0.996 (p < 0.001) and 0.991 (p < 0.001), respectively. Conclusion: CT-based measurement of VF with patients who received PORT was a highly consistent and reproducible quantitative method between and within observers.

Inter-rater Reliability of Cervical Proprioception, Dynamic Balance and Dorsiflexion Range of Motion Ising STARmat®

  • Park, Ji-Won;Park, Seol
    • The Journal of Korean Physical Therapy
    • /
    • v.32 no.2
    • /
    • pp.88-93
    • /
    • 2020
  • Purpose: This study examined the inter-rater reliability of cervical proprioception, dynamic balance ability, and ankle dorsiflexion range of motion using STARmat®, which is a practical clinical tool that can provide practitioners and patients with quantitative and qualitative results. Methods: Thirty healthy young subjects were enrolled in this study, and two well-trained physical therapists participated as a tester. Two testers measured the cervical joint position error at the starting position after neck flexion, extension, side bending, and rotation; three dynamic balance tests, including anterior excursion, anterior reaching with single leg balance, and posterior diagonal excursion; and ankle dorsiflexion range of motion using STARmat®. The intra-class correlation coefficient (ICC) was used to determine the inter-rater reliability of the tests. Results: The inter-rater reliability for the cervical proprioception ranged from moderate to good (0.66 to 0.83), particularly for flexion (0.82), extension (0.70), right side bending (0.73), left side bending (0.71), right rotation (0.83), and left rotation (0.66). For the dynamic balance, the inter-rater reliability ranged from good to excellent (0.87 to 0.91), particularly for anterior excursion (0.86), posterior diagonal excursion (0.87 to 0.89), and anterior reaching with a single leg balance (0.90 to 0.91). In addition, for the ankle dorsiflexion range of motion, the ICC for the inter-rater reliability ranged from 0.95 to 0.96. Conclusion: STARmat® is a reliable tool for measuring cervical proprioception, dynamic balance tests, and ankle dorsiflexion range of motion in healthy young adults.

Development of a Wearable Inertial Sensor-based Gait Analysis Device Using Machine Learning Algorithms -Validity of the Temporal Gait Parameter in Healthy Young Adults-

  • Seol, Pyong-Wha;Yoo, Heung-Jong;Choi, Yoon-Chul;Shin, Min-Yong;Choo, Kwang-Jae;Kim, Kyoung-Shin;Baek, Seung-Yoon;Lee, Yong-Woo;Song, Chang-Ho
    • PNF and Movement
    • /
    • v.18 no.2
    • /
    • pp.287-296
    • /
    • 2020
  • Purpose: The study aims were to develop a wearable inertial sensor-based gait analysis device that uses machine learning algorithms, and to validate this novel device using temporal gait parameters. Methods: Thirty-four healthy young participants (22 male, 12 female, aged 25.76 years) with no musculoskeletal disorders were asked to walk at three different speeds. As they walked, data were simultaneously collected by a motion capture system and inertial measurement units (Reseed®). The data were sent to a machine learning algorithm adapted to the wearable inertial sensor-based gait analysis device. The validity of the newly developed instrument was assessed by comparing it to data from the motion capture system. Results: At normal speeds, intra-class correlation coefficients (ICC) for the temporal gait parameters were excellent (ICC [2, 1], 0.99~0.99), and coefficient of variation (CV) error values were insignificant for all gait parameters (0.31~1.08%). At slow speeds, ICCs for the temporal gait parameters were excellent (ICC [2, 1], 0.98~0.99), and CV error values were very small for all gait parameters (0.33~1.24%). At the fastest speeds, ICCs for temporal gait parameters were excellent (ICC [2, 1], 0.86~0.99) but less impressive than for the other speeds. CV error values were small for all gait parameters (0.17~5.58%). Conclusion: These results confirm that both the wearable inertial sensor-based gait analysis device and the machine learning algorithms have strong concurrent validity for temporal variables. On that basis, this novel wearable device is likely to prove useful for establishing temporal gait parameters while assessing gait.

Test-retest Reliability of Sit-to-Stand and Gait Assessment Using the Wii Balance Board (Wii Balance Board를 이용한 Sit-to-Stand와 보행기능 측정의 검사-재검사 신뢰도)

  • Yang, Seong-rye;Oh, Yu-ri;Jeon, Ye-rim;Park, Dae-sung
    • Physical Therapy Korea
    • /
    • v.23 no.3
    • /
    • pp.40-47
    • /
    • 2016
  • Background: Assessments of Sit-to-Stand (STS) and gait functions are essential procedures in evaluating level of independence for the patients after stroke. In a previous study, we developed the software to analyze center of pressure (COP) in standing position on Wii Balance Board (WBB). Objects: This purpose of this study is to measure test-retest reliability of ground reaction forces, COP and time using WBB on STS and gait in healthy adults. Methods: Fifteen healthy participants performed three trials of STS and gait on WBB. The time (s), vertical peak (%) and COP path-length (cm) were measured on both tasks. Additionally, counter (%), different peak (%), symmetry ratio, COP x-range and COP y-range were analyzed on STS, 1st peak (%), 2nd peak (%) of weight were analyzed on gait. Intra-class correlation coefficient (ICC), standard error measurement (SEM) and smallest real difference (SRD) were analyzed for test-retest reliability. Results: ICC of all variables except COP path-length appeared to .676~.946 on STS, and to .723~.901 on gait. SEM and SRD of all variables excepting COP path-length appeared .227~8.886, .033~24.575 on STS. SEM and SRD excepting COP path-length appeared about .019~3.933, .054~11.879 on gait. Conclusion: WBB is not only cheaper than force plate, but also easier to use clinically. WBB is considered as an adequate equipment for measuring changes of weight bearing during balance, STS and gait test which are normally used for functional assessment in patients with neurological problems and elderly. The further study is needed concurrent validity on neurological patients, elderly patients using force plate and WBB.

A study on the clinical usefulness, validity, and test-retest reliability of the Spirokit, a device that combines the pulmonary function test and respiratory muscle strength test

  • Kim, Byeong-Soo;Lee, Myung-Mo
    • Physical Therapy Rehabilitation Science
    • /
    • v.9 no.2
    • /
    • pp.120-130
    • /
    • 2020
  • Objective: This study was conducted to identify the clinical usefulness, validity, and reliability of the Spirokit, a device that combines the pulmonary function test (PFT) and respiratory muscle strength (RMS) test. Design: Cross-sectional study. Methods: Forty young adults (male: 23, female: 17) participated in a PFT and a RMS test. The concurrent validity for pulmonary function was assessed by comparing data obtained from MicroQuark and the Spirokit and the agreements between the MicroRPM and the Spirokit for RMS were compared. The test-retest reliability of the Spirokit was determined by comparing data obtained from the first and second sessions. The test and retest were performed at the same time after one day for the PFT and RMS test. Validity was estimated using intraclass correlation coefficients (ICCs), and by calculating 95% limits of agreement (LoA). To estimate interrater reliability, ICCs were calculated. Results: The Spirokit showed a high agreement intra class coefficient (ICC [2, 1]): 0.978-0.999, 95% limits of agreements (95% LOA): -0.798 to 0.847 with MicroQuark. It also showed a high level of concordance ICC (2, 1): 0.992 to 0.993, 95% LOA: -9.313 to 11.169 with MicroRPM. The test-retest reliability of the Spirokit was analyzed using ICC (2, 1), and showed a high level of reliability (ICC [2,1]=0.960 to 0.998). Standard error of measurement % (SEM%) was 0.12% to 3.39%, and minimum detectable change% (MDC%) was 0.02% to 3.79%, indicating high level of reliability. Conclusions: The Spirokit is a device with high validity and reliability that can be used to simultaneously measure PFT and RMS tests.

Observation of Changes in Indoor Formaldehyde(HCHO) Concentration during Ultrasound Guided Biopsy (초음파 조직생검 시 실내의 포름알데히드(HCHO) 농도 변화 관찰)

  • Lee, Hoon-Jeong;Kang, Sung-Jin
    • Journal of the Korean Society of Radiology
    • /
    • v.15 no.7
    • /
    • pp.1057-1064
    • /
    • 2021
  • This study was conducted by simulating the same environmental conditions as the actual biopsy to observe the change in formaldehyde(HCHO) concentration in the indoor air during ultrasound guided biopsy. Changes in HCHO concentration in the room were measured by successively performing five steps: sealing the ultrasound room, ventilation, opening formalin containers, sealing formalin containers, and re-ventilating. Trends of measured HCHO concentration changes were visualized using graphs. As a result of analyzing the consistency of the concentration change values measured three times using the intra-class correlation coefficient, it was found to be 0.989, which was statistically significant(p<0.05). Based on the results of this study, we hope that medical workers working in the HCHO exposure environment of the field of radiology part will improve their awareness of the necessity of exposure management at work, and actively discuss the establishment of an environment for exposure control and preparation of countermeasures.

The estimation of cholesterol intake in elderly: reliability and validity of short, Semi-Quantitative Food Frequency Questionnaire (SQ-FFQ)

  • Nindya, Triska Susila;Mahmudiono, Trias;Rachmah, Qonita
    • Journal of Nutrition and Health
    • /
    • v.54 no.1
    • /
    • pp.95-103
    • /
    • 2021
  • Purpose: High intake of cholesterol leads to cardiovascular disruption. Estimating the actual intake of cholesterol can be beneficial for nutrition intervention. This research aimed to develop Semi-Quantitative Food Frequency Questionnaire (SQ-FFQ) to estimate cholesterol intake and analyze its reliability and validity. Methods: SQ-FFQ was developed by sorting high cholesterol food items in Indonesian food database and food items' availability. A total of 30 older adults were randomly chosen from Public Health Center in Jagir District, Surabaya, Indonesia to test its validity. Reliability test was done by measuring the same developed SQ-FFQ in one-month period, while validity test was done by comparing SQ-FFQ results with 6-days food record. Statistical analysis used for reliability test was paired t-test, the Intra-class Correlation Coefficient (ICC), and Cronbach's α to measure the internal consistency. Meanwhile, validity of developed SQ-FFQ was analyzed using paired t-test and Bland-Altman. Results: Reliability of 2 administered SQ-FFQs showed a good agreement based on paired t-test analysis (p = 0.200), ICC (0.609), and Cronbach's α (0.757). Strong agreement was found in most of food items, but agreements for egg yolk and fried duck were poor. Significant difference was found between those food items (p = 0.001 vs. p < 0.001, respectively) with mean difference were -25.3 mg and 46.2 mg. Validity of developed SQ-FFQ2 compared to 6-days food diary records also found a strong agreement based on paired t-test and the Bland-Altman analysis. Conclusion: This baseline research provides a reasonably valid and repeatable measure of cholesterol intake estimation that can be widely used in nutrition and public health study, especially in Indonesia. No study has been conducted in Indonesia on the development of tools to estimate the cholesterol intake.