• Pediatric Gastroenterology, Hepatology & Nutrition
• /
• 제26권2호
• /
• pp.88-98
• /
• 2023

Purpose: Children with inflammatory bowel disease (IBD) frequently undergo clinical assessments, involving triadic communication between clinician, parent, and child. During such encounters parents are traditionally the main communicator of information on their child's IBD, including subjective symptom reports. The level of agreement between children and their parents for IBD symptoms is poorly understood, and this study aimed to examine this factor. Methods: This was a cross-sectional study among children with IBD, and one parent. A validated paediatric IBD symptom report tool (IBDnow) enabled children and their parent to rate seven pain, well-being, and stool metrics, with dyads completing the tool concurrently. Results were assessed using: Individual agreement: proportion of identical symptom reports by each dyad (ideal score >0.7); Category agreement: percentage of identical reports for IBDnow metrics for the cohort; Inter-rater reliability: Gwet's AC1 coefficient with higher scores indicating better reliability (maximum=1). Results: Seventy-four parent/child dyads participated; child's mean age 12.2 years (standard deviation [SD] 2.9, range 6-16), mean time since diagnosis 2.8 years (SD 3), 54% female, 73% had Crohn's Disease. Mean individual agreement level was 0.6, with 27% of dyads agreeing on ≥6/7 IBDnow metrics. Category agreement was reported by 61% of dyads, 20% of parents overestimated, and 19% underestimated, their child's symptoms. Inter-rater reliability ranged from fair to good. Conclusion: These results should improve clinician awareness of how IBD symptom reports from parents may introduce bias. Children should be considered the most important source of symptom reports, and tools such as IBDnow utilised to enhance communication.

• Journal of health informatics and statistics
• /
• 제41권1호
• /
• pp.49-56
• /
• 2016

목적: 경동맥 내막-중막 두께와 경동맥 경화반의 존재유무는 죽상동맥경화증의 임상 전단계를 나타내는 지표로 널리 사용되고 있다. 경동맥 내막-중막 두께를 측정할 때의 측정자 의존성 때문에, 다기관 연구에서는 경동맥 내막-중막 두께와 경화반 측정의 기관간 신뢰도를 확인하는 것이 중요하다. 이 연구의 목적은 심뇌혈관 및 대사질환원인 연구센터에 속해 있는 세 임상기관 사이의 경동맥 내막-중막 두께와 경화반 측정의 측정자간 신뢰도를 평가하는 것이다. 방법: 심뇌혈관 질환 과거력이 없는 사람 20명이 2014-2015년 사이에 이 연구에 참여하였고(연령 37-64세), 미리 정해진 프로토콜에 따라 연구참여자의 좌, 우 경동맥을 세 임상기관에서 반복적으로 측정하였다. 총 경동맥의 원위부에서 측정한 경동맥 내막-중막 두께의 최대값과 평균값을 기록하였다. 경동맥에서의 경화반 존재유무는 측정자에 의해 확인되었다. 경동맥 내막-중막 두께와 경화반 존재유무의 신뢰도를 급내상관계수와 카파 통계량을 통해 각각 평가하였다. 결과: 계산된 급내상관계수는 최대 경동맥 내막-중막 두께를 평가하였을 때 0.647이었고 (95% CI: 0.487-0.779), 평균 경동맥 내막-중막 두께를 평가하였을 때 0.758 (95% CI: 0.632-0.854) 이었다. Bland Altman plot에서, 관측치의 대부분은 평균의 차이에서 ${\pm}1.96$ 표준편차 사이에 분포하였다. 각 기관 사이의 경화반 존재유무에 대한 카파 통계량은 0.304 (기관 1과 2), 0.507 (기관 1과 3), 0.606 (기관 2와 3)이었다. 전반적인 일치를 평가하는 Fleiss카파값은 0.445였다. 결론: 세 임상기관 사이의 경동맥 내막-중막 두께의 측정자간 신뢰도는 훌륭하였으며, 경화반 존재유무에 대한 신뢰도는 적정하였다.

• 재활치료과학
• /
• 제8권4호
• /
• pp.65-76
• /
• 2019

목적 : 본 연구는 문화적 차이를 보이는 Upper extremity performance test for elderly (TEMPA)를 한국판으로 수정 및 번역하고 그 타당도 및 신뢰도를 검증하는 것이다. 연구방법 : 연구대상자는 40세이상의 손 기능에 장애가 없는 성인 171명과 손 기능에 장애가 있는 성인 41명 이었다. 내용 타당도와 분별 타당도를 검증하였고, 검사-재검사 신뢰도와 검사자 간 신뢰도를 검증하였다. 결과 : 내용 타당도를 통해 문화적 차이를 보이는 2개의 항목 ('자물쇠 열고 약통 열기', '편지 봉투 작성하고 우표 붙이기')을 수정하였다. 분별 타당도를 통해 TEMPA는 손 기능에 장애가 있는 성인과 없는 성인을 구별할 수 있는 평가 도구임을 확인 하였다 (p<.001). 신뢰도 검증 결과 수행 속도는 급간 내 상관계수(ICC)= .71-.92, 기능 정도는 카파계수 (kappa) = 1.0, 수행 분석은 ICC = 1.0로 중간수준에서 높은 수준의검사-재검사 신뢰도를 보였다. 검사자 간 신뢰도는 실행 속도 ICC = 1.0, 기능 정도 kappa = .79-1.0, 수행 분석 ICC = .94-1.0으로 상당한 수준에서 높은 수준의 신뢰도를 보였다. 결론 : TEMPA는 손 기능의 장애가 있는 성인을 구별해 낼 수 있고, 높은 수준의 신뢰도를 보이는 평가 도구로 임상적 평가 및 근거 기반의 연구에 있어 많이 사용되기를 기대한다.

• 한국전문물리치료학회지
• /
• 제18권3호
• /
• pp.85-93
• /
• 2011

The purpose of this study was to establish the reliability and validity of the passive lumbar extension (PLE) test and prone instability test (PIT). Thirty-three subjects (14 males, 19 females) with lower back pain enrolled in the study and the subjects were divided into 2 groups (positive and negative instability groups) on the basis of radiographies of flexion and extension. Reliability was determined by the kappa coefficient and validity was examined using calculated sensitivity, specificity, and the likelihood ratio. The results showed that the reliability of the PLE test was higher than the PIT (intra-rater reliability: k=.86 and k=.81, interrater reliability: k=.65 and k=.62) and the validity of the PLE test was also higher than the PIT (sensitivity: 91% and 62%, specificity: 95% and 85% positive likelihood ratio: 20.00 and 4.10, negative likelihood ratio: .10 and .45). In conclusion, we think that the PLE test was a more reliable and valid method for lumbar instability than the PIT.

• The Journal of Korean Physical Therapy
• /
• 제21권1호
• /
• pp.41-48
• /
• 2009

Purpose: The examine the Reliability and Validity of the modified Emory Functional Ambulation Profile (mEFAP), Tinetti. Gait (TG), Timed Up & Go Tes t (TUG), Comfortable Gait Speed (CGS), Berg Balance Scale (BBS) in assessing gait function and balance in elderly person. Methods: The 45 community-dwelling subjects were participated in this study. Reliability was determined by intra-class correlation coefficient (ICC$_{3,1}$), Bland and Altman method (Standard Error of Measurement (SEM), Smallest Real Difference (SRD)). Results: Validity was examined by correlation the mEFAP, TG, TUG, CGS, BBS. The intra-rater reliability were High (ICC$_{3,1}$ : mEFAP=0.95, TG=0.96, TUG=0.94, CGS=0.96, BBS=0.92) and Absolute reliability were excellent (SEM: mEFAP=1.90, TG=0.21, TUG=0.28 CGS=0.25, BBS=0.52), (SRD: mEFAP=5.26, TG=0.58, TUG=0.77, CGS=0.69, BBS=1.44). There were significant correlations between assessment tool (r=.0.58$\sim$0.78, p<0.01) indicating good validity. Our results provide strong evidence that the assessment tool has good reliability, validity for assessing elderly person undergoing rehabilitation. Conclusion: The gait assessment tool is a useful scale for measuring walking function and recovery in elderly person.

• 재활치료과학
• /
• 제11권1호
• /
• pp.69-85
• /
• 2022

목적 : 본 연구는 연하장애 환자를 대상으로 구강안면기능을 평가할 수 있는 포괄적 구강안면기능척도(Comprehensive Oro-Facial Function Scale; COFFS)를 개발하고자 실시되었다. 연구방법 : COFFS의 문항 구성과 신뢰도를 검증하는 연구로 4개의 선행 연구를 선택 분석하여 예비문항을 수집하였고, 전문가를 대상으로 2차의 설문조사를 통해 내용타당도(Content Validity Ratio; CVR)를 도출하였다. 평가 항목의 내적 타당도를 위해 Cronbach's 𝛼값을 산출하였으며, 급간 내 상관계수(Internal Classification Coefficients; ICC)를 이용하여 검사-재검사 신뢰도 및 검사자간 신뢰도를 구하였다. 결과 : 전체 문항의 내용타당도는 0.67로 나타났으며, 영역별 Cronbach's 𝛼값의 경우 의사소통 영역 0.849, 구강안면 구조 및 형태 -0.224, 구강안면 움직임 수행능력 0.831, 저작 및 삼킴 기능은 0.946으로 도출되었으며, 검사-재검사 신뢰도는 0.974, 검사자간 신뢰도는 0.937로 높은 신뢰도를 보였다. 결론 : 본 연구에서 COFFS의 평가도구는 4개의 영역에서 34개의 문항을 최종적으로 선정하였고, 평가항목에 따라 3~5점 척도로 개발되었다. 추후 연구에서는 구강안면기능을 측정하는 다른 평가도구와의 상관관계를 통해 타당도를 입증할 추가연구가 필요할 것으로 사료된다.

• The Journal of Korean Physical Therapy
• /
• 제21권1호
• /
• pp.9-17
• /
• 2009

Purpose: The purpose of this study was to determine reliability and validity of the Postural Assessment Scale for Stroke Patients (PASS) in chronic stroke patients. Methods: A total of 43 stroke patients, who had a stroke more than 6 months previously, participated in the study. Reliability was determined by the intra-class correlation coefficient (ICC$_{3,1}$), Bland and Altman method and Cronbach's alpha by internal consistency. Validity was examined by correlation the PASS scores to the Berg Balance Scale (BBS), Trunk Control Test (TCT), and Fugl-Meyer Balance (FM-B) score. Results: The intra-rater reliability and the Absolute reliability of the PASS was good ICC$_{3,1}$=0.97 (95%CI 0.95$\sim$0.99) and excellent SEM=1.01 respectively. Cronbach's alpha value for PASS was found to be 0.94. There were significant correlations between the PASS and BBS, TCT, FM-B (r=0.65－0.96, p<0.01). Conclusion: The PASS provide reliable and valid instrument of the postural control assessment for chronic stroke patients.

• 한국콘텐츠학회:학술대회논문집
• /
• 한국콘텐츠학회 2019년도 춘계종합학술대회
• /
• pp.381-382
• /
• 2019

본 연구는 기능적 뻗기 검사의 측정자 간 신뢰도를 알아보기 위하여 실시하였다. 본 연구에 참가한 대상자는 총 46명(남 20명, 여 26명)이었고 기능적 뻗기 검사는 두 곳의 실험실에서 이루어졌고 측정자는 총 6명이었다. 같은 장소의 실험실에서 이루어진 검사의 측정자간 신뢰도는 높게 나타났으나 장소가 다른 곳에서 이루어진 검사의 측정자 간 신뢰도는 아주 낮게 나타났다. 따라서 기능적 뻗기 검사의 신뢰도를 확보하기 위하여서는 측정자들의 명확한 기준의 정리가 필요할 것으로 보인다.

• 한국과학교육학회지
• /
• 제17권1호
• /
• pp.65-73
• /
• 1997

The purpose of this study is to develop a valid and reliable instrument, applicable to high school Earth Science class experiment. In advance of developing items, I was selected 14 inquiry process skills and specified evaluative objectives for each of them to develop scales and criteria for them. I developed 28 evaluation items for 5 experiment subjects among those of high school Earth Science class. The first field trial was performed a sample of 5 high school students, and the second one using a sample of 25 high school students. The results are as follows. (1) The content validity and reliability(Cronbach $\alpha$) of the developed items were 82.7% and .86, respectively, the developed instrument in this study is considered valid and reliable. (2) The average difficulty index was .69 and the discrimination index was .30. (3) Answer sheets based on the reported results were rated 5 teachers and Inter-rater Reliabilitiy and Inter-rater Consistency were analyzed, its indices were .80 and .76, respectively. (4) The developed items show a low coefficient of .45 with TESIS, a set of paper-and-pencil test items developed by Lee, Hang-Ro(1991). That the experiment assessment is solely subject to the rater's viewpoint has been one of the major problems raised concerning the matter. This research, however, shows that a set of more specified scales and criteria for the evaluation will make it more valid, reliable and efficient.

• Asian Pacific Journal of Cancer Prevention
• /
• 제15권14호
• /
• pp.5759-5765
• /
• 2014

Electrical impedance tomography (EIT) is a potential supplement for mammogram screening. This study aimed to evaluate and feasibility of EIT as opposed to mammography and to determine pain perception with both imaging methods. Women undergoing screening mammography at the Radiology Department of National University of Malaysia Medical Centre were randomly selected for EIT imaging. All women were requested to give a pain score after each imaging session. Two independent raters were chosen to define the image findings of EIT. A total of 164 women in the age range from 40 to 65-year-old participated and were divided into two groups; normal and abnormal. EIT sensitivity and specificity for rater 1 were 69.4% and 63.3, whereas for rater 2 they were 55.3% and 57.0% respectively. The reliability for each rater ranged between good to very good (p<0.05). Quantitative values of EIT showed there were significant differences in all values between groups (ANCOVA, p<0.05). Interestingly, EIT scored a median pain score of $1.51{\pm}0.75$ whereas mammography scored $4.15{\pm}0.87$ (Mann Whitney U test, p<0.05). From these quantitative values, EIT has the potential as a health discriminating index. Its ability to replace image findings from mammography needs further investigation.