• Title/Summary/Keyword: weighted kappa

Search Result 89, Processing Time 0.026 seconds

Reliability of Education and Occupational Class: A Comparison of Health Survey and Death Certificate Data (면접조사자료와 사망등록자료 간 교육수준 및 직업계층의 신뢰도)

  • Kim, Hye-Ryun;Khang, Young-Ho
    • Journal of Preventive Medicine and Public Health
    • /
    • v.38 no.4
    • /
    • pp.443-448
    • /
    • 2005
  • Objectives : This study was done to evaluate the reliability of education and occupational class between using the health survey and the death certificate data. Methods : The 1998 National Health and Nutrition Examination Survey (NHANES) was conducted on a cross-sectional probability sample of South Korean households, and it contained unique 13-digit personal identification numbers that were linked to the data on mortality from the Korean National Statistical Office. The data from 263 deaths were used to estimate the agreement rates and the Kappa indices of the education and occupational class between using the NHANES data and the death certificate data. Results : The simple and weighted Kappa indices for education were 0.60 (95% CI=0.53-0.68) and 0.73 (95% CI=0.67-0.79) respectively, if the educational level was grouped into five categories: no-formal-education, elementary-school, middle-school, high-school and college or over. The overall agreement rate was 71.9% for these educational groups. The magnitude of reliability, as measured by the overall agreement rates and Kappa indices, tended to increase with a decrease in the educational class. The number of non-educated people with using the death certificate data was smaller than that with using the NHANES data. For the occupational class (manual workers, non-manual workers and others), the Kappa index was 0.40 (95% CI=0.30-0.51), which was relatively lower than that for the educational class. Compared with the NHANES, the number of non-manual workers for the deceased who were aged 30-64 tended to be increased (8 to 12) when using the death certificate data, whereas the number of manual workers tended to be decreased (59 to 41). Conclusions : The socioeconomic inequalities in the mortality rates that were based on the previous unlinked studies in South Korea were not due to a numerator/denominator bias. The mortality rates for the manual workers and the no-education groups might have been underestimated.

Reliability of the Emergency Severity Index Version 4 Performed by Trained Triage Nurse (중증도 분류 간호사에 의한 응급환자 중증도 분류 신뢰도 측정 연구: Emergency Severity Index Version 4를 중심으로)

  • Choi, Hee Kang;Choi, Min Jin;Kim, Ju Won;Lee, Ji Yeon;Shin, Sun Hwa;Lee, Hyun Jung
    • Journal of Korean Critical Care Nursing
    • /
    • v.5 no.2
    • /
    • pp.61-71
    • /
    • 2012
  • Purpose: The aim of this study was to measure the inter-rater reliability of Emergency severity index (ESI) version 4 among triage nurse. Methods: This study was carried out from August 11, 2010 to September 7, 2010 in a regional emergency department. Data collection was done by ten triage nurses who trained ESI v.4. Two research nurses and ten triage nurses scored the ESI version 4 to the patients as references, independently. We calculated the weighted kappa between the triage nurses and research nurses to evaluate the consistency of the ESI v.4. Results: A total of 233 patients were enrolled in this study. Classification of ESI level was as follows - level 1 (0.4%), level 2 (21.0%), level 3 (67.8%), level 4 (9.4%), and level 5 (1.3%). Inter-rater reliability by weighted kappa was 0.79 (95% Confidence Interval= 0.74-0.83) and agreement rate was 87.1%. Under-triage rate by triage nurse was 6.0% and over-triage rate was 6.9%. Conclusion: For this study, inter-rater reliability was measured good level between triage nurses and research nurses in Korean single ED.

  • PDF

Reliability of the Visual Discrimination Scale on Oral Mucosa Pressure Ulcer for Healthcare Providers (의료인을 위한 구강점막욕창 시각적 감별도구의 신뢰도)

  • Uhm, Ju-Yeon;Kim, Myoung Soo
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.11
    • /
    • pp.443-450
    • /
    • 2020
  • The purpose of this study was to examine the inter-rater and intra-rater reliability of the oral mucosa pressure ulcer classification system based on the photographs. The study consisted of two stages; development and evaluation. In the developmental stage, 9 photographs of 82 were selected. In the evaluation stage, a total of 49 participants were invited web-based survey by e-mail. Cohen's weighted kappa and Krippendorff's alpha were used to define the inter-rater reliability. Nine photographs consisted of two, three, three, and one in normal, stage 1, stage 2, and stomatitis, respectively. The inter-rater reliabilities of wound care nurse specialist, intensive care nurse specialist, and dentist groups were 0.75, 0.70, and 0.78, respectively. The intra-rater reliability was 0.73. The inter-rater and intra-rater reliabilities of the oral mucosa pressure ulcer classification system showed substantially good agreement.

Inter-Rater Reliability of the Korean Triage and Acuity Scale (한국형 응급환자 분류도구의 간호사-응급구조사 간 신뢰도 평가)

  • Son, Jeong Ah;Lee, Eun Ja
    • Journal of Korean Clinical Nursing Research
    • /
    • v.26 no.1
    • /
    • pp.107-116
    • /
    • 2020
  • Purpose: This study was a prospective survey to evaluate the Korean Triage and Acuity Scale (KTAS) inter-rater reliability and to identify discordant areas in the KTAS classification between nurses and paramedics in emergency department (ED). Methods: Inter-rater reliability were evaluated using triage deta from January 11 to May 31, 2019. A convinience sample of a total of 800 patients who visited an emergnecy medical center in Incheon (400 adult and 400 pediatric patients in this study) were selected. The triages of this study a pair of one nurse and one paramedic performed triage at the same time, using the KTAS, Inter-rater reliability for the KTAS was evaluated with the weighted kappa. Results: The inter-rater reliability of the KTAS evaluated by weighted Kappa between nurse-paramedic KTAS score of adult patients was .71, and .66 for pediatric patients. Both were in the level considered as substantial. Among causes of triage discordance, the most frequently identified discordant item in triaging adults was the difference in the measurement of pain intensity (28.0%). For both adult and pediatric patients, multiple chief complaint was identified as the major discordant factor. In triaging pediatric patients the body temperature assessment by subjective judgments was the highest discordant item (50.7%). Conclusion: The study result suggested that the KTAS demonstrated a reasonable level of inter-rater reliability and functioned as a standardized triage tool for emergency medical services. In order to improve the inter-rater reliability and classification competence, it is necessary to revise the current all-integrated KTAS provider course to be differentiated for each job group.

Assessment of Additional MRI-Detected Breast Lesions Using the Quantitative Analysis of Contrast-Enhanced Ultrasound Scans and Its Comparability with Dynamic Contrast-Enhanced MRI Findings of the Breast (유방자기공명영상에서 추가적으로 발견된 유방 병소에 대한 조영증강 초음파의 정량적 분석을 통한 진단 능력 평가와 동적 조영증강 유방 자기공명영상 결과와의 비교)

  • Sei Young Lee;Ok Hee Woo;Hye Seon Shin;Sung Eun Song;Kyu Ran Cho;Bo Kyoung Seo;Soon Young Hwang
    • Journal of the Korean Society of Radiology
    • /
    • v.82 no.4
    • /
    • pp.889-902
    • /
    • 2021
  • Purpose To assess the diagnostic performance of contrast-enhanced ultrasound (CEUS) for additional MR-detected enhancing lesions and to determine whether or not kinetic pattern results comparable to dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) of the breast can be obtained using the quantitative analysis of CEUS. Materials and Methods In this single-center prospective study, a total of 71 additional MR-detected breast lesions were included. CEUS examination was performed, and lesions were categorized according to the Breast Imaging-Reporting and Data System (BI-RADS). The sensitivity, specificity, and diagnostic accuracy of CEUS were calculated by comparing the BI-RADS category to the final pathology results. The degree of agreement between CEUS and DCE-MRI kinetic patterns was evaluated using weighted kappa. Results On CEUS, 46 lesions were assigned as BI-RADS category 4B, 4C, or 5, while 25 lesions category 3 or 4A. The diagnostic performance of CEUS for enhancing lesions on DCE-MRI was excellent, with 84.9% sensitivity, 94.4% specificity, and 97.8% positive predictive value. A total of 57/71 (80%) lesions had correlating kinetic patterns and showed good agreement (weighted kappa = 0.66) between CEUS and DCE-MRI. Benign lesions showed excellent agreement (weighted kappa = 0.84), and invasive ductal carcinoma (IDC) showed good agreement (weighted kappa = 0.69). Conclusion The diagnostic performance of CEUS for additional MR-detected breast lesions was excellent. Accurate kinetic pattern assessment, fairly comparable to DCE-MRI, can be obtained for benign and IDC lesions using CEUS.

Study of the Radiation Effect by Equivalence ratio change on the 3-D Turbulent Combustion (당량비 변화에 따른 복사 특성이 3차원 난류 연소에 미치는 영향 연구)

  • Kim, Tea-Kuk;Yoon, Kyung-Beom;Min, Dong-Ho;Chang, Hee-Chul;Kim, Jin-Soo
    • 한국연소학회:학술대회논문집
    • /
    • 2006.10a
    • /
    • pp.79-85
    • /
    • 2006
  • Radiative heat transfer is very important in many combustion systems since they are operated in high temperature. Fluid flows in most of the combustion systems are turbulent to promote fast mixing of the hydrocarbon fuel and oxidant. Major combustion products are $CO_2$ and $H_2O$. The turbulent flow is modeled by using the standard ${\kappa}-{\epsilon}$ model and the radiation transfer is modeled by using the discrete ordinates method where the radiative gas properties are calculated by using the weighted sum of gray gases model with a gray gas regrouping(WSGGM-RG). Effect of the radiation on the combustion characteristics in a three-dimensional rectangular enclosure is studied by changing the equivalence ratio. Results show that the radiation plays a significant role on the heat transfer in the combustion systems by resulting in a temperature drop of 16% as compared to that obtained without radiation. The equivalence ratio also affects the combustion by different contribution of the radiative transfer with different gas compositions.

  • PDF

Reliability of the Korean Version of the Trunk Impairment Scale in Patients With Stroke

  • Seo, Hyun-Du;Kim, Nam-Joe;Chung, Yi-Jung
    • Physical Therapy Korea
    • /
    • v.15 no.4
    • /
    • pp.87-96
    • /
    • 2008
  • The purpose of this study was to establish the reliability of the Trunk Impairment Scale (TIS) translated into Korea in patients with stroke. It also aims to score the quality of trunk movement and to be a tool for the treatment. The TIS consists of three subscales that static sitting balance, dynamic sitting balance and co-ordination. The TIS score ranges from a minimum of 0 to a maximum of 23. Twenty-five stroke patients (13 males, 12 females) were examined by two physiotherapists. Interrater and test-retest reliability were assessed. Kappa and weighted kappa values for the items of the trunk assessment of the TIS ranged from .67 to 1.00. Intraclass correlation coefficients for interrater and test-retest agreement were .95 and .97. Cronbach alpha coefficients for internal consistency range from .87 to .97. The TIS provide reliable assessments for the trunk and are valid scales for measuring trunk performance in patients with stroke. TIS can be used as a guideline for treatment and the assessment of quality of trunk activity.

  • PDF

Numerical Study for 3D Turbulent Flow in High Incidence Compressor Cascade (고입사각 압축기 익렬 내의 3차원 난류유동에 관한 수치적 연구)

  • 안병진;정기호;김귀순;임진식;김유일
    • Journal of the Korean Society of Propulsion Engineers
    • /
    • v.6 no.3
    • /
    • pp.29-36
    • /
    • 2002
  • A numerical analysis based on two-dimensional and three-dimensional incompressible Wavier-Stokes equations has been carried out for double-circular-arc compressor cascades and the results are compared with available experimental data at various incidence angles. The 2-D and 3-D computational codes based on SIMPLE algorithm adopt pressure weighted interpolation method for non-staggered grid and hybrid scheme for the convective terms. Turbulence modeling is very important for prediction of cascade flows, which are extremely complex with separation and reattachment by adverse pressure gradient. Considering computation times, $\kappa$-$\varepsilon$ turbulence model with wall function is used.

Development of the intermittency turbulence model for a plane jet flow (자유 평면 제트유동 해석을 위한 간혈도 난류모델의 개발)

  • 조지룡;정명균
    • Transactions of the Korean Society of Mechanical Engineers
    • /
    • v.11 no.3
    • /
    • pp.528-536
    • /
    • 1987
  • In a turbulent free shear flow, the large scale motion is characterized by the intermittent flow which arises from the interaction between the turbulent fluid and the irrotational fluid of the environment through the mean velocity gradient. This large scale motion causes a bulk convection whose effect is similar to the spatial diffusion process. In this paper, the total diffusion process is proposed to be approximated by weighted sum of the bulk convection due to the large scale motion and the usual gradient diffusion due to small scale motion. The diffusion term in conventional .kappa.-.epsilon. model requires on more equation of the intermittency transport equation. A production term of this equation means mass entrainment from the irrotational fluid to the turbulent one. In order to test the validity of the proposed model, a plane jet is predicted by this method. Numerical results of this model is found to yield better agreement with experiment than the standard .kappa.-.epsilon. model and Byggstoyl & Kollmann's model(1986). Present hybrid diffusion model requires further tests for the check of universality of model and for the model constant fix.

Development and Validation of an Instrument to Measure the Job Satisfaction of Perioperative Nurses (수술실 간호사의 직무 만족도 측정 도구 개발 연구)

  • Yoon, Ke Sook;Park, Sung Ae
    • Journal of Korean Clinical Nursing Research
    • /
    • v.15 no.1
    • /
    • pp.93-106
    • /
    • 2009
  • Purpose: The purpose of this study was to develop a valid and reliable instrument to explore and measure job satisfaction as perceived by perioperative nurses, specifically from the perspective of contemporary perioperative nursing in Korea. Method: Items (69) were developed from the responses to two open-ended questions by 168 perioperative nurses in one teaching hospital; (a) reasons that make work enjoyable, (b) reasons that make work unpleasant. Finally 55 items were selected, excluding items with lower correlation with the total scale. The instrument was completed by 885 perioperative nurses from 89 different hospitals nationwide who were attending the annual conference of the Korean Association Operating Room Nurses (KAORN), yielding a response rate of 95.6%. Results: Ten factors were extracted by factor analysis, which explained 60.0% of the total variance; Reliability and internal consistency were established (Cronbach's alpha=.95). A smaller sample of 39 perioperative nurses completed the instrument on two occasions, with a 2-week interval between. Mean scores were computed and two sets of scores were analyzed by Weighted Kappa (W-Kappa=0.680, p=.029). Conclusion: This instrument is a concise, highly practical and flexible tool, which can be used for the perioperative nurse in a wide range of hospital settings.