• Title/Summary/Keyword: Coefficient of Concordance

Search Result 48, Processing Time 0.026 seconds

Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination

  • Yim, Mikyoung
    • Korean journal of medical education
    • /
    • v.30 no.4
    • /
    • pp.347-357
    • /
    • 2018
  • Purpose: The purpose of this study was to apply alternative standard setting methods for the Korean Medical Licensing Examination (KMLE), a criterion-referenced written examination, and to compare them to the conventional cut score used on the KMLE. Methods: The process and results of criterion-referenced standard settings (i.e., the modified-Angoff and bookmark methods) were evaluated. The ratio of passing and failing examinees determined using these alternative standard setting methods was compared to the results of the conventional criteria. Additionally, the external, internal and procedural evaluation of these methods were reviewed. Results: The modified-Angoff method yielded the highest cut score, followed sequentially by the conventional method and the bookmark method. The classification agreement between the modified-Angoff and bookmark methods was 0.720 measured by Cohen's ${\kappa}$ coefficient. The intra-panelist classification consistency of modified-Angoff method was higher than bookmark method. However, the inter-panelist classification consistency was vice versa. The standard setting panelists' survey results showed that the procedures of both methods were satisfactory, but panelists had more confidence in the results of the modified-Angoff method. Conclusion: The modified-Angoff method showed results that were more similar to those of the conventional method. Both new methods showed very high concordance with the conventional method, as well as with each other. The modified-Angoff method was considered feasible for adoption on the KMLE. The standard setting panelists responded positively to the modified-Angoff method in terms of its practical applicability, despite certain advantages of the bookmark method.

Small diagnostic scale for internet addiction (인터넷 중독 자가진단 소형척도 개발)

  • Oh, Kwang-Sik
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.6
    • /
    • pp.1203-1209
    • /
    • 2010
  • Internet addiction is a serious social problem in information society. The purpose of this study is to develope a small diagnostic scale in order to detect internet addiction easily. The reliability and validity of K-scale and Kimberly Young-scale is investigated. Five small diagnostic scale is suggested by factor analysis and regression. The comparision of these small scale is established by correlation coefficient, chi-square test, gamma value of concordance in contingency table. In view of reliability and validity, we suggest a small diagnostic scale. The results of this study may be useful to detect internet addiction by oneself.

Development of the Home Fall Prevention Checklist for Community-dwelling Older Adults (재가노인 낙상환경위험 평가도구 개발)

  • Park, Eunok;Jang, Insun
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.5
    • /
    • pp.354-365
    • /
    • 2013
  • The purpose of the study was to develop the home fall prevention checklist for community-dwelling older adults. And the validity and reliability of the checklist were tested. The preliminary questions were developed through content validity by twenty experts using the CVI(Content Validity Index). Following the establishment of content validity, 52 items of the checklist were developed. Responses of 299 community-dwelling older adults were analyzed to further establish both reliability and validity of the checklist. Reliability using cohen's kappa coefficient and test-retest reliability(rate of concordance(%)), and construct validity using known-group comparison technique were tested. 51 items were over 0.80 in the cohen's kappa coefficient of the checklist, 45 items were over 80.0% in test-retest reliability. Construct validity was established by known-group comparison(t=3.50, p=.001). Validity and reliability of the checklist were confirmed. This checklist will help further studies to develop more safe environment to prevent falls.

Histologic Accuracy of Diagnostic Methods in Lung Cancer (폐암에서 진단수기의 조직학적 분류의 정확성에 관한 연구)

  • Lee, Sang-Min;Koh, Won-Jung;Yoon, Ho-Il;Choi, Seung-Ho;HwangBo, Bin;Park, Gye-Young;Yoo, Chul-Gyu;Lee, Choon-Taek;Kim, Young-Whan;Han, Sung-Koo;Shim, Young-Soo
    • Tuberculosis and Respiratory Diseases
    • /
    • v.47 no.4
    • /
    • pp.488-497
    • /
    • 1999
  • Background : Identification of the histologic cell type of lung cancer is important because it is related to the treatment modality and prognosis. Currently, many diagnostic methods are used to determine the cell type. We have studied to evaluate the histologic accuracy of each diagnostic methods in lung cancer. Method : 168 cases were analysed retrospectively, who underwent curative thoracotomy for lung cancer in Seoul National University Hospital from January, 1994 to February, 1997. Sputum cytology, percutaneous needle aspiration(PCNA), percutaneous needle biopsy(PCNB), bronchial washing cytology and flexible bronchoscopic biopsy were evaluated respectively. The k coefficient was applied to evaluate the degree of concordance between the histologic diagnosis obtained by each methods and the one derived from thoracotomy. Results : The k value in sputum cytology was 0.86. In the 34 cases with squamous cell carcinoma(SQ), 32 cases were finally diagnosed as having such by thoracotomy. 7 of the 8 cases with adenocarcinoma(AD) turned out to have the same. The k value in PCNA was 0.51. In the 31 cases with SQ, only 14 cases were finally diagnosed as having such. All of the 3 cases with small cell carcinoma(SC) turned out to have the same. The k value in PCNB was 0.77. The diagnosis was correct in 13 of the 16 patients with SQ and in 30 of the 32 cases with AD. The k value in bronchial washing cytology was 1.0. In all of the 29 cases with SQ and all of the 7 cases with AD, the diagnosis was correct. The k value in flexible bronchoscopic biopsy was 0.77. The diagnosis was correct in 51 of the 52 cases with SQ and in 1 of the 2 cases with SC. Conclusion : The concordance rate with the final histologic diagnosis in sputum cytology, PCNB, bronchial washing cytology and flexible bronchoscopic biopsy were excellent ($k{\geq}0.75$), while that in PCNA was fair (k=0.53). Because PCNA showed lower concordance rate than other diagnostic methods, PCNA is recommended to perform with PCNB.

  • PDF

Enhancement of nuclear radiation shielding and mechanical properties of YBiBO3 glasses using La2O3

  • Issa, Shams A.M.;Ali, Atif Mossad;Tekin, H.O.;Saddeek, Y.B.;Al-Hajry, Ali;Algarni, Hamed;Susoy, G.
    • Nuclear Engineering and Technology
    • /
    • v.52 no.6
    • /
    • pp.1297-1303
    • /
    • 2020
  • In this study, nuclear radiation shielding and rigidity parameters of Y (0.1-x)B0.6Bi1.8O3La2x glassy system were investigated in order to determine it's suitability for use as nuclear radiation shielding materials. Therefore, a group of bismuth borate glass samples with La2O3 additive were synthesized using the technique of melt quenching. According to the results, the increase of the La2O3 additive increases the density of the glass samples and the mass attenuation coefficient (μm) values, whereas the half-value layer (HVL) and mean free path (MFP) values decrease. The effective atomic number (Zeff) is also enhanced with an increment of both mass removal cross section for neutron (ΣR) and absorption neutron scattering cross section (σabs). In addition to the other parameters, rigidity parameter values were theoretically examined. The increase of La2O3 causes some other important magnitudes to increase. These are the average crosslink density, the number of bonds per unit volume, as well as the stretching force constant values of these glass samples. These results are in concordance with the increase of elastic moduli in terms of the Makishima-Mackenzie model. This model showed an increase in the rigidity of the glass samples as a function of La2O3.

CT-based quantitative evaluation of radiation-induced lung fibrosis: a study of interobserver and intraobserver variations

  • Heo, Jaesung;Cho, Oyeon;Noh, O Kyu;O, Young-Taek;Chun, Mison;Kim, Mi-Hwa;Park, Hae-Jin
    • Radiation Oncology Journal
    • /
    • v.32 no.1
    • /
    • pp.43-47
    • /
    • 2014
  • Purpose: The degree of radiation-induced lung fibrosis (RILF) can be measured quantitatively by fibrosis volume (VF) on chest computed tomography (CT) scan. The purpose of this study was to investigate the interobserver and intraobserver variability in CT-based measurement of VF. Materials and Methods: We selected 10 non-small cell lung cancer patients developed with RILF after postoperative radiation therapy (PORT) and delineated VF on the follow-up chest CT scanned at more than 6 months after radiotherapy. Three radiation oncologists independently delineated VF to investigate the interobserver variability. Three times of delineation of VF was performed by two radiation oncologists for the analysis of intraobserver variability. We analysed the concordance index (CI) and inter/intra-class correlation coefficient (ICC). Results: The median CI was 0.61 (range, 0.44 to 0.68) for interobserver variability and the median CIs for intraobserver variability were 0.69 (range, 0.65 to 0.79) and 0.61(range, 0.55 to 0.65) by two observers. The ICC for interobserver variability was 0.974 (p < 0.001) and ICCs for intraobserver variability were 0.996 (p < 0.001) and 0.991 (p < 0.001), respectively. Conclusion: CT-based measurement of VF with patients who received PORT was a highly consistent and reproducible quantitative method between and within observers.

Synthesis of T2-weighted images from proton density images using a generative adversarial network in a temporomandibular joint magnetic resonance imaging protocol

  • Chena, Lee;Eun-Gyu, Ha;Yoon Joo, Choi;Kug Jin, Jeon;Sang-Sun, Han
    • Imaging Science in Dentistry
    • /
    • v.52 no.4
    • /
    • pp.393-398
    • /
    • 2022
  • Purpose: This study proposed a generative adversarial network (GAN) model for T2-weighted image (WI) synthesis from proton density (PD)-WI in a temporomandibular joint(TMJ) magnetic resonance imaging (MRI) protocol. Materials and Methods: From January to November 2019, MRI scans for TMJ were reviewed and 308 imaging sets were collected. For training, 277 pairs of PD- and T2-WI sagittal TMJ images were used. Transfer learning of the pix2pix GAN model was utilized to generate T2-WI from PD-WI. Model performance was evaluated with the structural similarity index map (SSIM) and peak signal-to-noise ratio (PSNR) indices for 31 predicted T2-WI (pT2). The disc position was clinically diagnosed as anterior disc displacement with or without reduction, and joint effusion as present or absent. The true T2-WI-based diagnosis was regarded as the gold standard, to which pT2-based diagnoses were compared using Cohen's ĸ coefficient. Results: The mean SSIM and PSNR values were 0.4781(±0.0522) and 21.30(±1.51) dB, respectively. The pT2 protocol showed almost perfect agreement(ĸ=0.81) with the gold standard for disc position. The number of discordant cases was higher for normal disc position (17%) than for anterior displacement with reduction (2%) or without reduction (10%). The effusion diagnosis also showed almost perfect agreement(ĸ=0.88), with higher concordance for the presence (85%) than for the absence (77%) of effusion. Conclusion: The application of pT2 images for a TMJ MRI protocol useful for diagnosis, although the image quality of pT2 was not fully satisfactory. Further research is expected to enhance pT2 quality.

Comparison of Blood Lead Concentration Using Graphite Furnace Atomic Absorption Spectrometry (GF-AAs) and Inductively Coupled Plasma-mass Spectrometry (ICP-MS) (흑연로 원자 흡광 광도법과 유도 결합 플라즈마 질량 분석법을 이용한 혈중 납 농도 비교)

  • Kang, Min-Kyung;Kwon, Jung-Yeon;Kim, Byoung-Gwon;Lim, Hyoun-Ju;Seo, Jeong-Wook;Kim, Yu-Mi;Hong, Young-Seoub
    • Journal of Environmental Health Sciences
    • /
    • v.45 no.3
    • /
    • pp.258-266
    • /
    • 2019
  • Objectives: In this study, blood lead was analyzed using graphite furnace atomic absorption spectrometry (GF-AAs) and inductively coupled plasma mass spectrometry (ICP-MS). We tried to examine the difference and consistency of the analytical values and the applicability of the analytical method. Methods: We selected 57 people who agreed to participate in this study. After confirming the linearity of the calibration standard curves in GF-AAs and ICP-MS, the concentrations of lead in quality control material and samples were measured, and the degree of agreement was compared. Results: The detection limit of the ICP-MS was lower than that of GF-AAs. The coefficient of variation of reference materials was shown to be stable in the ICP-MS and GF-AAs. When the correspondence between the two equipments was verified by bias of the analysis values, a concordance was shown, and approximately 98% of the ideal reference lines were present within ${\pm}40%$ of the deflection. Conclusion: GF-AAs showed high sensitivity to single heavy metal analysis, but it took much time and showed higher detection limit than ICP-MS. Therefore, it would be considered necessary to switch to ICP-MS analysis method, considering that the level of lead exposure is gradually decreasing.

Detection of immunity in sheep following anti-rabies vaccination

  • Hasanthi Rathnadiwakara;Mangala Gunatilake;Florence Cliquet;Marine Wasniewski;Mayuri Thammitiyagodage;Ramani Karunakaran;Jean-Christophe Thibault;Mohamed Ijas
    • Clinical and Experimental Vaccine Research
    • /
    • v.12 no.2
    • /
    • pp.97-106
    • /
    • 2023
  • Purpose: Rabies is a fatal but preventable disease with proper pre-exposure anti-rabies vaccination (ARV). Dogs, as household pets and strays, are the reservoir and vector of the disease, and dog bites have been associated with human rabies cases in Sri Lanka over the past few years. However, other susceptible species having frequent contact with humans may be a source of infection. One such species is sheep and immunity following ARV has never been tested in sheep reared in Sri Lanka. Materials and Methods: We have tested serum samples from sheep reared in the Animal Centre, Medical Research Institute of Sri Lanka for the presence of anti-rabies antibodies following ARV. Sheep serum samples were tested with Bio-Pro Rabies enzyme-linked immunosorbent assay (ELISA) antibody kits used for the first time in Sri Lanka and our results were verified by a seroneutralization method on cells (fluorescent antibody virus neutralization, FAVN test) currently recommended by World Organization for Animal Health and World Health Organization. Results: Sheep received annual ARV and maintained high neutralizing antibody titers in their serum. No maternal antibodies were detected in lamb around 6 months of age. Agreement between the ELISA and FAVN test, i.e., coefficient concordance was 83.87%. Conclusion: Annual vaccination in sheep has an effect on maintaining adequate protection against rabies by measurements of anti-rabies antibody response. Lambs need to be vaccinated earlier than 6 months of age to achieve protective levels of neutralizing antibodies in their serum. Introducing this ELISA in Sri Lanka will be a good opportunity to determine the level of anti-rabies antibodies in animal serum samples.

Genetic Diversity of Indigenous Cattle Populations in Bhutan: Implications for Conservation

  • Dorji, T.;Hanotte, O.;Arbenz, M.;Rege, J.E.O.;Roder, W.
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.16 no.7
    • /
    • pp.946-951
    • /
    • 2003
  • The Genetic diversity and relationship of native Siri (Bos indicus) cattle populations of Bhutan were evaluated using 20 microsatellite markers. A total of 120 Siri cattle were sampled and were grouped into four populations according to their geographical locations which were named Siri West, Siri South, Siri Central and Siri East cattle. For each, 30 individuals were sampled. In addition, 30 samples each of Indian Jaba (B. indicus), Tibetan Goleng (B. taurus), Nepal Hill cattle (B. indicus), Holstein Friesian (B.taurus) and Mithun (B. frontalis) were typed. The mean number of alleles per loci (MNA) and observed heterozygosity (Ho) were high in the Siri populations ($MNA=7.2{\pm}0.3$ to $8.9{\pm}0.5$ and $Ho=0.67{\pm}0.04$ to $0.73{\pm}0.03$). The smallest coefficient of genetic differentiation and genetic distance ($F_{ST}=0.015$ and $D_A=0.073$) were obtained between Siri West and Siri Central populations. Siri East population is genetically distinct from the other Siri populations being close to the Indian Jaba ($F_{ST}=0.024$ and $D_A=0.084$). A high bootstrap value of 96% supported the close relationship of Siri South, Siri Central and Siri West, while the relationship between Siri East and Jaba was also supported by a high bootstrap value (82%). Data from principal component analysis and individual assignment test were in concordance with the inference from genetic distance and differentiation. In conclusion we identified two separate Siri cattle populations in Bhutan at the genetic level. One population included Siri cattle sampled from the West, Central and South of the country and the other Siri cattle was sampled from the East of the country. We suggest that Siri cattle conservation program in Bhutan should focus on the former population as it has received less genetic influence from other cattle breeds.