• Title/Summary/Keyword: Acceptable Reliability Level

Search Result 116, Processing Time 0.024 seconds

Assessing the Validity of the Preclinical Objective Structured Clinical Examination Using Messick's Validity Framework (Messick의 타당도 틀을 활용한 임상실습 전 실기시험의 타당도 평가)

  • Lee, Hye-Yoon;Yune, So-Jung;Lee, Sang-Yeoup;Im, Sunju
    • Korean Medical Education Review
    • /
    • v.23 no.3
    • /
    • pp.185-193
    • /
    • 2021
  • Students must be familiar with clinical skills before starting clinical practice to ensure patients' safety and enable efficient learning. However, performance is mainly tested in the third or fourth years of medical school, and studies using the validity framework have not been reported in Korea. We analyzed the validity of a performance test conducted among second-year students classified into content, response process, internal structure, relationships with other variables, and consequences according to Messick's framework. As results of the analysis, content validity was secured by developing cases according to a pre-determined blueprint. The quality of the response process was controlled by training and calibrating raters. The internal structure showed that (1) reliability by generalizability theory was acceptable (coefficients of 0.724 and 0.786, respectively, for day 1 and day 2), and (2) the relevant domains had proper correlations, while the clinical performance examination (CPX) and objective structured clinical examination (OSCE) showed weaker relationships. OSCE/CPX scores were correlated with other variables, especially grade point average and oral structured exam scores. The consequences of this assessment were (1) making students learn clinical skills and study themselves, while causing too much stress for students due to lack of motivation; (2) reminding educators of the need to apply practical teaching methods and to give feedback on the test results; and (3) providing an opportunity for faculty to consider developing support programs. It is necessary to develop the blueprint more precisely according to students' level and to verify the validity of the response process with statistical methods.

Development and Validation of a Education Nurse Specialist-Led Education Satisfaction Scale for Nurses Working at Comprehensive Nursing Care Service Wards (교육전담간호사가 주도하는 교육 프로그램에 대한 간호·간병통합서비스 병동 간호사의 교육 만족도 측정 도구 개발 및 타당도 검정)

  • Shin, Na yeon;Lee, Seung Shin;Park, Min Jung;Park, Young Mi;Kim, Sung Kyung;Nam, Ga Hee
    • Journal of Korean Clinical Nursing Research
    • /
    • v.26 no.3
    • /
    • pp.285-295
    • /
    • 2020
  • Purpose: The purpose of this study was to develop and validate a education nurse specialist-led educational satisfaction scale for nurses working at comprehensive nursing care service wards. Methods: A methodological study was conducted. A total of 237 nurses working at comprehensive nursing care service wards in a general hospital participated in this study. The scale was developed through literature reviews, in-depth interview, development of preliminary items, verification of content validity, development of secondary items, evaluation of construct validity, and extraction of final items. Analysis included exploratory factor analysis, pearson's analysis, and reliability analysis using cronbach's α. Results: The education nurse specialist-led educational satisfaction scale for nurses working at comprehensive nursing care service ward consisted of 21 items. Two factors (critical thinking disposition and clinical competency) were identified which explained 63.5% of the total variance. Cronbach's α of each factors were >.95. Conclusion: The results suggested that the education nurse specialist-led educational satisfaction scale for nurses working at comprehensive nursing care service wards demonstrated acceptable validity and reliability. Items of the instrument can assess the level of satisfaction with regards to education led by education nurse specialist among nurses working at comprehensive nursing care service wards.

Evaluation of the Impact of Iterative Reconstruction Algorithms on Computed Tomography Texture Features of the Liver Parenchyma Using the Filtration-Histogram Method

  • Pamela Sung;Jeong Min Lee;Ijin Joo;Sanghyup Lee;Tae-Hyung Kim;Balaji Ganeshan
    • Korean Journal of Radiology
    • /
    • v.20 no.4
    • /
    • pp.558-568
    • /
    • 2019
  • Objective: To evaluate whether computed tomography (CT) reconstruction algorithms affect the CT texture features of the liver parenchyma. Materials and Methods: This retrospective study comprised 58 patients (normal liver, n = 34; chronic liver disease [CLD], n = 24) who underwent liver CT scans using a single CT scanner. All CT images were reconstructed using filtered back projection (FBP), hybrid iterative reconstruction (IR) (iDOSE4), and model-based IR (IMR). On arterial phase (AP) and portal venous phase (PVP) CT imaging, quantitative texture analysis of the liver parenchyma using a single-slice region of interest was performed at the level of the hepatic hilum using a filtration-histogram statistic-based method with different filter values. Texture features were compared among the three reconstruction methods and between normal livers and those from CLD patients. Additionally, we evaluated the inter- and intra-observer reliability of the CT texture analysis by calculating intraclass correlation coefficients (ICCs). Results: IR techniques affect various CT texture features of the liver parenchyma. In particular, model-based IR frequently showed significant differences compared to FBP or hybrid IR on both AP and PVP CT imaging. Significant variation in entropy was observed between the three reconstruction algorithms on PVP imaging (p < 0.05). Comparison between normal livers and those from CLD patients revealed that AP images depend more strongly on the reconstruction method used than PVP images. For both inter- and intra-observer reliability, ICCs were acceptable (> 0.75) for CT imaging without filtration. Conclusion: CT texture features of the liver parenchyma evaluated using the filtration-histogram method were significantly affected by the CT reconstruction algorithm used.

Validity and reliability of the Korean version of the Quality of Recovery-40 questionnaire

  • Lee, Jun Ho;Kim, Deokkyu;Seo, Donghak;Son, Ji-seon;Kim, Dong-Chan
    • Korean Journal of Anesthesiology
    • /
    • v.71 no.6
    • /
    • pp.467-475
    • /
    • 2018
  • Background: The Quality of Recovery-40 (QoR-40) is a widely-used, self-rated, and self-completed questionnaire for postoperative patients. The questionnaire is intended to elicit information from each patient regarding the quality of recovery during the postoperative period. It is noteworthy, however, that an official Korean version of the QoR-40 (QoR-40K) has not been established. The purpose of this study was to develop the QoR-40K by translation and cultural adaptation process and to evaluate the validity and reliability of the QoR-40K. Methods: After pre-authorization from the original author of the QoR-40, the translation procedure was established and carried out based upon Beaton's recommendation to create a QoR-40K model comparable to the original English QoR-40. Two hundred surgical patients were enrolled, and each completed the questionnaire during the preoperative period, on the third day, and 1 month after surgery. The QoR-40K was compared with the visual analogue scale (VAS) and another health-related questionnaire, the Short-form Health Survery-36 (SF-36). The method of validation for QoR-40K included test-retest reliability, internal consistency, and level of responsiveness. Results: Spearman's correlation coefficient for test-retest reliability was 0.895 (P < 0.001), and Cronbach's alpha of the global QoR-40K on the third day after surgery was 0.956. A positive correlation was obtained between the QoR-40K and the mental component summary of SF-36 (${\rho}=0.474$, P < 0.001), and a negative correlation was observed between QoR-40K and VAS (${\rho}=-0.341$, P < 0.001). The standardized responsive mean of the total QoR-40K was 0.71. Conclusions: The QoR-40K was found to be as acceptable and reliable as the original English QoR-40 for Korean patients after surgery, despite the apparent differences in the respective patients' cultural backgrounds.

수학 영재 판별 도구 개발 - 수학 창의적 문제 해결력 검사를 중심으로 -

  • 김홍원
    • Journal of Gifted/Talented Education
    • /
    • v.8 no.2
    • /
    • pp.69-89
    • /
    • 1998
  • The purpose of this study is to develop a test which can be used in identification of the gifted students in the area of mathematics. This study was carried out for two years from 1996. Mathematical giftedness is, in this study, regarded as a result of interaction of mathematical thinking ability, mathematical creativity, mathematical task committment, background knowledge. This study presumed that mathematical thinking ability is composed of seven thinking abilities: intuitive insights, ability for information organization, ability for visualization, ability for mathematical abstraction, inferential thinking ability(both inductive and deductive thinking abilities), generalization and application ability, and reflective thinking. This study also presupposed that mathematical creativity is composed of 3 characteristics: fluency, flexibility, originality. The test for mathematical creative problem solving ability was developed for primary, middle, and high school students. The test is composed of two parts: the first part is concentrated more on divergent thinking, while the second part is more on convergent thinking. The major targets of the test were the students whose achievement level in mathematics belong to top 15~20% in each school. The goodness of the test was examined in the aspects of reliability, validity, difficulty, and discrimination power. Cronbach $\alpha$ was in the range of .60~.75, suggesting that the test is fairly reliable. The validity of the test was examined through the correlation among the test results for mathematical creative problem solving ability, I. Q., and academic achievement scores in mathematics and through the correlation between the scores in the first part and the scores in the second part of the test for mathematical creative problem solving ability. The test was found to be very difficult for the subjects. However, the discrimination power of the test was at the acceptable level.

  • PDF

Permitted Daily Exposure for Diisopropyl Ether as a Residual Solvent in Pharmaceuticals

  • Romanelli, Luca;Evandri, Maria Grazia
    • Toxicological Research
    • /
    • v.34 no.2
    • /
    • pp.111-125
    • /
    • 2018
  • Solvents can be used in the manufacture of medicinal products provided their residual levels in the final product comply with the acceptable limits based on safety data. At worldwide level, these limits are set by the "Guideline Q3C (R6) on impurities: guideline for residual solvents" issued by the ICH. Diisopropyl ether (DIPE) is a widely used solvent but the possibility of using it in the pharmaceutical manufacture is uncertain because the ICH Q3C guideline includes it in the group of solvents for which "no adequate toxicological data on which to base a Permitted Daily Exposure (PDE) was found". We performed a risk assessment of DIPE based on available toxicological data, after carefully assessing their reliability using the Klimisch score approach. We found sufficiently reliable studies investigating subchronic, developmental, neurological toxicity and carcinogenicity in rats and genotoxicity in vitro. Recent studies also investigated a wide array of toxic effects of gasoline/DIPE mixtures as compared to gasoline alone, thus allowing identifying the effects of DIPE itself. These data allowed a comprehensive toxicological evaluation of DIPE. The main target organs of DIPE toxicity were liver and kidney. DIPE was not teratogen and had no genotoxic effects, either in vitro or in vivo. However, it appeared to increase the number of malignant tumors in rats. Therefore, DIPE could be considered as a non-genotoxic animal carcinogen and a PDE of 0.98 mg/day was calculated based on the lowest No Observed Effect Level (NOEL) value of $356mg/m^3$ (corresponding to 49 mg/kg/day) for maternal toxicity in developmental rat toxicity study. In a worst-case scenario, using an exceedingly high daily dose of 10 g/day, allowed DIPE concentration in pharmaceutical substances would be 98 ppm, which is in the range of concentration limits for ICH Q3C guideline class 2 solvents. This result might be considered for regulatory decisions.

An Alternative Perspective to Resolve Modelling Uncertainty in Reliability Analysis for D/t Limitation Models of CFST (CFST의 D/t 제한모델들에 대한 신뢰성해석에서 모델링불확실성을 해결하는 선택적 방법)

  • Han, Taek Hee;Kim, Jung Joong
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.28 no.4
    • /
    • pp.409-415
    • /
    • 2015
  • For the design of Concrete-Filled Steel Tube(CFST) columns, the outside diameter D to the steel tube thickness t ratio(D/t ratio) is limited to prevent the local buckling of steel tubes. Each design code proposes the respective model to compute the maximum D/t ratio using the yield strength of steel $f_y$ or $f_y$ and the elastic modulus of steel E. Considering the uncertainty in $f_y$ and E, the reliability index ${beta}$ for the local buckling of a CFST section can be calculated by formulating the limit state function including the maximum D/t models. The resulted ${beta}$ depends on the maximum D/t model used for the reliability analysis. This variability in reliability analysis is due to ambiguity in choosing computational models and it is called as "modelling uncertainty." This uncertainty can be considered as "non-specificity" of an epistemic uncertainty and modelled by constructing possibility distribution functions. In this study, three different computation models for the maximum D/t ratio are used to conduct reliability analyses for the local buckling of a CFST section and the reliability index ${beta}$ will be computed respectively. The "non-specific ${beta}s$" will be modelled by possibility distribution function and a metric, degree of confirmation, is measured from the possibility distribution function. It is shown that the degree of confirmation increases when ${beta}$ decreases. Conclusively, a new set of reliability indices associated with a degree of confirmation is determined and it is allowed to decide reliability index for the local buckling of a CFST section with an acceptable confirmation level.

The Effect of Smart Work Quality on Collective Intelligence and Job Satisfaction (스마트워크 품질이 집단지성 및 직무만족에 미치는 영향)

  • Kim, Hyun-Chul;Kim, Oh-Woo
    • Journal of Distribution Science
    • /
    • v.13 no.5
    • /
    • pp.113-120
    • /
    • 2015
  • Purpose - As the rapid development of ICT has been made recently, many domestic companies are trying to introduce smart work infrastructure. The purpose of institution of smart work is to enhance their performance. To this end, it is necessary to advance the way of working. Developing employees' collective intelligence should be regarded as a prerequisite for advancing the way of working. Job satisfaction of the employees is another important factor to enhance organizational performance. So this study aims to provide the theoretical background of systematic approach to smart work quality by empirically analyzing the effect of smart work quality on collective intelligence and job satisfaction. Research design, data, and methodology - A structural equation model was designed to examine cause-and-effect relationships among three latent variables(smart work quality, collective intelligence, job satisfaction). Three hypotheses were formulated. The first hypothesis is that the effect of smart work quality on collective intelligence will be positively and statistically significant. Likewise, the second hypothesis is that the effect of smart work quality on job satisfaction will be positively and statistically significant. Finally, the third hypothesis is that the effect of collective intelligence on job satisfaction will be positively and statistically significant. Based on the previous researches, 34 questionnaire items were developed to measure the effect of the three variables. The survey was conducted on 162 employees who are working under smart work environment. The number of the effective questionnaires for the analysis was 154. PASW Statistics 18 and AMOS 18 were used for the statistical analysis. Results - The validity and reliability test for questionnaire items have been carried out. From the factor analysis, 1 out of 34 items was eliminated. As a result, 33 out of 34 items were used for analyzing. The values of Cronbach's α ranged from 0.701 to 0.910, indicating the acceptable reliability of the questionnaire items. The values of χ2, df, CFI, TLI, RMSEA of the model are 102.838, 51, 0.949, 0.935, 0.082, respectively. So the structural equation model was statistically significant. The first and third hypotheses were supported. But the second hypothesis was rejected. Conclusions - An analysis using structural equation model showed meaningful implications about the effect of smart work quality on collective intelligence and job satisfaction. First, as the five quality elements of the smart work improved, the level of collective intelligence increased. Second, the statistical analysis showed smart work didn't have a direct effect on job satisfaction, which is inconsistent with the prior findings. The main purpose of smart work is to help achieve greater performance. The companies also need to make efforts to improve job satisfaction of their employees along with achieving greater performance. Third, an organization with higher level of collective intelligence showed greater job satisfaction. The companies under smart work environment need to develop functions to encourage participation, sharing, openness, and collaboration. This research will provide useful information for the companies which want to introduce smart work, distribution information system, management information system, etc.

Life Satisfaction Scale for Elderly : Revisited (구조적 차원성 탐색을 통한 '노인 생활 만족도 척도'의 재발견: 최성재의 '노인 생활 만족도 척도'를 중심으로)

  • Choi, Hye-Ji;Lee, Young-Boon
    • Korean Journal of Social Welfare
    • /
    • v.58 no.3
    • /
    • pp.27-49
    • /
    • 2006
  • The purpose of the present study was to investigate dimensionality and psychometric properties of identified theoretical constructs of the 'Life Satisfaction Scale for Elderly(LSSE)', which was developed by Choi, Sung-Jae in 1986. Data was obtained from 'The survey of health and welfare status of the elderly aged 65 or older in Chung-Choo city'. The subjects were 275 elderly. Results showed that LSSE had a multi-dimensional structure with three theoretical constructs. Each theoretical construct was named as 'positive affect and subjective satisfaction', 'negative self image and affect', and 'self-value'. Three theoretical constructs had high levels of reliability and validity based on internal construct. 'Positive affect and subjective satisfaction' and 'negative self image and affect' showed high levels of convergent and discriminant validity. 'Self-value' had a high level of convergent validity but acceptable level of discriminant validity. Results of this study revealed that there was a difference in theoretical dimensionality of LSSE between this study and Choi's study, which explained the dimensionality of LSSE as a single dimension. However, the result of this study regarding theoretical dimensionality supported findings from existing studies which insisted that life satisfaction had a multi-dimensional structure.

  • PDF

A Psychometric Item Goodness-of-Fit of the Test of Performance Strategies for Athletes with Physical Disabilities Applying Rasch Model (Rasch 모형을 적용한 지체장애 엘리트선수의 스포츠수행전략(TOPS) 척도 타당화)

  • Seo, Eunchul;Baek, Jae keun
    • 재활복지
    • /
    • v.21 no.2
    • /
    • pp.169-190
    • /
    • 2017
  • The purpose of this study was to investigate item goodness-of-fit of Scale, Rasch rating scale model was applied to 5 dimensions 24 items of the Test of Performance Strategies (TOPS) in a sample of athletes with physical disabilities (n=215). An assumption to test Rasch Model, which is satisfaction of unidimensionality, is regarded through PCAR test, and WINSTEPS 3.65 program is used to test the goodness-of-fit of items. The results of this study were: First, 3-point rating category was appropriate for the TOPS instead of the existing 5-point rating category. Second, as a result of analyzing the goodness-of-fit of the items, 21 items of the TOPS were suitable, but 3 items were not. Third, the item reliability of person separation of the TOPS was acceptable, but the person reliability of item separation was not suitable and it was necessary to adjust the item order considering the difficulty level of the items. Fourth, as a result of comparing the individual attribute score and the difficulty level through the Item-Person Map, the distribution of the item difficulty distribution was shown to be biased in some factors compared to the personal attribute score distribution.