• Title/Summary/Keyword: assessment item analysis

Search Result 353, Processing Time 0.042 seconds

Risk Assessment of Industrial Machines and Devices and Appropriateness of Their Safety Certification and Self-Declaration of Conformity (위험기계, 기구의 위험성 평가 및 안전인증 또는 자율안전확인의 적정성)

  • Choi, Gi Heung;Loh, Byoung Gook
    • Journal of the Korean Society of Safety
    • /
    • v.31 no.1
    • /
    • pp.1-6
    • /
    • 2016
  • Severity and frequency of industrial accidents are typically used to assess the "absolute" risk associated with the industrial machines and devices ("items") which are subject to safety certification or self-declaration of conformity. However, the "relative" risk associated with a particular item can further be assessed based on unit severity and unit frequency where the total number of item in use is taken into account. This study first attempts to estimate the total number of each item in use which was recently selected for safety certification or self-declaration of conformity. The appropriateness of such selection is recapitulated based on the relative risk involved. Analysis results indicate that depending on items, the relative risk is differentiated from the absolute risk. Recent selection of items for safety certification or self-declaration of conformity is then revisited for its validity. The relative risk based on unit severity and unit frequency of industrial accidents, together with the absolute risk, may be used to further categorize items for safety certification or self-declaration of conformity in the future.

Development of the Parent-Satisfaction Scale (<부모의 역할만족도 척도> 의 개발)

  • 현온강
    • Journal of the Korean Home Economics Association
    • /
    • v.32 no.1
    • /
    • pp.103-118
    • /
    • 1994
  • The purpose of this study was to develop the Parent Satisfaction Scale(PSS) to measure the various components of satisfaction related to parenting. The subjects were 1210 parents(249 fathers and 961 mothers) selected nation widely from 7 cities and several rural area in Korea. the statistics used for data analysis were Fisher's Exact Test, Cramer's V, factor analysis multiple regression, Cronbach's α,and Pearson's correlation. To begin with eighty of 100-item scale were selected through the item analysis and from that 48 items were abstracted through the multiple regression analysis conducted to reduce the length of the scale. Results of factor analysis indicated that the PSS comprised of five factors: general satisfaction parent-child relationship spouse support parent's role conflict support of children. Reliabilities for the domains ranged from 79 to 91. To determine the construct validity of this instrument the Marital Satisfaction Scale and the Proverb about child rearing were administered. The two creterion measures showed significant relationships with the PSS. The final 48 items scale from the current analysis were considered to be critical steps in the development of this assessment device.

  • PDF

Selecting Common Items for Linking the Oswestry Low Back Pain Questionnaire and a Short Form of Self-Reported Activity Measure for Low Back Pain

  • Choi, Bong-sam
    • Physical Therapy Korea
    • /
    • v.22 no.3
    • /
    • pp.61-70
    • /
    • 2015
  • To develop an effective and efficient measurement system for tracking changes of functional status across two measures, it is essential to integrate information and communicate scores across two measures. The lack of communication between two measures leads to score incompatibility. A potential solution would be the development of a crosswalk table between those measures. Prior to creating a crosswalk table, selecting common items between two measures is critical. By using the Oswestry low back pain disability questionnaire (Oswestry) and a short form measuring disability resulting from low back pain, item level statistics as well as differential item functioning (DIF) using the Rasch measurement were investigated. Eighty-two participants with known group validity were recruited. Based on the application of the Rasch measurement model, item difficulties across the two measures were logically and hierarchically ordered. Ceiling effects for both measures were detected, which were not be able to be effectively measured with the two measures. The DIF analysis across the two measures confirmed that five paired items were found to have DIF and five common items were selected for common items. Although five paired items function differently across the Oswestry and the short form, all items of both measures were well targeted study participants. The common items selected by the Rasch measurement model may be effective when creating a crosswalk table between the Oswestry and the short form.

Development of a lesbian, gay, bisexual, and transgender cultural competence scale for nurses in South Korea: a methodological study

  • Min Kyung Kim;Hye Young Kim
    • Women's Health Nursing
    • /
    • v.30 no.2
    • /
    • pp.107-116
    • /
    • 2024
  • Purpose: This study was conducted to develop a cultural competence scale for nurses regarding the lesbian, gay, bisexual, and transgender (LGBT) community and to test its validity and reliability. Methods: The study adhered to the 8-step process outlined by DeVellis, with an initial set of 25 items derived through a literature review and individual interviews. Following an expert validity assessment, 24 items were validated. Subsequently, a preliminary survey was conducted among 23 nurses with experience caring for LGBT patients. Data were then collected from a final sample of 322 nurses using the 24 items. Item analysis, item-total score correlation, examination of construct and convergent validity, and reliability testing were performed. Results: The item-level content validity index exceeded .80, and the explanatory power of the construct validity was 63.63%. The factor loadings varied between 0.57 and 0.80. The scale comprised five factors: cultural skills, with seven items; cultural awareness, with five items; cultural encounters, with three items; cultural pursuit, with three items; and cultural knowledge, with three items; totaling 21 items. Convergent validity demonstrated a high correlation, affirming the scale's validity. Internal consistency analysis yielded an overall reliability coefficient of 0.97, signifying very high reliability. Each item is scored from 1 to 6 (total score range, 21-126), with higher scores reflecting greater cultural competence in LGBT care. Conclusion: This scale facilitates the measurement of LGBT cultural competence among nurses. Therefore, its use should provide foundational data to support LGBT-focused nursing education programs.

Analysis of Concordance Between Parent Proxy and Child Self-report of KIDSCREEN-10 Health-related Quality of Life Questionnaire in an Elementary School-based Wellness Program: A Pilot Focus Group Study

  • Choi, Bongsam
    • Physical Therapy Korea
    • /
    • v.28 no.2
    • /
    • pp.146-153
    • /
    • 2021
  • Background: Researchers have previously commenced examining the degree of concordance between parent proxy and child self-reports on health-related quality of life (HRQOL) of many disease and impairment populations. Objects: To explore the differences between parent proxy and child self-reports on the HRQOL using Korean version of KIDSCREEN-10 questionnaires for applying to elementary school children and their parents who participated for a school-based wellness program. Methods: The focus groups were recruited for a school-based wellness program by implementing the following wellness services: 1) referring to a screening session for detecting potential posture-related musculoskeletal problems and 2) recommending home exercise programs. Before a primary field testing for the program, two focus groups were formed with a group of 9 parents and their 9 elementary school children aged 8-10 years of age. The parent proxy and child self-report versions of KIDSCREEN-10 questionnaires were administered to both groups after completion of the wellness program. Item level Rasch rating scale analysis was applied to compute logit scales of KIDSCREEN-10 questionnaire. Intraclass correlation coefficients (ICCs) and scatterplot of item difficulty between two reports were analyzed. Results: For fit statistics of parent proxy report, all items except 4 items (i.e., psychological well-being, mood/emotions, self-perception, parent relation) were found to be acceptable. For fit statistics of child self-report, all items except 3 items (i.e., psychological well-being, autonomy and home life) were acceptable. The relationship between two reports using ICCs were ranging from weak to very strong at p = 0.05 (i.e, ICCs = 0.011 to 0.905). Scatterplot analysis between two reports showed a major disparity on self-perception item at 95% confidence intervals. Conclusion: Both item level analyses and ICC comparisons provided a disparity between parent proxy and child self-reports of the HRQOL on self-perception item after competing a school-based wellness program. Therapist should consider the item as part of the HRQOL assessment.

The Use of Rasch Model in Developing a Short Form Based on Self-Reported Activity Measure for Low Back Pain

  • Choi, Bong-Sam
    • Physical Therapy Korea
    • /
    • v.21 no.4
    • /
    • pp.56-66
    • /
    • 2014
  • For maintaining adequate psychometric properties when reducing the number of items from an instrument, item level psychometrics is crucial. Strategies such as low item correlation or factor loadings, using classical test theory, have traditionally been advocated. The purpose of this study is to describe the development of a new short form assessing the impact of low back pain on physical activity. Rasch measurement model has been applied to the International Classification of Functioning, Disability and Health Activity Measure (ICF-AM). One hundred and one individuals with low back pain aged 19-89 years (mean age: $48.1{\pm}17.3$) who live in the community were participated in the study. Twenty-seven items of lifting/carrying construct of the ICF-AM were analyzed. Ten items were selected from the construct to create a short form. Item elimination criteria include: 1) high or low mean square (out of the range: .6-1.4 for the fit statistics), 2) similar item calibrations to adjacent items, 3) person separation value, and item-person map for potential gap in person ability continuum. All 10 items of the short form fit to the Rasch model except one item (i.e., carrying toddler on back). Despite its high infit and outfit statistics (1.90/2.17), the item had to be reinstated due to potential gaps at the upper extreme of person ability level. The short form had a slightly better spread of person ability continuum compared to the entire set of item. The created short form separated individuals with low back pain into nearly 4 groups, while the entire set of items separated the individuals into 6 groups. The findings prompted multidimensional models for better explanation of the lifting/carrying domain. The item level psychometrics based on the Rasch model can be useful in developing short forms with rationally retained items.

A Study on School Facilities Build Transfer Lease Project - Centering on the improvement of the assessment - (학교시설 임대형민자사업의 평가기준 개선연구)

  • Kwon, Byoung-Koo;Lee, Jae-Rim;Jo, Jin-Il
    • The Journal of Sustainable Design and Educational Environment Research
    • /
    • v.7 no.2
    • /
    • pp.30-46
    • /
    • 2008
  • In this study, were prepared after statistical analysis was conducted of assessment items and marks distribution for the selection of executors of the BTL project. When tests of the degree of dispersion and degree of appropriateness for each assessment item were analyzed, it was found that the degree of dispersion among assessment points has the power of discrimination since it is highly marked in the design field and operation management field. In contrast, 'business management plan' and 'investment composition for economic quality assessment' have a low level of the power of discrimination since points given to them have smaller difference between business projects.

  • PDF

Analysis of Item Contents of 2010, 2011 National Assessment of Educational Achievement at elementary school for deduction of suggestions to the mathematics teaching-learning (수학과 교수.학습 시사점 도출을 위한 2010, 2011년 국가수준 초등학교 학업성취도 평가 문항 내용 비교 분석)

  • Jo, Yun Dong;Ko, Ho Kyoung
    • The Mathematical Education
    • /
    • v.51 no.4
    • /
    • pp.395-413
    • /
    • 2012
  • National Assessment of Educational Achievement(NAEA) is important standard reference to become the basic data for confirming the effect of the curriculum administrated and the educational policies put in force presently and preparing the new curriculum and educational policies. In this paper, we looked into the mean and standard deviation of the calibrated score of whole group and male/female students, the correct answer ratio of each performance level and the correct answer ratio of each content domain, etc. in the results of NAEA at 6th elementary school. The analytic objects are 2010 and 2011 NAEA that are changed into complete enumeration survey and the standard reference prepared on the basis of the new calibrated score is applied to. And we analysed and compared correct answer ratio of the each content domain and each item to conform the difference between male and female students. On the basis of the these informations, we investigated that here is what kind of characteristics and trends to the whole group and what kind of suggestions to the teaching-learning. And we were going to provide the information of the needs to understand which content of mathematics is needed and which thinking methods are needed.

Development and Validation of a Practical Instrument for Injury Prevention: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT)

  • Sun, Yi;Arning, Martin;Bochmann, Frank;Borger, Jutta;Heitmann, Thomas
    • Safety and Health at Work
    • /
    • v.9 no.2
    • /
    • pp.140-143
    • /
    • 2018
  • Background: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. Methods: The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Results: Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. Conclusion: These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.

Development of the Damage Investigation Item to Debris Flow using the Delphi Method (델파이 기법을 활용한 토석류 피해조사 항목 개발)

  • Byun, Yo Seph;Kim, Min Gi;Park, Kyung Han;Oh, Tae Keun;Seong, Joo Hyun
    • Journal of the Korean Society of Safety
    • /
    • v.31 no.2
    • /
    • pp.41-48
    • /
    • 2016
  • Recently, the frequency and intensity of localized heavy rain and typhoon due to the abnormal climate has increased, and especially the damage by an avalanche of earth and rocks similar to the landslide of Umyeon Mountain has become a social issue. However, the standardized damage investigation method doesn't yet exist, so the systematic analysis of the data has not been carried out. In this regard, this study developed assessment items to conduct standardized damage investigation of debris flow. To achieve this, preliminary assessment items were derived from analysis of literature review and the Delphi technique of 12 experts who are engaged in research facility, academia and industry was conducted. As a result, 29 assessment items which can be classified into 6 groups were determined. Surveying the relevant hand-on workers, details assessment items in each group were determined by exploratory factor analysis and reliability analysis.