• Title/Summary/Keyword: Evaluation Domains and Items

Search Result 83, Processing Time 0.026 seconds

A Study on the Importance of Works Perceived by Quality Improvement Coordinators and Their Current Work Performances (질 관리 실무자가 인지하는 업무중요도와 수행업무에 관한 연구)

  • Kim, Young Ju
    • Quality Improvement in Health Care
    • /
    • v.5 no.2
    • /
    • pp.224-237
    • /
    • 1998
  • Background : This is an investigative study to analyse the importance of works perceived by Quality Improvement(QI) Coordinators and to evaluate their current work performances using the questionnaires developed by the investigator. Methods : The data were collected from 37 subjects over two weeks period from Oct. 1 to Oct. 17, 1998 and analysed by the descriptive statistics of SPSS program. The items of questionnaire are consisted of 13 work domains including 73 activities based on Quality Management(QM) Coordinator's job description of National Association for Healthcare Quality:data collection & analysis, communication, monitoring, evaluation, accreditation, tool development, policy development, program development, self development, education & trainning, system design, planning, and consultation & support. Results : 1) Of the performances in 13 work domains, the frequencies of the work performed were accreditation(89%), planning(88%), communication(83%), data collection & analysis(82%), monitoring(76%), policy development(72%), consultation & support (71%), education & trainning(70%), self development(68%), evaluation(63%), tool development(61%), program development(44%) and system design(43%) in order. 2) For the importances (1=not important, 5=very important), the policy development(4.46) scored highest then monitoring(4.42), planning(4.41), education & trainning(4.38), communication(4.35), evaluation(4.34) tool development (4.30), data collection & analysis(4.29), program development(4.22), consultation & support(4.22), accreditation(4.15), self development(4.05) and system design(3.98) in order. 3) There was a difference between the work performance and the perceived importance. The results showed the low performances in policy development, monitoring, education & trainning and evaluation which ranked high by the perceived importance and the high performances in accreditation, data collection & analysis, self development, communication and consultation & support which ranked middle to low by the perceived importance. 4) The reasons for low performances of QI Coordinators were the lack of clear assignment for the responsibility and allowed authority for work to QI Coordinators(30.8%), insufficient member of QI Coordinators(13.9%), lack of hospital director's interest(11.5%), low motivation of QI Coordinators (10.6%) and insufficient knowledge & experience of QI Coordinators (8.8%). Conclusion : Most works were perceived important by QI Coordinators, but there was a difference in the work performance. The works performed over 70% were related with accreditation, data collection & analysis, communication, planning and monitoring, on the other hand under 50% in performances were related with system design, program development, tool development and evaluation.

  • PDF

A New Approach to Evaluation of Industrial Informatization (차세대 기업 정보화수준 평가 시스템에 관한 연구)

  • Leem, Choon-Seong;Yu, Eun-Jung;Kim, Byeong-Wan;Shin, Seon-Do;Lee, Byeong-Ryul;Cha, Jeong-Hoon
    • The Journal of Society for e-Business Studies
    • /
    • v.13 no.4
    • /
    • pp.125-144
    • /
    • 2008
  • Recently, the main concerns of enterprise management activities is how to strengthen the competitiveness to quickly respond to changes and sustain the growth in business environment. As IT(Information Technology) has become to be viewed as a key driver for the business competitiveness, new paradigms, such as business and IT alignment, IT-driven product/service innovation and so on, are regarded as the hot topic in many industries. However, previous studies related to IT evaluation, which is more critical than any other IT activities, have focused on quantitative IT deployment, utilization and its economical effects. Therefore, this study presents the newly-developed evaluation domains and items based on four pairs of relative concepts in industrial informatization, and their multi-dimensional analysis methodology which explains various types of IT characteristics of enterprises. And finally, pilot tests at 2 companies in financial service sector will be performed in order to verify the practicality of the evaluation system.

  • PDF

A Study on development of evaluation indicators on the Managed Security Service(MSS) (보안관제 업무에 대한 평가지표 개발 연구)

  • Lee, Hyundo;Lee, Sangjin
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.22 no.5
    • /
    • pp.1133-1143
    • /
    • 2012
  • Currently, Many Cyber Security Centers(CSC) are established and being operated in our country. But, in the absence of indicators to evaluate activities of the Managed Security Service(MSS), We can't identify the CSC's level of overall job performance. Therefore, we can't derive strengths and weaknesses from the CSC. From these reasons, The purpose of this research is to develop an objective indicator to evaluate activities of the MSS. I studied both international and domestic Information Security Management System(ISMS) as related standards(ISO/IEC 27001, G-ISMS). Moreover, I analysed the NIST Computer Security Incident Handing Guide and the Incident Management Capability Metrics(IMCM) of Carnegie Mellon Software Engineering Institute(SEI). The implications for this analysis and domestic hands-on experience are reflected in the research. So I developed 10 evaluation domains and 62 detail evaluation items. This research will contribute to our understanding the level of the CSC's job performance.

Preliminary Report of Validity for the Infant Comprehensive Evaluation for Neurodevelopmental Delay, a Newly Developed Inventory for Children Aged 12 to 71 Months

  • Hong, Minha;Lee, Kyung-Sook;Park, Jin-Ah;Kang, Ji-Yeon;Shin, Yong Woo;Cho, Young Il;Moon, Duk-Soo;Cho, Seongwoo;Hwangbo, Ram;Lee, Seung Yup;Bahn, Geon Ho
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.33 no.1
    • /
    • pp.16-23
    • /
    • 2022
  • Objectives: Early detection of developmental issues in infants and necessary intervention are important. To identify the comorbid conditions, a comprehensive evaluation is required. The study's objectives were to 1) generate scale items by identifying and eliciting concepts relevant to young children (12-71 months) with developmental delays, 2) develop a comprehensive screening tool for developmental delay and comorbid conditions, and 3) assess the tool's validity and cut-off. Methods: Multidisciplinary experts devised the "Infant Comprehensive Evaluation for Neurodevelopmental Delay (ICEND)," an assessment method that comes in two versions depending on the age of the child: 12-36 months and 37-71 months, through monthly seminars and focused group interviews. The ICEND is composed of three parts: risk factors, resilience factors, and clinical scales. In parts 1 and 2, there were 41 caretakers responded to the questionnaires. Part 3 involved clinicians evaluating ten subscales using 98 and 114 questionnaires for younger and older versions, respectively. The Child Behavior Checklist, Strengths and Difficulties Questionnaire, Infant-Toddler Social Emotional Assessment, and Korean Developmental Screening Test for Infants and Children were employed to analyze concurrent validity with the ICEND. The analyses were performed on both typical and high-risk infants to identify concurrent validity, reliability, and cut-off scores. Results: A total of 296 people participated in the study, with 57 of them being high-risk (19.2%). The Cronbach's alpha was positive (0.533-0.928). In the majority of domains, the ICEND demonstrated a fair discriminatory ability, with a sensitivity of 0.5-0.7 and specificity 0.7-0.9. Conclusion: The ICEND is reliable and valid, indicating its potential as an auxiliary tool for assessing neurodevelopmental delay and comorbid conditions in children aged 12-36 months and 37-71 months.

Development of a Breast Cancer Awareness Scale for Thai Women: Moving towards a Validated Measure

  • Rakkapao, Nitchamon;Promthet, Supannee;Moore, Malcolm A;Hurst, Cameron P
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.2
    • /
    • pp.851-856
    • /
    • 2016
  • Background: Breast cancer is a major health problem among women around the world. Recent developments in screening and treatment have greatly improved the prognosis of patients with breast cancer in developed countries. However, in developing countries breast cancer mortality remains high.Breast cancer awareness is a first and important step in reducing breast cancer mortality. The development of a validated instrument to measure breast cancer awareness is crucial for the understanding and implementation of suitable health education programs to facilitate early deletion and minimize mortality. Objective: The objective of this study was to develop an instrument for the assessment of breast cancer awareness in Thai women. Materials and Methods: This methodological study was conducted in two stages: (1) literature searches and semi-structured interviews were conducted to generate items of the breast cancer awareness scale (B-CAS) which were subsequently examined for content and face validity, and (2) an exploration of the factor structure of the resulting instrument and an examination of its reliability. Data were collected using a self-administered questionnaire in Thai women aged 20-64 in August, 2015. Results: A total of 219 women (response rate 97.4 %) participated in this validation study. The B-CAS contains five domains with 53 items on breast cancer awareness: 1) knowledge of risk factors, 2) knowledge of signs and symptoms, 3) attitude to breast cancer prevention, 4) barriers of breast screening, and 5) health behavior related to breast cancer awareness. Items with a content validity index < 0.80 were excluded, and factor structure for the remaining items reflected the hypothesized five factor model. The scales based on all retained items was shown to have strongly internal consistency reliability (Cronbach's ${\alpha}=0.86$). Conclusions: The B-CAS provides good psychometric properties to assess breast cancer awareness in women. It can be used to examine breast cancer awareness in Thai women and it could lead to the development and evaluation of suitable educational interventions for raising breast cancer awareness. Future research should focus on further validating the B-CAS including an assessment of construct and criterion-based validity.

Development of a Questionnaire to Measure Resilience in Children with Chronic Diseases (만성질환아의 극복력(Resilience) 측정도구 개발)

  • Kim, Dong-Hee;Yoo, Il-Young
    • Journal of Korean Academy of Nursing
    • /
    • v.40 no.2
    • /
    • pp.236-246
    • /
    • 2010
  • Purpose: The purpose of this study was to develop and evaluate a Korean questionnaire to measure resilience in children with chronic illness. Methods: Item construction was drawn from an extensive review of the literature, existing questionnaires and interviews with parents. Content validity was tested by experts. To further refine the questionnaire and test its reliability and validity, data were collected from the 202 children with asthma, diabetes mellitus or nephrotic syndrome. Corrected items were used to total correlation coefficient and test-retest reliability. Questionnaire testing was conducted using factor analysis, Cronbach's $\alpha$, and correlation coefficients. Validity of the questionnaire was tested using internal consistency, construct validity, and criterion-related validity. Results: Components of the questionnaire were in three domains; interpersonal characteristics, characteristics of coping, and intrapersonal characteristics. Factor analysis is showed five factors; positive self-understanding, self-reliance, resourcefulness, perception of positive family relationships, and intimacy. The questionnaire showed a high internal consistency. A significant positive correlation with the Numerical Rating Score and negative correlation with the Child Depression Inventory support the validity of the questionnaire. Conclusion: This instrument demonstrated high reliability and validity. Therefore, this instrument can contribute to the evaluation of resilience of chronically ill children and to any subsequent intervention as well as to develop a theory for resilience.

The Economic Evaluation of the Public Values of Agriculture and Rural Area in Korea (농업·농촌의 공익적 가치에 대한 경제적 평가)

  • Kim, Yong-Lyoul;Jeong, Hak-Kyun;Heo, Joo-Nyung
    • Journal of Korean Society of Rural Planning
    • /
    • v.20 no.4
    • /
    • pp.101-112
    • /
    • 2014
  • The public value of agriculture and rural areas is closely associated with the concept of multifunctionality of agriculture and rural areas, which in turn signifies economic values other than the production function of agriculture and rural areas. Based on the survey results, virtual scenarios were set up and the contingent valuation method (CVM) was used to estimate the amount consumers are willing to pay (WTP) for the public functions of agriculture and rural areas. This study selected five domains of the public value (environment conservation, maintenance of landscape and cultural tradition, enhancement of national prestige, local community maintenance and socio-economic functions, and food security) and 21 value items as components of the public value. An economic assessment of the public value of agriculture and rural areas was conducted using a binomial logistic regression model. The estimation results showed that the public value consumers are willing to pay ranges from a minimum of 6,346.8 billion won to a maximum of 9,327.2 billion won.

A Study on the Characteristics of Academic Achievement in Problem Solving and Inquiry Tasks of Korean Fourth Graders in TIMSS 2019 (TIMSS 2019 문제해결 및 탐구 과제에 대한 우리나라 초등학교 4학년 학생들의 학업성취 특성 분석)

  • Jeom-Rae Kwon
    • Journal of Science Education
    • /
    • v.48 no.1
    • /
    • pp.31-46
    • /
    • 2024
  • This study analyzes the academic achievement characteristics of Korean fourth graders on the problem solving and inquiry tasks (PSIs) introduced in TIMSS 2019. TIMSS 2019 conducted a computer-based assessment in addition to the traditional paper-based assessment. The PSIs were included only in the computer-based assessment, so 30 countries participated in the PSIs of the computer-based assessment. PSIs consist of integrating multiple content and cognitive domains, including 10 or fewer items. Most of the items are constructed in an open-ended format rather than multiple-choice. The analysis results showed that there were differences in student achievement across countries depending on the inclusion of PSIs. Korea's average achievement score decreased by 1 point. The analysis of individual items showed that students' achievement was somewhat low, and the correct answer rate for male students was generally higher than that for female students in many items. Furthermore, item-by-item analysis revealed that there were items where countries such as England and Finland had higher correct answer rates than traditional high-achieving countries, i.e. Singapore, Taiwan, and Korea. Considering the recent emphasis on integrated education, it seems necessary to review the use of PSIs in assessments in Korea as well.

Development of a Scale to measure the Effectiveness of Oriental Nursing Education (한방간호교육의 평가 도구 개발)

  • Han Sang-Sook;Kim Won-Ock;Hyun Kyung-Sun;Won Jeong-Sook;Lee Jong-Soo
    • Journal of Korean Academy of Nursing
    • /
    • v.35 no.2
    • /
    • pp.362-371
    • /
    • 2005
  • Purpose: The aim of this study was to design and evaluate a scale for measuring reliability and validity in the field of oriental nursing education. Method: A questionnaire was administered to 495 university nursing students using a convenience sampling method. The period of time for collecting data was from September 2003 to January 2004. Result: The derived outcome tool consisted of 6 factors and 22 inquires on the basis of a conceptual frame of three domains (knowledge, attitude, and skill), As a result of the item analysis, 22 items were selected and the internal consistency alpha coefficient was .767. The value of Cronbach' Alpha of knowledge(factor 1) was .885, attitude(factor2)was .756, and skill (factor 3) was .610. The three factors accounted for $65.110\%$ of the variance in the total scale. Addressing the explanatory variance of each domain Cognitive domain was $22.477\%$, affective domain was $20.543\%$, and psychomotor domain was $17.090\%$. Conclusion: Further studies need to be done to verify educational evaluation and apply our outcomes to oriental nursing education.

Development and Evaluation of a Patient-Reported Outcome (PRO) Scale for Breast Cancer

  • Zhang, Jun;Yao, Yu-Feng;Zha, Xiao-Ming;Pan, Li-Qun;Bian, Wei-He;Tang, Jin Hai
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.16 no.18
    • /
    • pp.8573-8578
    • /
    • 2016
  • Background: This study was guided by principles of the theoretical system of evidence-based medicine. In particular, when searching for evidence of breast cancer, a measuring scale is an instrument for evaluating curative effects in accordance with the laws and characteristics of medicine and exploring the establishment of a system for medically assessing curative effects. At present, there exist few tools for evaluating curative effects. Patient-reported outcomes (PROs) refer to outcomes directly reported by patients (without input or explanations from doctors or other intermediaries) with respect to all aspects of their health. Data obtained from PROs provide evidence of treatment effects. Materials and Methods: In accordance with the tenets of theoretical medicine and ancient medical theory regarding breast cancer, principles for developing a PRO scale were established, and a theoretical model was developed and a literature review was performed, items from this pool were combined and split, and an initial scale was constructed. After a pilot survey and additional modifications, a pre-questionnaire scale was formed and used in a field investigation. After the application of statistical methods, the item pool was used to create a formal scale. The reliability, validity and feasibility of this formal scale were then assessed. Results: In a clinical investigation, 479 responses were recovered, with an acceptance rate of 95%. a combination of various methods was employed, and the items that were selected by all methods or more than half of the methods were employed in the questionnaire. In these cases, the screening methods were combined with certain features of the item, A total of four domains and 38 items were reserved. The reliability analysis indicated that the PRO scale was relatively reliable. Conclusions: Scientific assessment proved that the proposed scale exhibited good reliability and validity. This scale was readily accepted and could be used to assess the curative effects of medical therapy. However, given the limited scope of this investigation, the capacity for adapting this scale to incorporate other theories could not be determined.