• Title/Summary/Keyword: Evaluation Domains and Items

Search Result 83, Processing Time 0.03 seconds

A Study on the Development of Teaching Evaluation Indicators for Faculty in Engineering College (공과대학 교수의 교육업적평가 지표 개발 연구)

  • Kang, So Yeon;Choi, Keum Jin;Park, Sun Hee;Han, Jiyoung;Lee, Hyemi;Cho, Sung Hee
    • Journal of Engineering Education Research
    • /
    • v.20 no.4
    • /
    • pp.38-50
    • /
    • 2017
  • The purpose of this study is to analyze the current evaluation methods on faculty performance at Korean engineering colleges and develop teaching evaluation indicators for faculty performance. We investigated the faculty performance cases in engineering colleges inside and outside of the Korea, the engineering faculty's awareness of evaluation factors for their educational performance, and the appropriate ratios by indicating factors. Also we developed evaluation indicators for educational achievements to improve the current faculty performance system. 227 engineering faculty members answered our survey questionnaire. The result in the case study on faculty performance evaluation is as follows. First, most items of faculty performance evaluation are about quantitative indicators that can easily conduct objective evaluation. Second, evaluation items of faculty performance are mostly focused on instruction in a classroom. Third, the evaluation by students and administrative managers is more dominant than that by professors or their colleagues, document evaluation than on site evaluation, general evaluation than formative evaluation, and static evaluation than dynamic evaluation. Lastly, Some universities tend to substitute outstanding articles for underperforming instruction. The evaluation indicators that we have developed can be implemented by four types of subjects, such as students, professors, their colleagues, and deans. Also, based on the evaluation indicators, faculties can freely select their evaluation domains depending on the their tracks, such as a teaching track, a research track, or an industry-university cooperation track. The mandatory evaluation fields include teaching, student counselling, teaching portfolio evaluation by mentors or colleagues, class management evaluation by deans, and self-evaluation. The other areas are optional and professors can choose their evaluation factors.

Developing and Applying Usability Testing Instrument to Improve the VR-based Mobile Application for Maker Education (VR 기반 메이커 교육용 모바일 앱 개선을 위한 사용성 평가 도구 개발 및 적용)

  • Park, Taejung;Cha, Hyunjin
    • Journal of Information Technology Services
    • /
    • v.21 no.2
    • /
    • pp.127-143
    • /
    • 2022
  • In this study, a usability evaluation tool was developed for "ICANDUINO", a VR-based mobile application for maker education, and usability evaluation was conducted with a heuristic survey method for experts. The usability evaluation tool was derived through literature review and validated by two experts. It consisted of seven domains (effectiveness, efficiency, satisfaction, learnability, memorability, error, and cognitive load) and twenty-five sub-items. As a result of the usability evaluation conducted for six experts, it received the highest score in the domain of efficiency and the lowest score in the domain of error. The improvements of ICANDUINO were derived by analyzing the qualitative opinions of experts in each of the four stages (training, coding, tinkering, and testing) of making. the results of this study can be used as a guideline when evaluating the usability of a mobile app for education.

The Development of a Quality Assessment Tool for the Process of Health Promotion Programs at Public Health Centers (보건소 건강증진사업 수행과정의 질 평가지표 개발 -고혈압관리사업에서의 타당도 검증-)

  • 서영준;정애숙;박태선;이규식
    • Health Policy and Management
    • /
    • v.13 no.3
    • /
    • pp.35-51
    • /
    • 2003
  • This study purports to develop a quality assessment tool for the process of health promotion programs at public health centers(PHC). The draft of the assessment tool developed by the literature was distributed to 242 staffs who were in charge of the health promotion programs at PHCs for evaluating the feasibility of the tool on September and October 2002. The major results of the study were as follows; The quality assessment tool developed in the study consisted of four domains: strategic planning, program management, monitoring and evaluation, and resources and information. The strategic planning dealt with the function of the planning staff and committees, community data analysis, the feasibility of the program, and the approach methods for attaining the goal of the program. The program management included the items on the qualification and power of the program staff. The monitoring and evaluation included the items on the reporting and communication among program units, and feed back after monitoring. Finally, the resources and information dealt with community networking, clients' response, and consulting activity of the staff. The validity of the tools was tested and partly supported by both formative and criterion-related methods. The assessment tools developed in this study could be used by health promotion workers in the self-evaluation of the program quality. In conclusion, the quality assessment tool developed in the study will be a good safeguard for assuring the quality of the process of health promotion programs.

Development of an Evaluation Scale of Internet Shopping Mall Sites (인터넷 쇼핑몰사이트 평가 척도 개발)

  • 김기옥;남수정
    • Journal of Families and Better Life
    • /
    • v.22 no.4
    • /
    • pp.15-27
    • /
    • 2004
  • This study investigated the factors in evaluating internet shopping mall sites, and developed a self-report evaluation scale of such sites, This article identifies factors to determine criteria for evaluating the sites from the consumers' viewpoint. Eighty three items were extracted initially, which were then categorized as follows: \circled1 Type of business, \circled2 Navigation ease, \circled3 Technological level, \circled4 Design of sites, \circled5 Communication ease, \circled6 Information available, \circled7 Ease of access, and \circled8 Site security, Overall reliability coefficients were high in the individual domains ($\alpha$=.86 to $\alpha$=.95). Face validity and contents validity were demonstrated to be good, There were significant differences in the means of these categories. The results also show that the technological level is the most important in shopping mall sites evaluation. These results may be used not only as a tool to evaluate shopping mall sites but also as a guideline to improve the quality of a shopping mall site that is under development.

Development and Validation of the Core Competency Evaluation Tool for New Graduate Nurse's Preceptor (신규간호사 프리셉터의 핵심역략 평가도구 개발)

  • Kwon, In-Gak;Jung, Kyoung-Hee;Cho, Hye-Sool;Hwang, Ji-Won;Kim, Ji-Young;Jeon, Kyoung-Ok;Sung, Young-Hee
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.8 no.4
    • /
    • pp.535-549
    • /
    • 2002
  • Purpose : The purpose of this study was to develop a core competency evaluation tool of the preceptors training new graduate nurses and to determine the validity of the developed instrument. Method : This study was conducted in 2 phases. In phase I, preceptor's core competency list was developed through literature review, focus group interview, and review by nursing directors and nurse managers. In phase II, 60 preceptors were evaluated with the developed instrument and categorized into excellent, good & poor core competency groups. For validation of the instrument, new graduates' clinical performance improvement and satisfaction with preceptor were compared between excellent and poor group. Result : The data were analyzed by SPSS P.C and the results were as follows. 1) Preceptor's core competencies were classified into three domains; Role model(10 items), Socialization facilitator(8 items), and Educator(16 items), and each item had four point system of "strongly agree" to "strongly disagree". Cronbach'${\alpha}$ of the instrument was.9416. 2) Comparison of clinical performance improvement and satisfaction with preceptor of the new graduates trained by excellent and poor preceptors revealed that new graduates' clinical performance improvement(p=.015) and satisfaction with the preceptor(p=.005) were significantly higher in the excellent core competency preceptor group than the poor core competency preceptor group. Conclusion : The validity of the preceptor's core competency evaluation tool developed in this study was confirmed. Therefore, this tool can be effectively utilized for education and evaluation of new graduates' preceptors in clinical settings.

  • PDF

A Research on the development of evaluation model for the government's recognition regarding the program accrediting organizations in Higher Education (고등교육 프로그램 평가인증기관의 정부인정 평가모형 개발에 관한 연구)

  • Kim, Kyung-Soo;Hwang, Myung-Ku;Lee, Tae-Hee
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.1
    • /
    • pp.87-98
    • /
    • 2012
  • The Ministry of Education, Science and Technology has been implementing the government's recognition project regarding the program accrediting organizations in Higher Education. This research is to establish an evaluation model for the government's recognition process of the program accrediting organizations, and develop the evaluation categories, items and indices for the model. The research has set the concept for the government's recognition regarding the program accrediting organizations and designed an evaluation model for such organizations. The evaluation model embraces a preliminary evaluation process, assessing an eligibility of the accrediting organizations for the higher education based on the formalities set forth for the government recognition organization accrediting process. It also includes the main evaluation process, which assess the eligibility based on the evaluation standards stipulated in the associated legislation and regulations. In addition, through in-depth verification processes by experts, this research finalized 2 evaluation domains, 5 evaluation categories, 24 evaluation items and 33 evaluation indices.

Exploring the Relationship Between International Classification of Functioning, Disability, and Health Items Linked to Clinical Assessments in Children With Cerebral Palsy

  • Park, Sang-Duk;Yi, Sook-Hee;Kim, Jeong-Soo
    • Physical Therapy Korea
    • /
    • v.28 no.4
    • /
    • pp.245-250
    • /
    • 2021
  • Background: The International Classification of Functioning, Disability, and Health-Child and Youth version (ICF-CY) is designed to record the characteristics of developing children and examine the influence of a child's environment on their health. Objects: This study was designed to determine the relationship between the clinically extracted ICF-CY items and The Pediatric Evaluation of Disability Inventory (PEDI) and Gross Motor Function Measure (GMFM) items. Methods: Thirty patients (17 males and 13 females) who were hospitalized in a pediatric and youth patient unit of a rehabilitation hospital were included in the study. Four health professionals (two physical therapists and two occupational therapists) working independently linked the PEDI and GMFM-66 items to the activity and participation domains of the ICF-CY. Results: There were strong negative correlations between the ICF-CY subdomains and the PEDI subdomains (r = 0.76-0.95; p < 0.05). There were positive strong correlations between the ICF-CY subdomains and the GMFM-66 (r = 0.76-0.95; p < 0.05). Conclusion: The extracted ICF codes were a valid tool for evaluating the mobility and selfcare conditions of cerebral palsy in the pediatric rehabilitation area.

Evaluation of Concordance between Learning Outcomes of Basic Medical Education Courses and Assessment Items of the Medical Licensing Examination (기본의학교육과정의 학습성과와 의사 국가시험 평가목표의 일치도 분석)

  • Kim, Na Jin;Park, In Ae;Kim, Eun Ju;Baek, Seung Ae;Kwon, Nani;Lee, Hye In;Kim, Su Young
    • Korean Medical Education Review
    • /
    • v.17 no.1
    • /
    • pp.33-38
    • /
    • 2015
  • During the education reform in 2009, the Catholic University of Korea College of Medicine (CUMC) adopted body systems as the basis for structuring basic medical education. After running the new program for 5 years, we need to evaluate the program by comparing it with nationwide standards. This study was designed to evaluate the coverage of our basic medical education program by comparing it with the assessment items of the medical licensing examination for physicians in the Republic of Korea. We built a relational database populated with 3,017 learning outcomes from all the courses on basic medical education. We tagged each learning outcome according to 2 criteria: 206 physician encounters and 9 outcome domains. A majority of the learning outcomes were in the domains of 'knowledge' and 'critical thinking'. In addition, we repeated the categorization process with 584 assessment items of the medical licensing examination in the Republic of Korea and compared them with the categorization results of the learning outcomes. Among the 206 physician encounters, we found that outcomes on family violence and sexual violence were missing in the learning outcomes of CUMC. Eighty-two physician encounters were associated with more than one outcome domain, and 96 physician encounters were covered in more than one course. Twenty-one physician encounters were repeated in 5 or more courses and 34 physician encounters had outcomes categorized into 3 or more domains. Thus, we showed that the 2-way categorization could be applied to the comparison and evaluation of two different education formats.

A basic research for evaluation of a Home Care Nursing Delivery System (가정간호 서비스 질 평가를 위한 도구개발연구)

  • Kim, Mo-Im;Cho, Won-Jung;Kim, Eui-Sook;Kim, Sung-Kyu;Chang, Soon-Bok;Ryu, Ho-Sihn
    • Journal of Home Health Care Nursing
    • /
    • v.6
    • /
    • pp.33-45
    • /
    • 1999
  • The purpose of this study was to develop a basic framework and criteria for evaluation of quality care provided to patients with the attributes of disease in the home care nursing field, and to provide measurement tools for home health care in the future. The study design was a developmental study for evaluation of hospital-based HCN(home care nursing) in Korea. The study process was as follows: a home care nursing study team of College of Nursing. Yonsei University reviewed the nursing records of 47 patients who were enrolled at Yonsei University Medical Center Home Care Center in March, 1995. Twenty-five patients were insured at that time, were selected from 47 patients receiving home care service for study feasibility with six disease groups; Caesarean Section (C/S), simple nephrectomy, Liver cirrhosis(LC), chronic obstructive pulmonary disease(COPD), Lung cancer or cerebrovascular accident(CVA). In this study, the following items were selected : First step : Preliminary study 1. Criteria and items were selected on the basis of related literature on each disease area. 2. Items were identified by home care nurses. 3. A physician in charge reviewed the criteria and content of selected items. 4. Items were revised through preliminary study offered to both HCN patients and discharged patients from the home care center. Second step : Pretest 1. To verify the content of the items, a pretest was conducted with 18 patients of which there were three patients in each of the six selected disease groups. Third step : Test of reliability and validity of tools 1. Using the collected data from 25 patients with either cis, Simple nephrectomy, LC, COPD, Lung cancer, or CVA. the final items were revised through a panel discussion among experts in medical care who were researchers, doctors, or nurses. 2. Reliability and validity of the completed tool were verified with both inpatients and HCN patients in each of field for researches. The study results are as follows: 1. Standard for discharge with HCN referral The referral standard for home care, which included criteria for discharge with HCN referral and criteria leaving the hospital were established. These were developed through content analysis from the results of an open-ended questionnaire to related doctors concerning characteristic for discharge with HCN referral for each of the disease groups. The final criteria was decided by discussion among the researchers. 2. Instrument for measurement of health statusPatient health status was measured pre and post home care by direct observation and interview with an open-ended questionnaire which consisted of 61 items based on Gorden's nursing diagnosis classification. These included seven items on health knowledge and health management, eight items on nutrition and metabolism, three items on elimination, five items on activity and exercise, seven items on perception and cognition, three items on sleep and rest, three items on self-perception, three items on role and interpersonal relations, five items on sexuality and reproduction, five items on coping and stress, four items on value and religion, three items on family. and three items on facilities and environment. 3. Instrument for measurement of self-care The instrument for self-care measurement was classified with scales according to the attributes of the disease. Each scale measured understanding level and practice level by a Yes or No scale. Understanding level was measured by interview but practice level was measured by both observation and interview. Items for self-care measurement included 14 for patients with a CVA, five for women who had a cis, ten for patients with lung cancer, 12 for patients with COPD, five for patients with a simple nephrectomy, and 11 for patients with LC. 4. Record for follow-up management This included (1) OPD visit sheet, (2) ER visit form, (3) complications problem form, (4) readmission sheet. and (5) visit note for others medical centers which included visit date, reason for visit, patient name, caregivers, sex, age, time and cost required for visit, and traffic expenses, that is, there were open-end items that investigated OPD visits, emergency room visits, the problem and solution of complications, readmissions and visits to other medical institution to measure health problems and expenditures during the follow up period. 5. Instrument to measure patients satisfaction The satisfaction measurement instrument by Reisseer(1975) was referred to for the development of a tool to measure patient home care satisfaction. The instrument was an open-ended questionnaire which consisted of 11 domains; treatment, nursing care, information, time consumption, accessibility, rapidity, treatment skill, service relevance, attitude, satisfaction factors, dissatisfaction factors, overall satisfaction about nursing care, and others. In conclusion, Five evaluation instruments were developed for home care nursing. These were (1)standard for discharge with HCN referral. (2)instrument for measurement of health status, (3)instrument for measurement of self-care. (4)record for follow-up management, and (5)instrument to measure patient satisfaction. Also, the five instruments can be used to evaluate the effectiveness of the service to assure quality. Further research is needed to increase the reliability and validity of instrument through a community-based HCN evaluation.

  • PDF

Development of the Thai Elderly Resilience Scale: TERS

  • Maneerat, Sonthaya;Isaramalai, Sang-arun;Boonyasopun, Umaporn
    • Asian Journal for Public Opinion Research
    • /
    • v.7 no.1
    • /
    • pp.40-56
    • /
    • 2019
  • This study aimed to develop and evaluate the psychometric properties of the Thai Elderly Resilience Scale (TERS). Its conceptual structure consists of three identified domains, I AM, I HAVE, and I CAN, within the 18 components that were initially used for developing the item pool. The first draft of the scale consisted of 50 items. A psychometric evaluation of content validity reliability and construct validity was conducted. The results yielded the current version of the TERS based on Exploratory Factor Analysis (EFA) consisting of 24 items categorized into 5 factors: 1) being able to join other people, 2) being confident in life 3) have social support 4) living with spiritual security and 5) being able to de-stress and manage problems. The scale had a high internal consistency (${\alpha}=.94$). A strong positive correlation between resilience and mental health scores were found (r=.84, p<.01, n=30). The newly developed TERS would be a useful tool to assess resilience in Thai elderly and can be applied to develop further studies regarding elderly Thai people.