• Title/Summary/Keyword: Competency evaluation

Search Result 553, Processing Time 0.027 seconds

Multifaceted validity analysis of clinical skills test in the educational field setting (교육 현장에서 시행된 임상 술기 시험의 다면적 타당도 분석)

  • Han Chae;Min-jung Lee;Myung-Ho Kim;Kyuseok Kim;Eunbyul Cho
    • The Journal of Korean Medicine
    • /
    • v.45 no.1
    • /
    • pp.1-16
    • /
    • 2024
  • Introduction: The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods. Methods: In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years. Results: The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem. Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.

A Study on Fitness Evaluation for Major Education of Competency Unit Element by the Development and Application of Subject Contents Based on NCS of Health Majoring Students at Junior Colleges (전문대학 보건계열학과 전공학생의 NCS 기반 교과내용 개발 적용에 따른 직무능력 단위요소의 전공교육 적합성 평가)

  • Kim, Min-Ja;Yang, Hee-Jung
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.8
    • /
    • pp.508-516
    • /
    • 2016
  • This study was conducted to investigate the fitness of major courses according to the development and application of new curricula based on the NCS (National Competency Standards) of health-related departments at junior colleges. To accomplish this, 300 students of the health-related departments at junior colleges were surveyed from March 11 to March 30, 2016. The overall findings showed that their awareness of NCS, intent of integration and understanding of curriculum contents had a significant effect on the fitness for linkage and combination with existing education. Competency unit elements based on the newly developed NCS (job, work, qualification and training standardization of major courses) were linked with existing education. And students - who accept this - are rapidly assimilated into the new curriculum contents. In particular, they have a high understanding of the integrated development of standardized curricula between three major departments, unlike existing textbooks. In conclusion, the high perception and understanding of knowledge integration education are expected to have a positive effect on healthcare education, establishing an early health-related NCS system in the future, and improving site fitness for development of the contents of NCS.

Lip Closing Force and the Related Factors in Elementary School Children (초등학교 어린이의 평균 구순폐쇄력과 이에 영향을 미치는 요소)

  • Lee, Haney;Baek, Kyounghee;Kim, Jaegon;Lee, Daewoo;Yang, Yeonmi
    • Journal of the korean academy of Pediatric Dentistry
    • /
    • v.46 no.4
    • /
    • pp.343-352
    • /
    • 2019
  • Abnormal orofacial functions such as lip incompetency in the period of growth and development can cause morphological anomalies of the craniofacial complex. Therefore, it is crucial to make an early diagnosis based on the evaluation of the myofunctional conditions, and to make appropriate treatment plans. The objectives of this study were to quantitatively evaluate the standard lip closing force (LCF) of each age in the elementary school children, and to evaluate the relationships between LCF and affecting factors. The sample consisted of 765 children who were 7 - 12 years old in Jeonju city. Clinical examination about occlusal conditions and lip competency, and LCF measurement were performed by a single examiner. LCF was measured three times for each children with the LCF measuring device. The LCF was correlated positively with age in both sexes. The distribution of LCF groups was correlated significantly with Angle's classes and lip competency (p = 0.016, 0.004). The proportion of children with high LCFs was greater in the "competent lip" group, whereas the proportion of those with low LCFs was greater in the "incompetent lip" group.

A study on career competency, task and job satisfaction of dental hygienists - Focusing on public officials, public institution workers, and researchers (치과위생사 취업 역량, 업무, 직무만족에 관한 연구 - 공무원·공기업 취업자·연구원 중심으로)

  • Jeong, So-Hyeon;Nam, Sang-Hee;Park, Ji-Hyeon;Shin, Eun-Ji;Oh, Na-Won;Yu, Ha-Rim;Kim, SeolHee
    • Journal of Korean society of Dental Hygiene
    • /
    • v.18 no.4
    • /
    • pp.477-488
    • /
    • 2018
  • Objectives: The purpose of this study was to investigate career competency, tasks, and job satisfaction of public servants, public institutions, and researchers. Methods: The survey was conducted about career competency, job satisfaction, and satisfaction on work life. Next, they interviewed on the characteristics of each job by two or three dimensions. The following conclusions were obtained from July to August 2017. Results: Career competencies were GPA with 3.87, 818 points of TOEIC score, and ITQ certification. Public servants required the information on literacy skills for employment and job performance, while civil servants need more than one year of clinical experience in the dental hospital. The non-commissioned officer needed a written test and fitness training. The health insurance review and assessment center required more than one year of experience from general hospital or medical institutions. Researchers required a research career, language skill, and professors required research and teaching experiences with clinical experience more than three years. The main job tasks were as follows; for public servants, they were official document processing and community projects. For the civilian workers and military/noncommissioned officers, they were medical assistant and administrative works. The employees of the health insurance review and assessment service are examining the medical expenses and the medical examination, the researchers are experimenting, researching and writing articles, and the teaching staff are lecturing and conducting individual research. Conclusions: The results of job satisfaction survey showed that occupational satisfaction was the highest in civil servants, researchers, and teaching professions. Job security was the highest in health workers and health inspectors' evaluation centers, and time vacancy was the highest in civilian workers and military/noncommissioned officers. If you want to work in such an institution, you should prepare elements that match your basic literacy and job specific characteristics. And we should try to increase the satisfaction of work even after work.

Effects of Working Competency of Local Child Centers on the Quality of Service for Children: The Mediation Effect of Self-Efficiency (지역아동센터 종사자의 업무 역량이 아동서비스의 질에 미치는 영향: 자기효능감의 매개효과)

  • Park, Woon-ju
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.1
    • /
    • pp.590-602
    • /
    • 2021
  • This study was originated from the idea that it would be important for caring service of community children center to be positioned as the institution to strengthen the public nature and provide quality care services to children. In particular, competencies of the employees in community children centers play an important role and the quality of children care services is the crucial evaluation parameter for those institutions. The objectives of this study are to investigate the effects of the competency levels of the employees in community children centers on the service quality to children and to verify the mediated effect of self-efficacy on their service quality to children. With respect to the data analysis methods, hierarchical regression analysis was performed. Barron & Kenny's method was used to understand the mediated effect of self-efficacy. Also, Sobel test was performed to investigate the significance of mediated effect of self-efficacy. The study results are, first, the service quality to children might be differed by the level of competencies of the employees in community children centers; and second, partial mediated effect of self-efficacy was found between their competencies and service quality to children. These results implicate that service quality to children can be improved by strengthening competencies of the employees in community children centers and enhancing their self-efficacy. It is necessary to try to improve the service quality by enhancing competencies and self-efficacy of the employees in community children centers, which will lead those institutions to play a crucial role in the caring services.

The Effects of Chemistry Class Using Computer-Based Science Inquiry Program on Positive Experiences about Science, Science Core Competency, and Academic Achievement (컴퓨터 기반 과학 탐구 프로그램을 활용한 화학 수업이 과학 긍정경험, 과학과 핵심역량 및 학업성취도에 미치는 영향)

  • Kim, Sungki;Kim, Hyunjung
    • Journal of the Korean Chemical Society
    • /
    • v.66 no.2
    • /
    • pp.107-123
    • /
    • 2022
  • The purpose of this study is to investigate the effects of learning using computer-based science inquiry program. To this end, the three lessons computer-based science inquiry were developed in domain of material's properties. The developed program was put into K middle school located in Seoul and the effects were verified. For the experimental group, the three lessons computer-based science inquiry related to the separation of mixture were introduced, and for the comparison group, the contents presented in the textbook were introduced as a teacher-centered teaching method. To verify the effects of the program, 2-way ANCOVA was performed on positive experiences about science and science core competency, and 2-way ANOVA was performed on academic achievement. As a result of the study, there were significant differences between the two groups in positive experiernces about science and scientific core competencies and academic achievement (p<.05), and group*gender interaction effect was only significant in academic achievement (p<.05). From the results of this study, we could see the possibility of using a computer-based science inquiry program as a chemistry teaching method that enables sustainable scientific inquiry.

Insights from edTPA in the United States on assessing professional competencies of preservice mathematics teachers (미국 edTPA 평가에서 요구하는 예비 수학 교사의 전문적 역량 분석)

  • Kwon, Oh Nam;Kwon, Minsung;Lim, Brian S.;Mun, Jin;Jung, Won;Cho, Hangyun;Lee, Kyungwon
    • The Mathematical Education
    • /
    • v.62 no.2
    • /
    • pp.211-236
    • /
    • 2023
  • The purpose of this study is to derive implications of preservice mathematics teacher education in Korea by analyzing the case of edTPA used in the preservice teacher training process in the United States. Recently, there has been a growing interest in promoting professional competencies considering not only the cognitive dimension related to knowledge development of preservice mathematics teachers but also the situational dimension considering reality in the classroom. The edTPA in the United States is a performance-based assessment based on lessons conducted by preservice teachers at school. This study analyzes the professional competencies required of preservice mathematics teachers by analyzing handbooks that described the case of edTPA in which preservice mathematics teachers in the United States participate. The edTPA includes planning, instruction, and assessment tasks, and continuous tasks are performed in connection with classes. Thus, the analysis is conducted on the points of linkage between the description of evaluation items and criteria in the planning, instruction, and assessment tasks, as well as the professional competencies required from that linkage. As a result of analyzing the edTPA handbooks, the professional competencies required of preservice mathematics teachers in the edTPA assessment were the competency to focus on and implement specific mathematics lessons, the competency to reflectively understand the implementation and assessment of specific mathematics lessons, and the competency to make a progressive determination of students' achievement related to their learning and their uses of language and representations. The results of this analysis can be used as constructs for competencies that can be assessed in the preservice in the organization of the preservice mathematics teacher curriculum and practice training semester system in Korea.

Analysis of the Perceptions of Teachers about Effective Application of National Competency Standards Based Vocational Education Curriculum in Technical Specialized High Schools and Meister High Schools (공업계 특성화고·마이스터고에서의 NCS 기반 직업교육과정의 효과적인 적용에 대한 전문교과 교원의 인식 및 요구 분석 연구)

  • Lee, Byung-Wook;Ahn, Jae-Yeong;Kang, Chol-Min
    • 대한공업교육학회지
    • /
    • v.40 no.2
    • /
    • pp.111-129
    • /
    • 2015
  • This study tried to investigate the possibility and expectation effect to organize and operate NCS(national competency standards)-based vocational education curriculum in technical specialized high schools and meister high schools and the perceptions of specialty subject teachers about support plans for effective operation of the NCS-based curriculum. For this, the survey was conducted targeting 286 specialty subject teachers in technical specialized high schools and meister high schools. And the results are as follow: First, the specialty subject teachers in the technical specialized high schools and meister high schools recognized that the positive expectation effect can be obtained through the NCS-based vocational education curriculum and the NCS-based vocational education curriculum should very much be applied to the school curriculum but it is impractical to organize and operate the NCS-based vocational education curriculum as the school curriculum from 2016. Second, the specialty subject teachers in the technical specialized high schools and meister high schools recognized that industrial education needs can be analyzed, industry duties-based educational objectives and contents can be set up, industrial duties-based education can be done, the capability to develop and operate teachers' curriculum can be improved, and the NCS-based curriculum will be effective for industrial and academic cooperation and connection with communities by applying it but the realistic possibility will relatively be low. Third, the specialty subject teachers in the technical specialized high schools and meister high schools recognized that tools for practice should be reorganized and expanded, the number of students targeting practical classes should be reduced by 15 to 20 persons, teachers' field education capability should be strengthened, supply and demand of teachers should be supported, industrial and academic cooperation-based field-centered education should be reinforced, and support of the NCS-based teaching materials to be textbooks should be required in terms of operating schools to operate the NCS-based vocational curriculum effectively. Support of finding jobs and field education which correspond with the NCS-based vocational curriculum should be provided, field instruction by ability of the national competency standards should be supported, field practice education projects about the NCS-based vocational curriculum should be provided and introduction and operation of the industrial employee performance evaluation system should be required in terms of the support plans of relevant organizations.

Contents analysis of the community dental hygiene practice outcome evaluation (지역사회치위생학 현장(보건소)실습 성과평가 내용분석)

  • Lee, Ga-Yeong;Han, Yang-Keum;Kim, Young-Kyung;Lim, Hyun-Ju;Kown, Yang-Ok;Kim, Han-Mi;Park, Jeong-Ran;Kim, Nam-Hee
    • Journal of Korean society of Dental Hygiene
    • /
    • v.16 no.1
    • /
    • pp.37-43
    • /
    • 2016
  • Objectives: The purpose of the study is to evaluate the contents analysis of the community dental hygiene practice in the dental hygiene students and suggest the outcome based evaluation index of community dental hygiene practice. This study will provide the basic data for the community nursing and social welfare practice. Methods: A self-reported questionnaire was completed by 82 dental hygiene professors and 254 dental hygienists in community health centers after receiving informed consent based on institutional review board from 5th Dec 2014 to 30th Jul 2015. A total of 49 professors and 134 dental hygienists gave the complete answers. The study instrument was adapted from the literature review. The questionnaire consisted of evaluation, purpose of evaluation, and evaluation format. Data were analyzed using SPSS 20.0 program. The contents analysis was carried out through input, process, output, and outcome. Results: The practice outcome evaluation was conducted in 62.9% of the dental hygiene departments and 32.9% of the community health centers. Most of the dental hygiene professors chose "To know what students learned(27.3%)" and "To ensure student's role and behavior in practice(27.3%)." as the purpose of evaluation. The public dental hygienists chose "To score the practice grade(42.1%)." The evaluation method was done anonymously. Conclusions: The outcome based evaluation in community dental hygiene practice was the best method to evaluate the practice education for the competency of the dental hygiene students.

A study on the validation of learning goals of community dental hygiene practicum based on the community dental hygiene process of care (지역사회 치위생관리과정에 기반한 지역사회치위생학 실습 학습목표 타당화 연구)

  • Yoo, Sang-Hee;Bae, Soo-Myoung;Shin, Bo-Mi;Shin, Sun-Jung
    • Journal of Korean society of Dental Hygiene
    • /
    • v.20 no.2
    • /
    • pp.139-153
    • /
    • 2020
  • Objectives: The purpose of this study was to define the concept of the community dental hygiene process of care and to develop competency-based learning goals applying the community dental hygiene process of care. Methods: Based on 12 references, the concept of community dental hygiene process of care was defined, and 393 learning objectives were derived to carry out the first and second categorization process. The 57 learning goals were classified according to the 15-week learning subject (once a week) for project learning. To evaluate the validity of the developed learning subjects and goals, 80 community dental hygiene professors were surveyed. The final learning subjects and goals were created by going through the process of collecting opinions from the 35 validity evaluation results received as responses, and opinions from 10 community dental hygiene professors. Results: The first and second validity surveys on the operational definition of community dental hygiene process of care showed 4.32 points and 4.60 points, respectively. As a result of the evaluation of the validity of the learning subjects and goals for 1~15 weeks, the average validity of the learning subjects was 4.44 points, and of learning goals was 4.32 points. Conclusions: The learning subjects and goals developed by applying the theoretical framework for community dental hygiene process of care defined in this study can be used as a learning guideline for learners to understand the theory of community dental hygiene area and to derive the standards of competence in the field of practice.