• Title/Summary/Keyword: Competency evaluation

Search Result 558, Processing Time 0.033 seconds

Development of Web Credibility Evaluation Model Using AHP (AHP를 이용한 웹 사이트 신뢰성 평가 모델 개발)

  • Kim, Young-Kee
    • Journal of Korean Library and Information Science Society
    • /
    • v.39 no.4
    • /
    • pp.51-69
    • /
    • 2008
  • This study tired to develop the web credibility evaluation model by calculating weighted values and sensitivities of indicators which presented on preceding researches using Analytic Hierarchy Process. "Expert Choice 2000" was used as the tool for analysing AHP. 25 experts are answered for this questionnaire who are selected by judgement sampling method, one of the non-probability sampling method. Also, sensitivity analyses was performed to graphically see how the alternatives change with respect to the importance of the indicators or sub-indicators. The main results are summarized as followings; i) importance analysis in first level factors: trust-worthiness(0,606), expertness(0.222), safety(0.173), ii) importance analysis in second level factors: trustfulness (0.519), reputation(0.087), usefulness (0.102), timeliness(0,093), competency(0.027), security(0.115), reliability(0,058). iii) some of the importance analysis in third level factors: the site provides comprehensive information that is attributed to a specific source(0.252), the site has articles that list citations and references(0.153), the site contains user opinions and reviews(0.072), etc. iv) sensitivity analyses showed that the importance of the indicators or sub-indicators are slightly changed with respect to the alternatives change.

  • PDF

A Study on the Relative Weights of the Components of Core Competence Based Learning Outcomes in STEAM (Science, Technology, Engineering Art, Mathematics) (융합인재교육에서 핵심역량 기반 학습성과 구성요소의 상대적 가중치 연구)

  • Park, Ki-Moon
    • 대한공업교육학회지
    • /
    • v.40 no.2
    • /
    • pp.239-258
    • /
    • 2015
  • The purpose of this study is to provide basic data that can be used in a reasonable assessment of the learning outcomes of STEAM. It presented a learning outcome evaluation method, relative weights of key competencies standard that a learner should cultivate. For this study, a pairwise comparison questionnaire about the key competencies was conducted on the STEAM professionals, and AHP was applied to analyze the priority of main factors of key competencies. The results of this study are as follows. First, the importance of capabilities of convergence accomplishment and capabilities of convergent cognition, in the first layer of key competencies, were 39.4% and 36.8%, respectively. In the education evaluation of the STEAM, capabilities of convergence accomplishment and capabilities of convergent cognition showed similar level of importance, and were considered more important factor than capabilities of convergence attitude (23.8%). Second, the relative importance of capabilities of problem solving (20.0%) was highest in the second layer of key competencies, and followed by capabilities of creative thinking (18.3%), responsibility (15.3%), and understanding convergence knowledge (11.0%). Third, it will be a foundation of a competency evaluation, which reasonably evaluates, based on the relative weights, whether to accomplish educational objectives of the STEAM program In addition, this results is expected to become a guide to develop an education program that can improve the teaching and learning process and raise the learning outcome, as well as an education evaluation of the STEAM.

Actions of the Department in Context of Higher Education Evaluation Policy -A Case on the Christian Education of A University- (대학평가정책에 따른 학과의 대응 -A대학교 기독교교육과 사례를 중심으로-)

  • Chang, Hwa-Seon;Song, Yun-Hee
    • Journal of Convergence for Information Technology
    • /
    • v.8 no.3
    • /
    • pp.153-160
    • /
    • 2018
  • This article examines actions of the department of a university according to Higher Education Evaluation Policy as a case on the department of Christian education of A University. This article consists of background and policy Higher Education Evaluation and actions of the department of Christian education. Specialization, curriculum, management of instructional quality, educational achievement, student support and cooperation of local community as category of trends of the department of Christian education are discussed. Aim of education, model of human resource, educational objects, and key-competency as the specialization of department of Christian education are discussed. Curriculum of department suggests students career track which is related to their career. Positive guidance counseling are implemented for rate of recruit related to educational achievement. Non-subject matter program of University and Department are introduced for students's support. 60 hours of educational service and other educational activities are carried out for local community. Principal, chaplain of school and teachers are invited for educational practical affairs of education. The result of this article can be used as a basic reference for the direction of the higher education.

Development of Pre-Service Teachers' TPACK Evaluation Framework and Analysis of Hindrance Factors of TPACK Development (예비교사의 TPACK 평가틀 개발과 TPACK 발달 저해 요인 분석)

  • Choi, Kyeongsik;Paik, Seoung-Hey
    • Journal of The Korean Association For Science Education
    • /
    • v.41 no.4
    • /
    • pp.325-338
    • /
    • 2021
  • In this study, we developed a 15-week educational program for TPACK(Technological Pedagogical Content Knowledge) development of 40 pre-service teachers in a university for teacher training. We also developed a TPACK evaluation framework to evaluate the practical competency of TPACK of pre-service teachers. The developed evaluation framework consisted of 5 levels, from 0 to 4, TPK(Technological Pedagogical Knowledge), TCK(Technological Content Knowledge), and TPACK, respectively. As a result of the evlauation, the levels of TPK, TCK, and TPACK development stages of most pre-service teachers were consistent, but some pre-service teachers' TPK and TCK did not match. It was found that the TPACK stages follow the lower level between TPK and TCK. In addition, as a result of an investigation into the hindrance factors of the TPACK development of pre-service teachers with low TPACK stages in the use of technology, they have distrust of students' ability to learn with self-regulation, distrust of students' ability to interact, and recognition of practical limitations in the school field. Based on these findings, we argued that it was necessary to provide an educational program to help pre-service teachers develop balanced TPK and TCK and eliminate the hindrance factors of the TPACK development of pre-service teachers about technology-using classes.

Development of STEAM Diagnostic Evaluation Tool to Strengthen the Implementation of STEAM Education (STEAM 교육의 실행 강화를 위한 학교 STEAM 역량 진단 도구 개발)

  • Park, HyunJu;Sim, Jaeho;Lee, Ji-Ae;Lee, Youngtae
    • Journal of Science Education
    • /
    • v.45 no.3
    • /
    • pp.349-363
    • /
    • 2021
  • The purpose of this study is to develop an instrument for school STEAM education diagnostic assessment. Literature reviews, the developmental study of a prototype instrument, experts' advices, and pilot study were administrated. The school STEAM education diagnostic assessment was consist of five areas: 'STEM education action and sustainability plan,' 'STEAM curriculum and instruction,' 'STEAM professional development,' 'process-based evaluation,' and 'community and partnerships.' Each area had one to five sub-areas. A total of 14 diagnosis items were developed, including items that can diagnose the school's STEAM environment base and STEAM education execution level at the school unit and member level for each area. The validation of the diagnostic assessment was conducted through the content validity of the expert group and the validity of a survey targeting school teachers. For applying the instrument for STEAM Education School Assessment to schools, a total of 267 elementary, middle, and high schools participated. As a result, the average of the five areas was 1.46 to 2.18. This instrument comprehensively diagnoses and evaluates the implementation and effectiveness of STEAM education in schools, and is expected to be used as basic data and core data for implementing STEAM education.

Development of OSCE by Nurse Managers of One University-Affiliated Hospital for Skill Test of Nurse Recruitment Process (간호사 채용을 위한 간호관리자의 OSCE 개발)

  • Han, Mi-Hyun;Choi, Joo-Soon;Park, Seok-Gun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.6
    • /
    • pp.2625-2631
    • /
    • 2012
  • To recruit nurses with skills, the hospital must evaluate the skills of the applicants. But objective evaluation of the skills is a difficult. Many hospitals are using written examination or oral test only and are not testing the nursing skills directly when they recruit new nurses. OSCE(Objective Structured Clinical Examination) is a method developed for the evaluation of clinical skills objectively. In this study, 16/20 nurse managers of one university-affiliate hospital were assembled for the project of developing 7 OSCE modules by themselves, and then they ran OSCE using those modules for 40 nursing students. They scored nursing skills of the students using checklists they designed. The whole process was proceeded phase by phase using step-wise approach model. The project was successful; inter-personal consistency of the scores were high; nurse managers became confident in objective skill evaluation; subjective responses for this project were favorable. The hospital adopted OSCE in recruitment process thereafter. This experience might be applied to other hospitals who want to recruit nurses with skills.

Development of Performance Management System for Contract Departments in the Korean Dual College Context (일학습병행제 대학연계형 계약학과의 성과관리체계 개발)

  • Im, Tami;Kang, Kiho
    • Journal of Practical Engineering Education
    • /
    • v.12 no.1
    • /
    • pp.145-162
    • /
    • 2020
  • The dual system in Korea already plays an important role in quantitative terms in the Korean lifelong vocational competency development system. However, since most of the existing dual system performance management plans in Korea focus on qualification-linked dual system, research on the effective performance management of the four-year university-driven dual system is very insufficient. This paper presents multiple measures for developing a performance management system suitable for the university-driven dual system to achieve qualitative improvement of the contract departments of the dual colleges or universities. As an approach to the end, a performance evaluation system is established by developing the evaluation items and indicators for the dual colloeges' contract departments. Next, it analyzes the needs of various stakeholder groups such as field teachers of the involved companies, students in apprenticeship and OJT professors of KOREATECH through FGI's and polls to diagnose the current operational performance, especially the causes of high drpout rates of the contract departments. From these results, the paper presents firstly the development of measuring methods for the developed performance indicators of the evaluation system and then a systemic performance management system which is based on 'input-transformation-outcome-feedback' structure. In addition, some measures for improving the high dropout rate and performance are presented from the viewpoints of each stakeholder.

The Impact of Organizational Competencies on the Performance of R&D Management Agencies in Korea (연구관리기관의 역량이 성과에 미치는 영향 분석)

  • Hong, Heung-deug;Lee, Kwang-hoon;Park, Kwang-pyo;Hwang, Byung-yong
    • Journal of Korea Technology Innovation Society
    • /
    • v.21 no.2
    • /
    • pp.788-817
    • /
    • 2018
  • This paper aims to explore the relationship between organizational competencies and performance by analysing perception survey data of R&D management agencies in Korea. The regression analysis results show the perceived performance measured by policy contribution and R&D management efficiency may be enhanced by organizational competencies such as professionalism and efficiency of R&D management specialized agencies. The paper suggests several improvement measures for strengthening professionalism of R&D management agencies in Korea. First, expertise competencies for strategic planning, management, evaluation need to be empowered in the whole process of R&D cycles. Second, in order to stabilize financial resources of R&D management specialized agencies, the existing R&D budget for Planing, Evaluation and Management should be reformed. Third, R&D management specialized agencies need setting up special organizations for managing inter-organizational collaboration with other R&D organizations. And the agencies should employ special experts in each position for strategic planning, management, evaluation, performance and commercialization. Finally, different R&D management procedures of each R&D management specialized agency need to be standardized in order to promote innovative R&D culture.

A Study on Development of the Competitive Evaluation Model in Oversea Construction Industry (해외건설 경쟁력 평가모델 개발에 관한 연구)

  • Han, Jae-Goo;Park, Hwan-Pyo;Jang, Hyoun-Seung
    • Korean Journal of Construction Engineering and Management
    • /
    • v.14 no.2
    • /
    • pp.12-21
    • /
    • 2013
  • The purpose of this study is to determine a national construction industry's competitiveness and establish strategies to expand into overseas construction markets. To evaluate the international competitiveness of overseas construction businesses, this study were selected as the target range of international comparisons among the countries cited by ENR, Global-Insight, IMF, OECD, and Transparency International. In result the United States ranked first, followed by China $2^{nd}$, Italy$3^{rd}$, U.K.$4^{th}$, and Germany $5^{th}$, while Korea ranked $9^{th}$ overall. In particular, Korea's competitiveness in the construction infrastructures by country ranking($11^{th}$) was higher than the competency assessment results of construction companies by country, therein ranking $12^{th}$. In addition, while Korea ranks $12^{th}$ among 22 countries, $3^{rd}$ in price competitiveness, $12^{th}$ in construction competitiveness, and $19^{th}$ in design competitiveness.

Development, Implementation, and Evaluation of an In-service Program of Practical Problem Focused Curriculum with Changing Curriculum Development Perspective (2007년 개정 가정과 교육과정 개발 관점의 변화에 따른 실천적 문제 중심 교육과정 연수 프로그램 개발, 실행 및 평가)

  • Yoo, Tae-Myung;Lee, Soo-Hee
    • Journal of Korean Home Economics Education Association
    • /
    • v.21 no.1
    • /
    • pp.1-19
    • /
    • 2009
  • The purpose of this study was to develop, implement, evaluate in-service program on the practical problem focused Home Economics program. This program is expected to contribute to the enforcement of high quality of teacher's teaching competency and to the readiness for the 2007 newly revised Home Economics curriculum. This study was carried into by followings steps: 1. Program development: Based on the program design, an in-service program of practical problem focused home economics curriculum and teaching-learning materials were developed. 2. Program implementation: The four days/30 hours in-service program was delivered in January, 2008 with 24 participants. Mentor teachers were arranged playing interface role during the program. 3. Program evaluation: Group interview was held and written evaluation was collected from participants, mentor teachers, and home economics curriculum experts. From the results of this study, it is suggested to promote understanding of theory relatively easier than delivered in the in-service program, to extend to a 60 hours program includes more activity and workshop, and to develop in-service programs for the beginner and the advanced groups separately.

  • PDF