• 디지털산업정보학회논문지
• /
• 제12권4호
• /
• pp.59-69
• /
• 2016

We proposed a specialized model of performance measurement to measure the training performance of the trainees in cyber practical training. Cyber security professionals are cultivating their expertise, skills, and competencies through cyber practical training in specialized education and training institutions. The our proposed process of trainee evaluation is consisted of an evaluation component discovery, evaluation item selection, evaluation index catalog, ratings and criteria decision, and calculation formula. The trainee evaluation is consisted of a formative evaluation during the training and an overall evaluation after finished training. Formative evaluation includes progress evaluation and participation evaluation, and overall evaluation includes practice evaluation and learning evaluation. The evaluation is weighted according to the importance of evaluation type. Because it is evaluated actual skills and abilities, competencies are assigned a high weight, while knowledge and attitudes are assigned a low weight. If cyber security trainees are evaluated by the proposed evaluation model, cyber security professionals can be cultivated by each skill and knowledge level and can be deployed by importance of security task.

• 한국콘텐츠학회논문지
• /
• 제12권10호
• /
• pp.510-523
• /
• 2012

본 연구는 CIPP모형을 활용하여 항공서비스교육의 성과를 평가하고자 한다. CIPP모형의 상황평가(Context), 투입평가(Input), 과정평가(Process), 산출평가(Product)를 중심으로 요인을 도출하고 항공서비스교육의 만족도와 재추천에 영향을 미치는 요인을 분석하였다. 그 결과 만족도에는 상황평가(C)의 교육목표, 과정평가(P)의 상호작용, 프로그램관리, 산출평가(P)의 직무성과 요인이 긍정적인 영향을 미쳤으며, 투입평가(I)의 인적자원은 부정적인 영향을 주었다. 또한 서비스교육의 재추천에는 상황평가(C)의 교육목표, 과정평가(P)의 상호작용, 교육지원, 산출평가(P)의 직무성과 요인이 긍정적인 요인으로 작용하였으며, 상황평가(C)의 요구진단은 부정적인 요인으로 영향을 미쳤다. 따라서 항공서비스교육의 만족도를 높이기 위해서는 인적자원이 아니라 교육의 목표, 상호작용, 프로그램관리, 성과를 높여야 하며, 서비스교육의 재추천을 위해서는 항공사의 요구진단보다는 교육목표, 상호작용, 교육지원, 직무성과를 높일 필요가 있음을 시사한다.

• 한국항해항만학회:학술대회논문집
• /
• 한국항해항만학회 2018년도 추계학술대회
• /
• pp.25-26
• /
• 2018

가상훈련은 가상현실을 기반으로 효율적으로 훈련을 수행할 수 있는 방법으로써 안전과 비용효율성을 기반으로 널리 사용되고 있다. 본 논문은 해사안전 훈련 중 구명정 정수 훈련, 밀폐 구역 훈련, 초기 화재 소화 훈련의 가상훈련으로써의 구현 및 이에 대한 유효성 평가를 제안한다. 구체적으로 각 훈련의 목표에 맞도록 가상훈련을 구현하는 방법을 논의하며 이 방식으로 구현했을 때의 피훈련자 유효성 평가 방식을 각 훈련에 맞게 제안한다. 제안된 평가 방식은 피훈련자의 훈련도 평가 및 훈련 방식의 훈련 효율도 평가, 훈련의 해사 안전 기여도에 대한 정량적 평가 지표로써 사용될 수 있다.

• 농촌지도와개발
• /
• 제4권1호
• /
• pp.305-315
• /
• 1997

The propose of this study was to analyze the relationships among the levels of training & development evaluation (reaction, learning, transfer). The study has been conducted on 730 trainees who attended in the basic accounting program in L training and development institution through three incidents of tracked research such as reaction survey right after the conclusion of training, learning evaluation through test, and an evaluation of the transferability after 3 months of training. Questionnaires and test papers for analyses were used after their reliability, validity, difficulty, and discrimination have been verified on a pre-test. The research has been conducted for six months from 4 March 1996 to the end of August 1996, and data have been collected through direct research and survey through mail. The collected data have been worked on at SAS program for Windows with a statistical significance level of 5%. Statistical method that had been used was Pearson's correlation coefficient. The result and conclusion acquired from this study were as follows: Between reaction and learning, learning and transfer of training, only a weak positive correlation exists and explanation or prediction variance showing hierarchical relationship was quite weak with 1%. Thus, this research not only does not strongly support Kirkpatrick(1976)'s hierarchical model of $reaction{\rightarrow}learning{\rightarrow}transfer$, but also indicates that the separate measurement on each levels of training evaluation needs to be done. On the other hand, there was a relatively strong positive correlation between reaction and transfer of training. Based on the result, the conclusion, and the restriction perceived through this study, the following suggestions were made. 1. There is a need to empirically analyze and verify the hierarchy of all levels of training evaluation including the evaluation of the fourth level (result) such as organizational productivity, organizational satisfaction, and separation rate. 2. A great deal of efforts will be needed to systematically analyze what the relationships are among the methods measuring the level of evaluation of the training and development, and to apply this result to the training field.

• 한국IT서비스학회지
• /
• 제19권1호
• /
• pp.173-185
• /
• 2020

It is very important to evaluate training because it can systematically grasp the current status of training. Evaluation includes getting ongoing feedback from the learner, trainer and learner's supervisor, to improve the quality of the training and identify if the learner achieved the goals of the training. It also provides a justification for the implementation of training. Nonetheless, there is a lack of studies that attempt to evaluate information security training programs. In this study, we utilize the Philips model to evaluate the public training programs for the people who are in charge of the information security duties in the public sector and propose the training improvement plans. Research result has shown that it is necessary to evaluate the level of the trainees in advance and conduct training programs according to the information security skill level. In addition, it needs to conduct training according to duties such as information security management, information security operate and maintain. The limitation of this study is that each education program was not assessed individually because this study had developed an evaluation tool that could be used comprehensively.

• 한국항공운항학회지
• /
• 제13권1호
• /
• pp.1-8
• /
• 2005

The purpose of the study is to show the need for the development of standard materials which can be used for flight training and pilot practical tests in the future. In this paper the flight training and evaluation references of flight training institutes certified by the Ministry of Construction and Transportation(MOCT) are compared with references of the international organization such as ICAO and FAA. As a result it is found that the flight schools certified by the MOCT have used different references for flight training and evaluation. Therefore, this study suggests creation and operation of an expert advisory group to develop new standards for flight training and evaluation, so called " Flight Training Manual", in Korea.

• 해양환경안전학회지
• /
• 제24권3호
• /
• pp.311-318
• /
• 2018

In accordance with the stipulations of the STCW Convention, simulation training has been enforced in order to develop practical skills so as to prevent accidents by predetermining the risks in special marine environments. Simulation training is a useful way to acquire navigation abilities, and can continuously measure the ability of a trainee by applying an appropriate evaluation. However, the result of training is evaluated by the instructor's subjective judgment without quantitative criteria. Therefore, this study aims to quantitatively evaluate the effectiveness of simulation training. For this purpose, evaluation items were derived by analyzing legal standards, earlier studies, and the current status of MET institutions. The simulations were then performed three times in the same scenarios and analyzed the results. As a result, it has been shown that the objectively analyzed ability to keep the route and to make safe passage with other vessel, as well as subjectively evaluated ability by the apprentice officer has been improved as training progressed. Through the evaluation of simulation training results, it can be derived that simulation education needs supplementation, and can be provided as a basic form of data to quantify the evaluation results of the simulation training in the future.

• 산업경영시스템학회지
• /
• 제46권4호
• /
• pp.209-217
• /
• 2023

In this study, the evaluation items related to the effectiveness evaluation of the LVC (Live, Virtual, Constructive) training system of the Air Force were derived and the weights of each item were analyzed. The LVC training system evaluation items for AHP (Analytic Hierarchy Process) analysis were divided into three layers, and according to the level, 3 items were derived at level 1, 11 items at level 2, and 33 items at level 3. For weight analysis of evaluation items, an AHP-based pairwise comparison questionnaire was conducted for Air Force experts related to the LVC training system. As a result of the survey, related items such as (1) Achievement of education and training goals (53.8%), (1.2) Large-scale mission and operational performance (25.5%), and (1.2.1) Teamwork among training participants (19.4%) was highly rated. Also, it was confirmed that the weights of evaluation items were not different for each expert group, that is, the priority for importance was evaluated in the same order between the policy department and the working department. Through these analysis results, it will be possible to use them as evaluation criteria for new LVC-related projects of the Air Force and selection of introduction systems.

• 정보과학회 컴퓨팅의 실제 논문지
• /
• 제24권3호
• /
• pp.122-128
• /
• 2018

실제 환경보다 더 안전하고 적은 비용으로 실제 훈련과 유사한 학습효과를 기대할 수 있는 가상훈련(Virtual Training)이 최근 주목받고 있다. 그러나 기존의 가상훈련 시스템들은 학습자의 훈련결과에 대한 평가를 평가자의 정성적인 판단에 의존해온 경우가 대부분이었다. 또한, 평가와 분석 기능이 해당 시스템에 국한이 되어 시스템마다 별도의 평가 분석 시스템이 필요했다. 본 논문에서는 가상훈련의 효과적인 평가와 분석을 위해 전문가의 경험지식을 활용하는 확장성 있는 가상훈련 평가 분석 시스템을 제안한다. 우선, 제안하는 시스템이 다양한 형태의 가상훈련 시스템과 연동될 수 있도록 Open API의 적용 방안을 다룬다. 그리고 가상훈련에 대해 전문가 경험지식을 별도로 구성하여 평가 분석 시 비교 대상과의 평가 효율성을 높였다. 구성된 전문가 경험지식은 제안된 평가 분석 절차에 따라 학습자의 훈련수행 결과와 정량적으로 비교 분석할 수 있게 했다.

• 한국항공운항학회지
• /
• 제23권1호
• /
• pp.74-84
• /
• 2015

The purpose of this study is to develop competitiveness evaluation index for global aviation training organizations. Research and studies on relevant documents were conducted to establish the index. With no sufficient study results previously done directly associated with global aviation training organization, relevant and related documents, such as studies on competitiveness evaluation index of higher educational institutions, were reviewed as an alternative. Two rounds of delphi surveys were conducted based on the review and consultation from experts in aviation training and human resource management fields. First round of survey with 62 evaluation indices were carried out, through which a total of 29 were selected, and 19 indices were chosen during the second round of survey. However, factor analysis was conducted in order to justify the survey result, which eliminated 3 more indices, with 16 finally selected. This study will provide implications for aviation training organizations which need to further improve their competitiveness globally.