• 의학교육논단
• /
• 제15권3호
• /
• pp.125-135
• /
• 2013

Since the establishment of the national medical licensing examination board in 1992, the medical licensing examination system has changed enormously and this has had a number of impacts on examination services. All those reforms were aimed at improving the relevance and reliability of the test. Several attempts of the testing system have appeared in the new examination service, and which have also brought about the changes in the medical school curriculum such as introducing integrated courses instead of traditional subjects, using test scores as a reference to the post-graduation selection test. Some examples of changes in the examination system are as follows: 1) choosing three integrated test subjects and outlines of their reference content instead of 15 academic subjects, 2) adjusting the ratio of multiple choice question items to focus more on the problem solving level, 3) introduction of 'one-best answer' single set and 'extended matching type items, 4) item construction based on real clinical cases and real clinical materials. Recently, a clinical skill test system has been introduced to measure examinees' basic clinical skills competencies. Despite continuing efforts, the examination system still has many issues remaining to be solved. These problems include the differential weighting of test items, appropriate threshold for passing, and practicality of pre-testing to stabilize the passing rate and avoid the hazards of newness and undesirably difficult test items.

• Korean journal of medical education
• /
• 제30권4호
• /
• pp.347-357
• /
• 2018

Purpose: The purpose of this study was to apply alternative standard setting methods for the Korean Medical Licensing Examination (KMLE), a criterion-referenced written examination, and to compare them to the conventional cut score used on the KMLE. Methods: The process and results of criterion-referenced standard settings (i.e., the modified-Angoff and bookmark methods) were evaluated. The ratio of passing and failing examinees determined using these alternative standard setting methods was compared to the results of the conventional criteria. Additionally, the external, internal and procedural evaluation of these methods were reviewed. Results: The modified-Angoff method yielded the highest cut score, followed sequentially by the conventional method and the bookmark method. The classification agreement between the modified-Angoff and bookmark methods was 0.720 measured by Cohen's ${\kappa}$ coefficient. The intra-panelist classification consistency of modified-Angoff method was higher than bookmark method. However, the inter-panelist classification consistency was vice versa. The standard setting panelists' survey results showed that the procedures of both methods were satisfactory, but panelists had more confidence in the results of the modified-Angoff method. Conclusion: The modified-Angoff method showed results that were more similar to those of the conventional method. Both new methods showed very high concordance with the conventional method, as well as with each other. The modified-Angoff method was considered feasible for adoption on the KMLE. The standard setting panelists responded positively to the modified-Angoff method in terms of its practical applicability, despite certain advantages of the bookmark method.

• 한국응급구조학회지
• /
• 제14권2호
• /
• pp.57-69
• /
• 2010

Purpose : The National Registry Exam had some problems on validity of EMT evaluation and verification. The aim of this study was to propose a New EMT National Registry Exam. Methods : Conducted using the Delphi Method(lst meeting March 29 in 2008, 2nd meeting May 31 in 2008, 3rd meeting September 20 in 2008, 4th meeting January 16 in 2009) from questionnaire data(391 from Paramedic, 317 from Basic EMT) collected between June 16-30(lst questionnaire) and October 16-30(2nd questionnaire) in 2008 and a public hearing on February 5 in 2009. Results: The subjects proposed at the request of the National Health Personnel Licensing Examination Board were Introduction, Medical+Trauma Emergencies(Paramedic & Basic) for written examination and scenarios+protocols(Paramedic), protocols(Basic) for practical examination. Conclusion : To be able to response patients' problems in various emergencies, this integrated examination was selected and proposed.

• 의학교육논단
• /
• 제16권1호
• /
• pp.11-15
• /
• 2014

A number of medical schools in Korea have been using computer-based testing (CBT) for evaluating their students' scientific and/or clinical performance since the early 1990s. Introducing CBT to medical education would have several advantages: first, presenting figures and audio-video files of clinical content is simple with CBT, making it possible to evaluate medical students' competency with navigating more realistic clinical situations at minimum cost; second, CBT enables automatic item analysis and score reporting. To establish CBT, constructing an item bank with item parameters such as difficulty or discriminating parameters will be needed. To select more psychometrically sound items, analysis of the items according to item response theory is necessary. CBT has already been introduced in high stakes tests like the United States Medical Licensing Examination and the Medical Council of Canada Qualifying Examination. The National Health Personnel Examination Board in Korea is also planning to introduce a CBT-based version of the National Medical Examination soon. Thus all medical schools in Korea will need to introduce CBT and construct item banks to prepare their students for their licensing examinations and to measure the students' competency more accurately.

• 대한통합의학회지
• /
• 제10권3호
• /
• pp.107-117
• /
• 2022

Purpose : The purpose of this study was to establish a model of the predictive factors for success or failure of examinees undertaking the Korean physical therapist licensing examination (KPTLE). Additionally, we assessed the pass/fail cut-off point. Methods : We analyzed the results of 10,881 examinees who undertook the KPTLE, using data provided by the Korea Health Personnel Licensing Examination Institute. The target variable was the test result (pass or fail), and the input variables were: sex, age, test subject, and total score. Frequency analysis, chi-square test, descriptive statistics, independent t-test, correlation analysis, binary logistic regression, and receiver operating characteristic (ROC) curve analyses were performed on the data. Results : Sex and age were not significant predictors of attaining a pass (p>.05). The test subjects with the highest probability of passing were, in order, medical regulation (MR) (Odds ratio (OR)=2.91, p<.001), foundations of physical therapy (FPT) (OR=2.86, p<.001), diagnosis and evaluation for physical therapy (DEPT) (OR=2.74, p<.001), physical therapy intervention (PTI) (OR=2.66, p<.001), and practical examination (PE) (OR=1.24, p<.001). The cut-off points for each subject were: FPT, 32.50; DEPT, 29.50; PTI, 44.50; MR, 14.50; and PE, 50.50. The total score (TS) was 164.50. The sensitivity, specificity, and the classification accuracy of the prediction model was 99 %, 98 %, and 99 %, respectively, indicating high accuracy. Area under the curve (AUC) values for each subject were: FPT, .958; DEPT, .968; PTI, .984; MR, .885; PE, .962; and TS, .998, indicating a high degree of fit. Conclusion : In our study, the predictive factors for passing KPTLE were identified, and the optimal cut-off point was calculated for each subject. Logistic regression was adequate to explain the predictive model. These results will provide universities and examinees with useful information for predicting their success or failure in the KPTLE.

• 대한임상검사과학회지
• /
• 제49권2호
• /
• pp.161-170
• /
• 2017

본 연구는 대학 교육제도와 국가면허시험 제도에 대한 교수와 병원실무자들의 의견을 조사하여 분석함으로써 우수한 임상병리사 양성을 위한 정책방향을 결정하는데 목표로 하고 있다. 2016년 8월에 온라인 설문지가 255명의 대학교수들과 4,000명의 병원실무자들에게 배포되었다. 회수율은 교수들은 59명(23%), 병원실무자들은 1,099명(27.7%)이 응답하였다. 결과는 기술통계분석과 비교분석을 통해 처리하였다. 대학 교육제도에서는 교수들과 병원실무자들 모두 대학 및 임상실습 교육의 질적 향상과 교육의 표준화가 필요하다고 조사되었다. 국가면허시험제도에서는 교수들과 병원실무자들 모두 특히 실기시험의 개편이 필요하다고 조사되었고, 면허시험제도도 개선이 필요하다고 조사되었다. 위의 결과들은 교수들과 병원실무자들은 우수한 임상병리사 양성을 위해서는 대학 및 임상교육의 질적 향상과 국가면허시험제도의 개선이 필요하다고 생각하고 있음을 보여준다.

• 의학교육논단
• /
• 제25권1호
• /
• pp.68-77
• /
• 2023

Basic medical education is important for developing the competencies of medical doctors, and it includes basic biomedical sciences, preventive medicine, medical ethics, and clinical science. This study aimed to reveal the current status of the Korean Medical Licensing Examination (KMLE) regarding its evaluation of competencies in basic biomedical sciences. The basic medicine-related questions were screened and selected from the test forms of the KMLE (2016-2018) by personnel conducting basic biomedical science education, and the selected questions were analyzed by three independent groups of undergraduate students at Chonnam National University Medical School in terms of the learning outcomes of basic medical education. The study scope includes the proportion of basic medicine-related questions, which consist of basic medicine questions and basic medicine-related clinical medicine questions, its annual change, discipline distribution, and associated learning outcomes. The average proportions of basic biomedical sciences, preventive medicine and medical law, and clinical sciences were 2.3%, 5.8%, and 91.9% of all questions, respectively. The proportion of basic medicine-related questions, except those on preventive medicine and medical law, was 22.0% of the total, and questions on pharmacology and microbiology accounted for 83.0% of the basic medicine-related questions. The proportion of sub-enabling learning outcomes linked with basic medicine-related questions comprised 14.0% of the total outcomes for basic biomedical sciences and 30.4% for preventive medicine and medical law. It is concluded that the KMLE questions may not sufficiently cover the essential competencies of basic medical education for medical doctors, and the KMLE may need to be improved with regard to competencies in basic biomedical sciences.

• 의학교육논단
• /
• 제17권1호
• /
• pp.33-38
• /
• 2015

During the education reform in 2009, the Catholic University of Korea College of Medicine (CUMC) adopted body systems as the basis for structuring basic medical education. After running the new program for 5 years, we need to evaluate the program by comparing it with nationwide standards. This study was designed to evaluate the coverage of our basic medical education program by comparing it with the assessment items of the medical licensing examination for physicians in the Republic of Korea. We built a relational database populated with 3,017 learning outcomes from all the courses on basic medical education. We tagged each learning outcome according to 2 criteria: 206 physician encounters and 9 outcome domains. A majority of the learning outcomes were in the domains of 'knowledge' and 'critical thinking'. In addition, we repeated the categorization process with 584 assessment items of the medical licensing examination in the Republic of Korea and compared them with the categorization results of the learning outcomes. Among the 206 physician encounters, we found that outcomes on family violence and sexual violence were missing in the learning outcomes of CUMC. Eighty-two physician encounters were associated with more than one outcome domain, and 96 physician encounters were covered in more than one course. Twenty-one physician encounters were repeated in 5 or more courses and 34 physician encounters had outcomes categorized into 3 or more domains. Thus, we showed that the 2-way categorization could be applied to the comparison and evaluation of two different education formats.

• 대한예방한의학회지
• /
• 제14권1호
• /
• pp.137-149
• /
• 2010

In recent decades, as the utilization of complementary and alternative medicine in the United State have been growing rapidly, regulatory controls surrounding complementary and alternative medicine(CAM) aims to ensure patient protection against unproven practices and to provide safe and effective treatments. Regulation and policy method on licensing CAM practitioners varies across the states. Over 85% of the states have the licensing system for acupuncturists, chiropractors, and naturopaths. For acupuncture, although the requirements for formal education are various across the states, a unified written examination has been adopted by almost entire states which have acupuncturist licensing law. Medicare, the public medical insurance, does not cover CAM practices except chiropractic and biofeedback. In some states, however, Medicaid programs cover some CAM therapies including acupuncture, naturopathy, and massage therapy. 67% of Health Maintenance Organizations, the private health plans, provide at least one modality of CAM services. In conclusion, government policies have been strengthened to ensure patient protection, and will continue to integrate CAM practices that are proven to be safe and effective into mainstream health care system.

• 의학교육논단
• /
• 제12권1호
• /
• pp.33-41
• /
• 2010

Purpose: This study aimed at investigating the current situation of Medical Humanities and Sociology-related-curriculum in Korean medical schools, and suggesting the courses of study for the contents and methods of the Medical Humanities and Sociology examination, which can be included in the National Examination for Medical Practitioners. Methods: We analyzed Medical Humanities and Sociology-related courses which are offered in Korean medical schools, and a survey was conducted by medical school professors and students and medical journalists. In the survey, the Medical Humanities and Sociology-related courses were divided into 8 parts, and the participants were asked to evaluate the importance of duty, necessity of education, necessity of evaluation and the evaluation method of each part using a seven-point scale. Results: A total of 207 medical school professors and students and 9 medical journalists participated in the survey. The results were similar for the importance of duty and necessity of education of each part, but those for the necessity of evaluation were different. - As a result, there seems to be a gap between the importance of duty and the importance of education of each course. Medical journalists and students group answered differently on the necessity of evaluation of each course was also reserved. Conclusion: It is necessarily recommended to include Medical Humanities and Sociology-related courses such as medical ethics, self-improvement and doctors' social responsibilities in the National Examination for Medical Practitioners.