• Journal of Technologic Dentistry
• /
• v.44 no.3
• /
• pp.104-110
• /
• 2022

Purpose: This study analyzes the difficulty and discrimination of the paper-based test (PBT) and the computer-based test (CBT) according to item response theory, focusing on the National Dental Technician Examination. Methods: A mock test was conducted from September 15 to 23, 2020, and the final 179 (1 out of 180 absentees)people were the subjects of this study. Both frequency analysis and factor analysis were performed. The collected data were analyzed using IBM SPSS Statistics ver. 18.0 (IBM) and jMetrik programs. The significance level was set to 0.05. Results: The difficulty of the mock test was more easily responded to in CBT. It was also predicted that the CBT could better measure the ability of test takers than the PBT could. Conclusion: The difficulty, discrimination, and reliability of the questions were not affected by the examination method through the mock test. The feasibility of a future change to the CBT was confirmed by the National Dental Technician Examination.

• Journal of Society of Preventive Korean Medicine
• /
• v.25 no.3
• /
• pp.57-71
• /
• 2021

Objectives : Computer-based test (CBT) will be introduced in the national examination of Korean medicine doctors from 2023. This study was aimed to provide some information, including prior considerations, to those preparing for CBT, by presenting a summary of the survey results from participants in a CBT simulation test. Methods : In December 2020, applicants from the graduating class of the college of Korean medicine from four universities participated in the simulation test for CBT. An online anonymous survey on the applicants' preference for CBT versus paper-based tests (PBT) was conducted. The questionnaire consisted of multiple-choice questions on a 5-point Likert scale and free-form questions. Results : A total of 176 students responded to the survey. Their response to CBT was generally positive. The item with the highest agreement was that it should provide a sufficient opportunity to experience CBT in the undergraduate exam (4.38±0.839). Concerns about the possibility of cheating or poor concentration were also detected. In addition to guaranteeing the stability of the CBT system, there were many comments expressing the need to supplement functions within the CBT system, including the memo or highlighter function. Conclusions : This study confirmed the feasibility of CBT including multimedia questions in the field of Korean medicine education and identified overall positive responses from those who experienced the CBT simulation test. Although time is short and there is so much to prepare, we hope this will be a leap forward for effective educational innovation in line with the changing environment of the health care education field.

• Journal of the Korea Society of Computer and Information
• /
• v.13 no.2
• /
• pp.67-78
• /
• 2008

The purpose of this paper is to discuss the design and implementation of a WCBT(Web and Computer based Test). The WCBT combines the strengths of both a WBT(Web-based test) and a CBT(Computer-based test) on the basis of efficiency and stability. The current assessment system, considered an important management tool in the construction and operation of a total management system for the national technical qualification, has some unstable elements with regard to system load and stability. The proposed system's technological aspects have been tested through a basic simulation pilot program. The pilot program will be expanded to include the local Chamber of Commerce and Industry because the stability of the system was proved through its application to the real-time national technical examination of KCCI (Korea Chamber of Commerce and Industry). The WCBT system has shown great efficiency in terms of system load, and has solved frequent communication problems which have occurred through the use of foreign qualifying examinations. The server and client systems of the WCBT have been given good evaluations with regard to the convenience of their use and the management system for operators and supervisors.

• Journal of The Korean Association For Science Education
• /
• v.43 no.1
• /
• pp.17-28
• /
• 2023

In line with the entry into the digital-based intelligent information society, the science curriculum emphasizes the cultivation of scientific competencies, and computer-based test (CBT) is drawing attention for assessment of competencies. CBT has advantages to develop items that have high fidelity, and to establish a feedback system by accumulating results into the database. However, it is necessary to solve the problems of improving validity of assessment results, lowering measurement efficiency, and increasing management factors. To examine students' responses to the introduction of the new assessment tools in the process of transitioning from paper-based test (PBT) to CBT, in this study, we analyzed the results of the PBT and the CBT conducted in 2021 National Assessment of Educational Achievement (NAEA). In particular, we sought to find the effects on student achievement when only the mode of assessment was changed without change of items, and the effect on student achievement when the items were composed including technology enhanced features that take advantage of CBT. This study is derived through the analysis of the results of 7,137 third-grade middle school students taking one among the three kinds of assessments, which were the PBT or two kinds of CBT. After the assessment, the percentage of correct answers and the item discriminations were collected for each group, and expert opinions on characteristics of response were collected through the expert council involving 8 science teachers with experience in NAEA. According to the results, there was no significant difference between students' achievement results in the PBT and the CBT-M, which means simple mode conversion type of CBT, so it could be explained that the mode effect did not appear. However, it was confirmed that the percentage of correct answers for the construct response items was somewhat high in the CBT, and this result was analyzed to be related to the convenience of the response. On the other hand, there were the items with a difference of more than 10%p from the correct answer rate of similar items, among the items to which technology enhanced functions were applied following the introduction of CBT. According to the analysis of response rate of options, these results could be explained that the students' level of understanding could be more closely grasped through the innovative items developed through the technology enhanced function. Based on the results, we discussed some guidance to be considered when introducing CBT and developing items through CBT, and presented implications.