• School Mathematics
• /
• v.2 no.1
• /
• pp.73-95
• /
• 2000

In this study, on the basis of the seventh national mathematics curriculum, the achievement standards were developed to specify the objectives and contents of teaching-learning at the first and second elementary school mathematics. The assessment standards were also developed to differentiate students’ levels of achievement with ‘high’, ‘mid’ and ‘low’ categories. Furthermore, this stuffy suggested the exemplary test items including short-answer and open-ended questions while putting emphasis on students' real performance to increase their ability in solving problems rather than in calculating. In addition to the test items, it introduced the grading system developed to grade the items with concrete guidelines and to report students' achievement on doing mathematics.

• Education of Primary School Mathematics
• /
• v.5 no.2
• /
• pp.121-142
• /
• 2001

The goal of the National Assessment of Educational Achievement(NAEA) 2001 was to affirm the accountability of school education, to scientifically manage and elevate the quality of education at the national level, and to articulate the final design of the NAEA. It was implemented on June 28th of the year 2001. The assessment frame for NAEA includes the achievement standards, the assessment standards, the instruction for the item development, and the grading policy for mathematics subject. Most of items are multiple-choice types, but the performance-based items should be at least thirty percent of the total items, also 30% in case of mathematics. Approximately 1% of students among entire population of the Grades 6 were randomly selected. Therefore, the finally sampled examines were 8023 at Grade 6. The result of the analysis of the NAEA revealed that Grade 6 students was labelled as ‘average’ level in general (Number and Operation: average, Geometric figures: average, Patterns and Functions: excellent, Measurements: average, Letters and Expressions: average, Probability and Statistics: average). The most characteristic finding was that except for Grade 6(its average is 69.92), most secondary students obtained low test scores and its average of each grade is below 50 out of 100. Especially, the scores on the performance-based items were by and large very low. This finding implies that Korean students are not familiar with the kind of test items which requires expression of ideas and feelings and they are rather familiar with the multiple-choice items. Another interesting finding was that the students in small towns and remote areas showed significantly low scores in all four skills compared with Seoul, metropolitan cities and medium and small cities. This may be attributed from the fact that the remote areas do not have equal learning environment with regard to social and cultural experience, supply of various teaching materials, extracurricular lessons which are directly related to teaching and learning. These findings may be utilized as a reliable resource fur improving curriculum and teaching and learning in Mathematics.

• Imaging Science in Dentistry
• /
• v.46 no.3
• /
• pp.211-216
• /
• 2016

Purpose: The use of electronic tools in teaching is growing rapidly in all fields, and there are many options to choose from. We present one such platform, Learning Catalytics$^{TM}$ (LC) (Pearson, New York, NY, USA), which we utilized in our oral and maxillofacial radiology course for second-year dental students. Materials and Methods: The aim of our study was to assess the correlation between students' performance on course exams and self-assessment LC quizzes. The performance of 354 predoctoral dental students from 2 consecutive classes on the course exams and LC quizzes was assessed to identify correlations using the Spearman rank correlation test. The first class was given in-class LC quizzes that were graded for accuracy. The second class was given out-of-class quizzes that were treated as online self-assessment exercises. The grading in the self-assessment exercises was for participation only and not accuracy. All quizzes were scheduled 1-2 weeks before the course examinations. Results: A positive but weak correlation was found between the overall quiz scores and exam scores when the two classes were combined (P<0.0001). A positive but weak correlation was likewise found between students' performance on exams and on in-class LC quizzes (class of 2016) (P<0.0001) as well as on exams and online LC quizzes (class of 2017) (P<0.0001). Conclusion: It is not just the introduction of technological tools that impacts learning, but also their use in enabling an interactive learning environment. The LC platform provides an excellent technological tool for enhancing learning by improving bidirectional communication in a learning environment.

• Journal of Educational Research in Mathematics
• /
• v.12 no.1
• /
• pp.145-162
• /
• 2002

In this study, on the basis of the seventh national mathematics curriculum, the achievement standards were developed to specify the objectives and contents of teaching-learning and the assessment standards were also developed to differentiate students' levels of achievement at school mathematics. The achievement standards were developed on the following guidelines; 1) to present the minimum standards based on the national curriculum, 2) to develop the standards based on the order of curriculum, 3) to suggest the minimum but ultimate achievement target, 4) to comprise not only of the intellectual but also of psychological spheres such as knowledge, function, attitude, aptitude, etc., and 5) to suggest the standards comprehensively and concretely. The standards were developed on the basis of the middle areas of contents of the curriculum in order not to be too comprehensive, nor to be too detailed. Learning activities, on the other hand, were provided for the assistance of instructions with emphasis on creativity rather than on the routine instruction. The assessment standards were established based on the following principles; 1) to establish the assessment methods, contents, and situations which are to be used for assessment, 2) to establish the criteria of classifying the assessed into the upper, intermediate and lower levels, 3) to develop the assessment standards in a proportionate balance to achievement standards, 4) to establish the intermediate level as a standard, and 5) to establish the minimum level in the contents, concepts, values and attitudes of basic learning. This study also suggested the exemplary test items including short-answer and open-ended questions while putting emphasis on students' real performance to increase their ability in solving problems rather than in calculating. In addition to the test items, it introduced the grading system developed to grade the items with concrete guidelines and to report students' achievement on doing mathematics.

• Journal of The Korean Association For Science Education
• /
• v.24 no.3
• /
• pp.519-531
• /
• 2004

In recent years, there has been an increased emphasis on performance assessment to evaluate students' abilities. Our nation has introduced a change in testing and assessment. Additional work on the efficacy, reliability, and comparability in order to develop the performance assessment item has been needed in the enforcement of the 7th National Science Curriculum. Also, criteria for professional and technical standards has been needed to be developed. The purpose of this study was to draw out various key concepts and to develop achievement standards, assessment standards and performance assessment items based on the 7th National Science Curriculum on the subject matter of reproduction(chapter 13) and biological accumulation(chapter 17). And also, this study examined the validity of completed performance assessment items based on classical test theory and polytomous item response theory. Twelve key concepts in chapter 13(reproduction) and four from chapter 17(biological accumulation) were abstracted. Twenty-six achievement standards in chapter 13(reproduction), and nine in chapter 17(biological accumulation) were developed. The achievement standards were determined in terms of knowledge(K), process skill(P) and attitude(A). Twenty-five assessment standards in chapter 13(reproduction) and nine in chapter 17(biological accumulation) were developed. Based on the developed achievement standards and assessment standards, twenty-two performance assessment items(seventeen open-ended questions, three essays, and two portfolios) with concrete grading criteria were developed. Eight open-ended items were applied to 240 10th graders to evaluate reliabilities of the test which consisted of four items per each chapter. The results would be suggested that the applied items were valid for performance assessment because item difficulties and item discriminations were proper. There was not much differences in item discrimination between interpretation from classical test theory and that from polytomous item response theory. However, there were some differences in item difficulties between the interpretations of two theories because the characteristics of examinees were reflected in classical test theory.

• Proceedings of the KSPS conference
• /
• 2000.07a
• /
• pp.338-349
• /
• 2000

Pronunciation teaching is once again coming into the foreground of ELT. Japan is, however, lagging far behind many countries in the development of pronunciation curricula and in the actual speech performance of the Japanese learners of English. The reasons for this can be found in the prevalence of communicative methodologies unfavorable for pronunciation teaching, in the lack of trained professionals, and in the large numbers of students in Japanese foreign language classes. This paper offers a way to promote foreign language pronunciation teaching in Japan and other countries by means of employing computer and internet facilities. The paper outlines the major directions of using modem speech technologies in pronunciation classes, like EVF (electronic visual feedback) training at segmental and prosodic levels; automated error detection, testing, grading and fluency assessment. The author discusses the applicability of some specific software packages (CSLU, SUGIspeech, Multispeech, Wavesurfer, etc.) for the needs of pronunciation teaching. Finally, the author talks about the globalization of pronunciation education via internet resources, such as computer corpora and speech and pronunciation training related web pages.

• Journal of the Korea Safety Management & Science
• /
• v.25 no.4
• /
• pp.57-65
• /
• 2023

The public safety management guidelines were introduced in 2019 and continue to be dedicated to advancing comprehensive measures for public safety management, with a primary focus on prioritizing the safety and well-being of the public within governmental institutions. To achieve this goal, our previous study developed a establishment procedure of risk assessment-based safety inspection system for public institutions that order construction projects and applied it to highway construction projects to evaluate its effectiveness. To enhance the practicality of the establishment procedure, it is essential to collect and analyze feedback from stakeholders regarding its performance and suitability. This study conducted a survey involving 200 participants who had experience with the establishment procedure, and performed statistical analyses to evaluate its performance and applicability. The survey results indicated that the participants reported a high level of satisfaction (scoring 4 and above on a 5-point Likert scale) in several areas: specialization of safety inspection items for different types of work (with a satisfaction rate of 65%), the evaluation process for safety ratings (64.5%), and their willingness to recommend the procedure to other institutions (75.5%). In the factor analysis with Varimax rotation, two factors emerged: (1) a specialization factor related to safety inspection items, and (2) a grading factor associated with safety evaluation results. Regression analyses of these factors unveiled significant positive relationships with improvements in safety and health performance, including the prevention of fatal accidents, heightened safety responsibility, and raised safety inspection standards. The establishment procedure of safety inspection system developed in our previous study can play a crucial role in reducing accidents resulting in fatalities and injuries at construction sites, ultimately contributing to a safer working environment for all involved parties.

• Journal of the Korean School Mathematics Society
• /
• v.11 no.4
• /
• pp.543-567
• /
• 2008

The current 2007 Mathematics Curriculum in Korea emphasizes mathematical problem solving, advanced mathematical thinking and effective mathematical communicating. Therefore, in order to assess and evaluate these important thinking attributes, performance evaluation using descriptive and essay type of assessments are emphasized. In this paper, analysis of the elementary mathematics curriculum is used to develop descriptive assessment problems and grading rubrics that could be used objectively and consistently by teachers of the grade 6 school mathematics. The assessment problems were developed, pilot tested, revised, implemented and analyzed in detail to understand the overall effectiveness of the descriptive evaluation method in school mathematics.

• Journal of Educational Research in Mathematics
• /
• v.18 no.3
• /
• pp.335-352
• /
• 2008

The purpose of this research was to investigate the descriptive evaluation method that focuses on the problem solving process of the student. The goal was to evaluate the students' understanding of the subject rather than the students' ability to find the final answer. The descriptive evaluation is being suggested as a way of examining the thought process of the student by performing a structured analysis of the problem solving process. Today, there are not enough descriptive evaluation resources available for teachers to effectively carry out this alternative assessment method in the elementary school mathematics curriculum. This research is a case study on the development of resources for descriptive evaluation in grade 4 mathematics. We designed the development process for descriptive evaluation and its rubric for all 8 units of the 4-Na level of mathematics in the elementary school curriculum. Three descriptive problems were developed for each of the 8 units for a total of 24 problems. The rubric consisted of three areas of assessment, 1) understanding of the problem, 2) problem solving, and 3) mathematical communication. The problems were first pilot tested in two 4th grade classes. Modified problems were then tested in a different 4th grade classroom. The study showed that the three defined areas of evaluation framework (problem understanding, problem solving and mathematical communication) were measurable and analyzable using the developed grading rubric. We then conclude that he descriptive evaluation could be used as an effective tool for improving teacher performance in elementary school mathematics.

• ETRI Journal
• /
• v.46 no.1
• /
• pp.82-95
• /
• 2024

As automated essay scoring (AES) has progressed from handcrafted techniques to deep learning, holistic scoring capabilities have merged. However, specific trait assessment remains a challenge because of the limited depth of earlier methods in modeling dual assessments for holistic and multi-trait tasks. To overcome this challenge, we explore providing comprehensive feedback while modeling the interconnections between holistic and trait representations. We introduce the DualBERT-Trans-CNN model, which combines transformer-based representations with a novel dual-scale bidirectional encoder representations from transformers (BERT) encoding approach at the document-level. By explicitly leveraging multi-trait representations in a multi-task learning (MTL) framework, our DualBERT-Trans-CNN emphasizes the interrelation between holistic and trait-based score predictions, aiming for improved accuracy. For validation, we conducted extensive tests on the ASAP++ and TOEFL11 datasets. Against models of the same MTL setting, ours showed a 2.0% increase in its holistic score. Additionally, compared with single-task learning (STL) models, ours demonstrated a 3.6% enhancement in average multi-trait performance on the ASAP++ dataset.