• Title/Summary/Keyword: 채점자

Search Result 98, Processing Time 0.025 seconds

A Study on Evaluation and Screening Methods of Research Proposals for National Research Foundation of Korea Grants (국가연구개발사업 연구과제 선정방식 개선에 관한 연구 : 한국연구재단 지원사업을 중심으로)

  • Lee, Youn-Kou;Son, Chung-Geun
    • Journal of Korea Technology Innovation Society
    • /
    • v.12 no.3
    • /
    • pp.614-637
    • /
    • 2009
  • To enhance the efficiency of national R&D programs, it is the most important thing to establish the optimized evaluation system. This is because the distorted evaluation could be an obstacle to select the best suited research team and lead the desirable research result. In current evaluation process of national R&D program, it is the most frequently used method for eliminating an evaluator's biased view to exclude both the maximum and minimum scores. However, there are several limitations in this stereotype method. Therefore, this study analyzes some real cases to derive the problems from the stereotype method and then recommends the complementary alternatives which can enhance the reliability of the evaluation system for national R&D programs. The results acquired from this study seem to be helpful to increase the agreement of the applicants on the evaluation results and ultimately to maximize the efficiency of national R&D program. In addition, they can be applied to various field with respect to the methodology for ranking decision.

  • PDF

Analysis of Integrated Korean Textbooks Based on the Components of Writing Tasks for Performance (수행을 위한 쓰기 과제의 구성요소를 기반으로 한 통합형 한국어교재 분석)

  • Park, Eunha
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.4
    • /
    • pp.197-206
    • /
    • 2019
  • This study aims to analyze through the integrated textbooks whether writing tasks are designed to be successful in cultivating students' writing abilities in the general-purpose Korean language education. First, we established the concept and the components of the writing task based on the definitions mentioned in previous research. The analysis of the types of writing tasks revealed "free writing" and "imitation and writing" to be the most frequent types of writing tasks in both textbooks. The textbooks have only twenty-one subjects in common. And most instructions provide only themes and genres, excluding the purpose, form, quantity, and time necessary for the article or for comprehending the instructions. In these tasks, the reading passages are most often explanatory text. The scoring criteria and time were not provided for the evaluation criteria and other factors. Therefore it became necessary to express the components of the writing task as explicitly and concretely as possible to improve learners' performances.

Suggestions for Improvement for KSL Screening Tests: From an Analysis of WIDA Tests (WIDA 평가 고찰을 통한 한국어(KSL) 교육과정 진단평가 개선 방안 탐색)

  • Lee, Inhye
    • Journal of Korean language education
    • /
    • v.29 no.1
    • /
    • pp.163-197
    • /
    • 2018
  • The present study suggests ways to improve the Korean proficiency screening test through an analysis of WIDA tests. A review of WIDA Screener, WIDA MODEL, and W-APT reveals that each of these three tests consists of four or five tests, corresponding to grade-level clusters. In addition, the WIDA screening tests assess both English for social communication and academic English, according to WIDA's five English Language Development (ELD) standards. Thematic folders of the ELD standards have different ranges of item difficulty, and the WIDA screening tests are adaptive tests. Lastly, the writing tests consist of performance-based tasks, and the rubric is holistic. As suggestions for improvement for Korean screening tests of the KSL curriculum, this study proposes (a) to devise items to assess academic Korean, so as to evaluate students' overall proficiency more accurately, (b) to utilize an adaptive method to screen students' proficiency more efficiently, and (c) to revise the writing tasks and rubric of the current KSL screening tests.

A Study of Korean Adolescents' Stress and Social Support: Focusing on stress events, social supporters and types of social support (청소년의 스트레스와 사회적 지원에 관한 연구: 스트레스 생활사건, 사회적 지원 제공자와 유형을 중심으로)

  • Young-Shin Park ;Sung-Sook Jeon ;Ju-Yeon Son;Young-Ja Park ;Ok-Ran Song ;Hoang-Bao-Tram Le
    • Korean Journal of Culture and Social Issue
    • /
    • v.22 no.4
    • /
    • pp.487-522
    • /
    • 2016
  • The main purpose of this research is to investigate Korean adolescents' perception of stress experiences, and related social support. To this end, adolescents were asked about stress events, as well as stress symptoms, in their lives. Also, the adolescents were asked about the people that provided social support and the types of social support provided. The participants were 952 Korean adolescents (Primary 219; Middle 280; High 212; University 241). Among the four measures (stress events, stress symptoms, social supporters, and types of social support), the measure of stress symptoms yielded a reliability of Cronbach α=.88, while the remaining three measures yielded an inter-judger reliability of 89.6%, Kappa=.87. The results were as follows. First, for stress events, the most frequent responses were related to Academic Achievement, followed by Career/Job, Family Relations, Friend Relations, Lack of Capacity, and Financial Difficulties. For high-school students the most frequent responses were related to Academic Achievement, while for university students Career/Job. Second, for stress symptoms there were significant differences among the groups, in that the high-school students showed the highest level of symptoms, while primary school students the lowest. Third, for social supporters, the most frequent responses were related to Friends, followed by Myself, Parents, Teacher, Siblings, and Seniors/Juniors. As the groups aged (from primary to university), support from Friends and Seniors/ Juniors increased, while support from Parents decreased. Fourth, for the types of social support, the most frequent responses were related to Emotional Support, followed by None, Advice, Supporter Directly Solved Problem, and Talked with Me. The highest frequencies of responses were found for Emotional Support among all groups. As the groups aged (from primary to university), Advice increased while Supporter Directly Solved Problem decreased.

An Analysis of Trends in Natural Language Processing Research in the Field of Science Education (과학교육 분야 자연어 처리 기법의 연구동향 분석)

  • Cheolhong Jeon;Suna Ryu
    • Journal of The Korean Association For Science Education
    • /
    • v.44 no.1
    • /
    • pp.39-55
    • /
    • 2024
  • This study aimed to examine research trends related to Natural Language Processing (NLP) in science education by analyzing 37 domestic and international documents that utilized NLP techniques in the field of science education from 2011 to September 2023. In particular, the study systematically analyzed the content, focusing on the main application areas of NLP techniques in science education, the role of teachers when utilizing NLP techniques, and a comparison of domestic and international perspectives. The analysis results are as follows: Firstly, it was confirmed that NLP techniques are significantly utilized in formative assessment, automatic scoring, literature review and classification, and pattern extraction in science education. Utilizing NLP in formative assessment allows for real-time analysis of students' learning processes and comprehension, reducing the burden on teachers' lessons and providing accurate, effective feedback to students. In automatic scoring, it contributes to the rapid and precise evaluation of students' responses. In literature review and classification using NLP, it helps to effectively analyze the topics and trends of research related to science education and student reports. It also helps to set future research directions. Utilizing NLP techniques in pattern extraction allows for effective analysis of commonalities or patterns in students' thoughts and responses. Secondly, the introduction of NLP techniques in science education has expanded the role of teachers from mere transmitters of knowledge to leaders who support and facilitate students' learning, requiring teachers to continuously develop their expertise. Thirdly, as domestic research on NLP is focused on literature review and classification, it is necessary to create an environment conducive to the easy collection of text data to diversify NLP research in Korea. Based on these analysis results, the study discussed ways to utilize NLP techniques in science education.

Development and application of algorithm judging system : analysis of effects on programming learning (알고리즘 자동평가 시스템의 개발 및 적용 : 프로그래밍 학습 효과 분석)

  • Chang, Won-Young;Kim, Seong-Sik
    • The Journal of Korean Association of Computer Education
    • /
    • v.17 no.4
    • /
    • pp.45-57
    • /
    • 2014
  • Many studies on algorithm judging system which verifies the correctness and the time efficiency of your program have been underway recently, most of which are on an online judging system focused on programming contests. However this study is mainly about development and application of the judging system based on client-server. Especially, we designed to promote metacognition and motivation which are emphasized in CRESST model, and implemented the total system that consists of the problem, data set, validation program, and user service environments. We applied our system to elementary, middle, and high school students, and We noticed a significant difference of average score between the experimental and control group in posttest and concluded that the teaching method using our system gave the bigger positive effects on programming learning.

  • PDF

The Design And Implementation of the Web-Based Performance Assessment System for the Effective Instruction and Learning (효율적 교수학습을 위한 웹 기반 수행평가 시스템 설계 및 구현)

  • Kwon, Hyung-Kyu;Lee, Eun-Jung
    • Journal of The Korean Association of Information Education
    • /
    • v.8 no.1
    • /
    • pp.125-137
    • /
    • 2004
  • This research presents a performance assessment system of which the purpose is to increase the effectiveness of the instruction and learning through the on-the-job superintendent of the instructor, the self-directed learning of the learner, and the interaction between instructors and students. The presented performance assessment system applies the problem-based situated learning of the web-based performance assessment to the production, the execution, the assessment, and the transmission of the test. For the effective administration and learning in the school, we applies the Problem-Based Learning of constructivism and the web-based situated learning of the learning community to the system design. The production of the web-based performance assessment shows that the problem-based and self-directed learning of the assessment are achieved through the web-based automatic production of the performance assessment, and the contextual learning by case-based learning is performed by the production of the template of the performance assessment.

  • PDF

Consistency in Assessment of Creative Products in Terms of Evaluators' Knowledge of Creativity Assessment Criteria and the Type of Assessment Tools (창의적 산출물 평가에서 평정자의 지식 및 평가 도구 유형에 따른 일치도 분석)

  • Lee, Su Jin;Choe, Ho Seong;Park, Kyung Hee
    • Journal of Gifted/Talented Education
    • /
    • v.26 no.4
    • /
    • pp.677-697
    • /
    • 2016
  • This study analyzed the difference in evaluation results in evaluating identical products by applying two different types of evaluating scales, Creative Product Analysis Matrix (CPAM) and Creative Product Semantic Scale (CPSS) by O'Quin and Bessember (1989). As a result, evaluation based on explicit knowledge scored lower than evaluation based on implicit knowledge, implying that the evaluation becomes stricter. When evaluated with CPSS, which as relatively more segmentalized grading criteria, all sub-dimensions of creativity showed low scores, and it show that when evaluator's first impression or personal evaluation standard on the products is firm, they may not be evaluated by the evaluation tools. Gifted education teachers were giving similar evaluations as experts in creative product evaluation, and understanding the product evaluation tool fully in advance before teaching or evaluating products may lead to the generation of newer, more useful and appropriate, and highly creative product with high solvability.

Analysis on Kindergarten Teachers' Stage of Concerns about Software Education: An Application of the Concerns-Based Adoption Model(CBAM) (유치원 교사의 소프트웨어 교육에 대한 관심도 분석: 관심중심수용모형(CBAM)을 중심으로)

  • Park, Sun-Mi;Jung, Ji-Hyun;Kang, Min-Jeng
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.2
    • /
    • pp.462-471
    • /
    • 2018
  • Even though software (SW) education has not been considered part of the current national kindergarten curriculum, in practice there is growing interest in adopting it. Teachers would be expected to play a key role in the successful introduction and implementation of new educational changes, such as SW education. In preparation for its adoption in ECE, it would be useful to determine ECE teachers' perception and attitudes toward early childhood software education. For this study, 219 ECE teachers' level of concern toward SW education was surveyed using the Stages of Concern Questionnaire. It was found that the teachers' level of concern was the highest at stage 0-Unconcerned and that they had high levels of stage management, personal and informational concern. Thus, a non-user pattern was mostly indicated. However, compared to the typical non-user pattern, the pattern aspect close to critical non-user ever appeared to some extent. In addition, a significant difference in the level of concern was shown at all stages depending on the awareness of the necessity for SW education. The teachers with SW training experience showed a higher intensity only at stage 0. There was a statistically significant difference in stages 0 and 6 depending on the future implementation decision. These results will be utilized as a resource in building an ECE teachers' support system according to their level of concern about SW education.

Implementation of a Coding Style Checking System in an Online Judge System (온라인 평가 시스템에서 코딩 스타일 검사 시스템 구현)

  • Yeonghun Kim;Junseok Cheon;Gyun Woo
    • The Transactions of the Korea Information Processing Society
    • /
    • v.13 no.9
    • /
    • pp.437-443
    • /
    • 2024
  • Adhering to coding style guidelines is crucial for both companies and developers as it improves code readability and reduces the costs associated with testing and maintenance. However, teaching coding style in programming courses poses challenges. Setting up an environment for learning coding styles is hard, and there are no predefined coding style rules for beginners. From the learners' perspective, since adherence to coding styles does not affect their grades, they do not feel a strong need to learn them. This paper introduces a coding style checking system for an online evaluation system. The proposed system is implemented to check and evaluate coding styles in C, Java, and Python. Additionally, we applied 234 out of the 1,023 rules provided by the language-specific tools, which is 23.08%, allowing for the application of coding style rules according to the course progression. Moreover, we motivated learners to improve their coding style by adding quality scores to their basic scores. After introducing the coding style education system, the number of students scoring over 25 points on their initial submissions increased by 149.47%, from 18 students in the first week to 44 students in the sixth week. Learners used the coding style checking system to learn how to apply coding style rules and subsequently implemented their code in adherence to the specified coding styles.