• 한국정보교육학회:학술대회논문집
• /
• 2010.01a
• /
• pp.149-156
• /
• 2010

컴퓨터와 인터넷이 보편화된 지금 학교현장에서는 효율적인 통계 분석이 가능하고, 공간적 시간적 제약을 극복한 웹 기반 교원능력개발평가 시스템이 필요하다. 본 논문에서는 현재 웹 기반으로 이루어지고 있고 교원평가 시스템을 비교 분석하여 그 특징을 알아본 후 그 제한점을 극복하고 사용자의 사용성 향상을 위한 웹 기반 교원능력개발평가 시스템을 제안하고 설계한다. 본 논문에서 제안하고 설계한 교원능력개발평가 시스템의 사용성 향상 요소는 크게 세 가지이다. 첫 번째는 평가문항별 키워드를 레이어 방식으로 설명하여 평가자의 평가문항 이해를 돕는 것이다. 두 번째는 평가자를 위해 평가보조자료를 첨부하여 공정하고 객관적인 교원능력개발평가가 이루어지도록 하는 것이다. 세 번째는 통계 처리가 힘든 서술형 문항에 키워드별 분류 기능을 추가하여 교원의 자기 발전의 자료로 활용하도록 하는 것이다. 이러한 웹 기반 교원능력개발평가 시스템은 학교 교육의 질 향상 및 공교육에 대한 신뢰를 제고하는데 기여할 수 있다.

• The KIPS Transactions:PartD
• /
• v.9D no.3
• /
• pp.511-522
• /
• 2002

WBI (Web-Based Instruction), a web-based tool for teaching the students at a long distance, makes possible to Interact between learners and instructors, provides a wide variety of learning materials, has an advantage of overcoming spatial constraints. In this paper, as a model of using the web for education, a web-based education-evaluation system has been designed and implemented. Web-based education-evaluation system has to be equipped with both of the online setting question mode and the upload setting question mode, the former makes questions on web and the latter uploads the setted questions on offline with settling a defeat of the existing systems on setting questions. And the system has to be equipped with the function of analyzing the questions that gives teacher several kinds of analysis information and makes possible to feedback to questions by adjusting the difficulty and revising the questions. In this paper, a system that reflects the above requirements has been designed and implemented with PHP script language and MySQL database system.

• Journal of Science Education
• /
• v.47 no.2
• /
• pp.211-224
• /
• 2023

The purpose of this study is to suggest how to investigate the reliability of the assessment, which consists of items generated by automatic item generation using empirical example data. To achieve this, we analyzed the illustrative assessment data by applying the multivariate generalizability theory, which can reflect the design of responding to different items for each student and multiple error sources in the assessment score. The result of the G-study showed that, in most designs, the student effect corresponding to the true score of the classical test theory was relatively large after residual effects. In addition, in the design where the content domain was fixed, the ranking of students did not change depending on the item types or items. Similarly, in the design where the item format was fixed, the difficulty showed little variation depending on the content domains. The result of the D-study indicated that the original assessment data achieved a sufficient level of reliability. It was also found that higher reliability than the original assessment data could be obtained by reducing the number of items in the content domains of operation, geometry, and probability and statistics, or by assigning higher weights to the domains of letters and formulas, and function. The efficient measurement conditions presented in this study are limited to the illustrative assessment data. However, the method applied in this study can be utilized to determine the reliability and to find efficient measurement conditions for the various assessment situations using automatic item generation based on measurement traits.

• The Journal of the Korea Contents Association
• /
• v.13 no.12
• /
• pp.321-327
• /
• 2013

Impaired naming difficulty is common in normal elderly as well as in patients with neurological impairment. The 60-item Korean version-Boston Naming Test(K-BNT) is one of the most commonly used test for measuring confrontational naming ability. However, age-related cognitive decline may make the elderly difficult concentrating during the 60-item test, therefore, item reduction of the K-BNT would improve test validity and reliability. Thus, the purpose of this study was to develop a short form of the K-BNT based on Item Response Theory(IRT). Considering item-fit index, sex factor, and item difficulty through Rasch analysis, the 15-item K-BNT(i.e., K-BNT-15) was developed. Via administration of the K-BNT-15, we observed age-related decline in naming ability and significantly different performance between the normal elderly and patients with mild cognitive impairment. This study demonstrates the utility of IRT for developing a short-form language evaluation tool. The K-BNT-15 can be effective as a language screening tool to differentiate between normal aging and pathological diseases.

• Journal of Korean Society of Forest Science
• /
• v.111 no.3
• /
• pp.450-460
• /
• 2022

This study was conducted to develop a forest ecological sensitivity scale and verify its reliability and validity to evaluate the effectiveness of forest education programs and assess the forest ecological sensitivity of people. Forest ecological sensitivity was defined through literature research and expert meetings. A total of 106 preliminary questions, which were developed by dividing the factors of each question, were used to conduct a preliminary survey on 256 adults. Based on the survey results, an exploratory factor analysis was conducted, and 19 questions were selected, excluding overlapping items between factors and items not suitable for factor load. This was a nationwide study in which 557 adult individuals participated, and 533 surveys were used for analysis. According to the results of the exploratory and confirmatory factor analysis, the forest ecological sensitivity scale consisted of 10 questions and 3 factors (personal stage, social stage, and integrated stage) and demonstrated good suitability. The forest ecological sensitivity questions developed in this study can be used to evaluate the effectiveness of forest education programs, which can help contribute toward improving the quality of such programs.

• Journal of Gifted/Talented Education
• /
• v.25 no.2
• /
• pp.237-259
• /
• 2015

Teachers in music(including Korean traditional music) gifted education are a significant variable in both identifying the giftedness of students and a successful instruction. The purpose of this study is to develop the Scale for Screening the Qualified Teachers for the Gifted in Korean traditional and western Music(SSQTGM), and to examine the validity and reliability of the SSQTGM. To achieve this purpose, this study administered the SSQTGM to 175 teachers of gifted students aged between 13 and 15 in middle schools for the arts. To validate the SSQTGM, I analyzed the criteria of the SSQTGM, and conducted an exploratory and confirmative factor analysis. I also examined an internal consistency. As a result of the exploratory factor analysis, I finally collected 41 items of the SSQTGM. Futhermore, I could identify psychological constructs of the qualified teachers for the gifted in Korean traditional and western music. In consequence of the confirmative factor analysis, the model provided a good fit to observe data. As a result of the reliability analysis, the internal consistency of knowledge in the music(korean traditional music) verified cronbach's ${\alpha}=.937$, and the expertise of the class management and instruction verified cronbach's ${\alpha}=.942$. Also, the teachers' aptitude and personality verified cronbach's ${\alpha}=.963$. This result of the construct validation reflects the fact that the SSQTGM is an available scale that can be applied in gifted education field instantly.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.11
• /
• pp.227-234
• /
• 2023

The evaluation of students' computational thinking begins with the evaluation of knowledge about the concepts and principles of computing. In this study, we analyzed the differences in teachers' perceptions depending on the description method of the bebras challenge questions to evaluate computer science knowledge. First, we classified the questions into two types depending on whether computer science terms were included or not. Also we made a computational thinking questionnaire with two types of questions and surveyed 72 major teachers. As a result, teachers expressed the opinion that the evaluation questions that revealed computer science terms were appropriate as evaluation questions for information subjects. They also perceived it as more helpful in assessing computational thinking and coding skills. Through the results of this study, we suggested that the way the questions are worded is important in the process of assessing students' understanding of computer science concepts and computational thinking skills.

• The Journal of Korean Association of Computer Education
• /
• v.10 no.3
• /
• pp.1-8
• /
• 2007

In this paper, we introduce a new measure called surprisal that estimates the informativeness of transactional instances and attributes in the item response dataset and improve the quality of association rules. In order to this, we set artificial dataset and eliminate noisy and uninformative data using the surprisal first, and then generate association rules between items. And we compare the association rules from the dataset after surprisal-based pruning with support-based pruning and original dataset unpruned. Experimental result that the surprisal-based pruning improves quality of association rules in question item response datasets significantly.

• Journal of Educational Research in Mathematics
• /
• v.25 no.3
• /
• pp.281-302
• /
• 2015

In the current study, answer sheets from 8007 students in 236 Korean schools were selected and analyzed to examine errors that emerge in the process of solving descriptive questions of the National Educational Achievement Assessment in mathematics. Questions used in the analysis were response assessment covering middle school mathematics topics: "mathematical symbols and equations" and "functions." The behavioral domain of the questions was that of "problem solving and computation," which requires establishing an equation for a word problem and allows the calculation of an answer that meets a certain condition. The analysis results revealed various errors in each stage of each question, from understanding to solving; the study attempts to conjecture causes for these errors and draw pedagogical implications.

• The Journal of the Korea Contents Association
• /
• v.10 no.7
• /
• pp.438-448
• /
• 2010

This study is aimed for a scale of assessing the work performance, educational operations, and so on of preschool teachers by the peers. It has been previously discussed the studies of scale assesment of preschool teachers, however, the scale assesment had been a self-assesment or a transitory assesment by the senior teachers and principals only. This study is developed to assess the preschool teachers through the peer- teachers. Peer-assesment has strong points that to assess the teachers constantly can be more accurate, the assessment result can be used as the basic material for peer scholarship, and it can give the preschool teachers an opportunity to be recognised on tasks. There are 51 questions are developed to assess the peers. 9 sections total; 1) 6 questions on body human nature 2) 6 questions on view on career 3) 3 questions on self-development 4) 4 questions on curriculum planing 5) 12 questions on administering and managing 6) 6 questions on understanding children 7) 4 questions on managing a class 8) 7 questions on work performance 9) 3 questions on teaching practice. Each section is surveyed by 150 preschool teachers, and the all questions are analysed statistically appropriate of a scale(validity of contents, validity of surveyors, inter-item consistency) and appropriate of each section. It is known this peer assesment of preschool teachers is an appropriate scale.