• Title/Summary/Keyword: Item difficulty

Search Result 285, Processing Time 0.025 seconds

Design and implementation of evaluation system in item pool with learning ability and course difficulty (학습 능력과 영역별 난이도를 고려한 문제은행 방식의 학습평가 시스템 설계 및 구현)

  • Tae-O Park;Bae-Ho Lee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2008.11a
    • /
    • pp.1149-1151
    • /
    • 2008
  • 본 논문에서는 학습자들의 학습특성 및 학습 능력에 따라 문제은행에서 문항을 선택하는 기준과 학습코스를 재구성하기 위한 방법을 제안한다. 본 논문에서 제안한 시스템은 학습단계와 평가단계를 연계하여 평가 단계에서 추정된 학습자의 능력에 따라 차기 학습단계에서 수준별 학습내용을 재구성하여 학습자에게 제공함으로써 합리적인 학습이 가능하도록 지원하고 있다. 이를 위해 학습자의 학습능력을 정확하게 판단 할 수 있도록 문항반응 이론에 의한 학습자 능력평가 모듈을 만들고, 가중치 값을 갖는 문항특성모델을 개발하여 적용함으로써 학습과정의 우선순위를 부여하여 학습코스를 재구성하는 시스템을 설계 및 구현하였다.

Design and Implementation of the Customized Contents Organization Engine (맞춤형 콘텐츠 구성 엔진의 설계 및 구현)

  • Heo, Sun-Young;Kim, Eun-Gyung
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2009.10a
    • /
    • pp.599-601
    • /
    • 2009
  • In currently being adopted as a e-leaning standard, SCORM it is difficult to provide the customized contents to a learner by changing the learner's level at runtime, and to control selective studying. So, we designed and implemented the customized contents organization engine(CCOE) in order to complement SCORM's faults in this paper. The CCOE consists of a level evaluation module, a contents re-organization module and a question item selection module. A level evaluation module evaluates the learner's level based on a question item reaction theory. And a question item selection module selects some random items by each level or by considering the learner's level which is then provided to a studying before evaluation, a section evaluation, and a quiz. And then this module transmits the selected items to the contents reorganization module for providing the quiz. A contents re-organization module selects the customized contents based on the learner's level by searching the tagged difficulty to the content, and creates the sequence with the selected items and the transmitted items from the question item selection module. If proposed in this paper CCOE is applied, the higher effectiveness of learning is expected by providing the customized learning contents based on the re-evaluated learner's level by each section.

  • PDF

Reactive and Proactive Aggression, the Validation of the Reactive-Proactive Questionnaire (RPQ): Focusing on ESEM and Rasch (반응적 공격성과 주도적 공격성, Reactive-Proactive Questionnaire(RPQ) 타당화 연구: ESEM과 Rasch를 중심으로)

  • Seonyoung Park;Jonghan Sea
    • Korean Journal of Culture and Social Issue
    • /
    • v.30 no.2
    • /
    • pp.159-192
    • /
    • 2024
  • The purpose of this study is to validate the Reactive-Proactive Aggression Questionnaire (RPQ), a tool for measuring reactive-proactive aggression, in the context of South Korea. A thorough translation was conducted in collaboration with the original author. An exploratory factor analysis (EFA), exploratory structural equation modeling (ESEM), rating scale model (Rasch), differential item functioning (DIF), and convergent validity were performed on a sample of 510 South Korean individuals. The results revealed a two-factor structure of reactive and proactive aggression after removing one item showing dual loading. Rating scale analysis based on the Rasch model indicated the appropriateness of the 3-point Likert scale, with all items meeting fit criteria. Although the separation index and separation reliability of proactive aggression was marginally lower, the overall discrimination between participants and items was satisfactory. Examination of participant-item distribution indicated a suitable alignment between reactive aggression and participant ability levels, whereas proactive aggression exhibited slightly elevated item difficulty. Furthermore, three items were found to function differently based on gender. A moderate but statistically significant positive correlation was found between the Barratt Impulsiveness Scale-11-R (Korean version) and RPQ from the results of the convergent validity evaluation. Overall, this study employed rigorous statistical methods to validate the suitability of the RPQ for use in Korea, taking cultural nuances into account, and introduced the concepts of reactive and proactive aggression to the Korean general population.

An Analysis of Paper and Pencil Test Items of Life Science I in High School (고등학교 생명 과학 I의 지필평가 문항 분석)

  • Lee, Donghoon;Jeong, Eunyoung
    • Journal of Science Education
    • /
    • v.38 no.3
    • /
    • pp.670-690
    • /
    • 2014
  • The purpose of this study was to analyze paper and pencil test items of life science I in high school to diagnose problems of the test items developed by teachers, and to provide some implication for better assessment. 690 selection-type items and 162 supply-type items in life science I were collected from 10 general high schools. In the analysis of test items, the ratio of the selection-type item and the supply-type item was 81:19 in the number of items based on item type, while the ratio was 74.4:25.6 in the distribution of marks, indicating that the distribution of marks compared to the number of items was higher in the supply-type items. In the analysis by the Bloom's revised taxonomy of educational objectives, the items of 'conceptual knowledge' in the knowledge and those of 'understanding' in the cognition process were shown most in both the selection-type item and the supply-type item. In the analysis by the science assessment frameworks of NAEA, the items of 'knowledge' were shown 9 times more than those of 'inquiry'. When compared to the level of difficulty presented in the two-way specification table and the percentage of correct answers in the selection-type item, the concurrence was 41.5%. When compared to the ratio of number of items based on the item type of the supply-type items, the short-answer items were 34.0%, the descriptive items were 61.1%, and the drawing items were 4.9%. The drawing items were mainly developed in the unit of 'Cells and Continuity of Life'. When the descriptive items were classified by the acceptance of response, all the items were 'response restricted' type, and the items of 'restricted in content range' type among them were highest. When the items were classified by presentation of data, the items of 'presentation of data' type were highest(65.4%), and when classified by type of question, the items of 'knowledge description' type were highest(80.4%). In conclusion, it is needed to develop items belonging to 'inquiry' area more in the school, and to increase the ratio of the descriptive items, presenting various types of items.

  • PDF

Cross-Sectional Item Response Analysis of Geocognition Assessment for the Development of Plate Tectonics Learning Progressions: Rasch Model (판구조론의 학습발달과정 개발을 위한 지구적 인지과정 평가의 횡단적 문항 반응 분석: Rasch 모델)

  • Maeng, Seungho;Lee, Kiyoung
    • Journal of The Korean Association For Science Education
    • /
    • v.35 no.1
    • /
    • pp.37-52
    • /
    • 2015
  • In this study, assessment items to examine geocognition on plate tectonics were developed and applied to middle and high school students and college students. Conceptual constructs on plate tectonics are Earth interior structure, specific geomorphology, and geologic phenomena at each plate boundary. Construct for geocognition included temporal reasoning, spatial reasoning, retrospective reasoning, and system thinking. Pictorial data in each item were all obtained from GeoMapApp. Students' responses to the items were analyzed and measured cross-sectionally by Rasch model, which distinguishes persons' ability levels based on their scores for all items and compared them with item difficulty. By Rasch model analysis, Wright maps for middle and high school students and college students were obtained and compared with each other. Differential Item Functioning analysis was also implemented to compare students' item responses across school grades. The results showed: 1) Geocognition on plate tectonics was an assessable construct for middle and high school students in current science curriculum, 2) The most distinguished geocognition factor was spatial reasoning based on cross sectional analysis across school grades, 3) Geocognition on plate tectonics could be developed towards more sophisticated level through scaffolding of relevant instruction and earth science content knowledge, and 4) Geocognition was not a general reasoning separated from a task content but a content-specific reasoning related to the content of an assessment item. We proposed several suggestions for learning progressions for plate tectonics and national curriculum development based on the results of the study.

A Content Analysis of the test of the National Examination for Registration Nurses in Korea over 3 years (간호사 국가고시문제의 내용분석)

  • 서문자;윤순녕;유지수;송지호;최경숙
    • Journal of Korean Academy of Nursing
    • /
    • v.26 no.1
    • /
    • pp.73-93
    • /
    • 1996
  • This study aimed to analyse the test contents of the national examination for the registered nurses (NERN) over 3 years from 1991 to 1993 in Korea. In recent years in Korea, the MCQ(multiple choice question) has been showing to be a highly recognized method for assessing the qualification of registered nurses. Unfortunately, nursing faculties have found NERN had some bad MCQs through having evaluation workshop for Some MCQs often provide so many unwriting clues which become a bias of the results, and some items fell into the category of the lower level of educational taxonomy such as isolated recall a fact or data. Frequently the stems of the questions are ambigous, unclear, disputable, esoterical or trivial. Considering those fallacies of the national examination, it is very critical to review the test items to see whether it is of high quality, is more fair, reliable and objective in depth. Therefore, this study was done to provide data for the improvement of the test contents as well as the teachers's assessment skill. For this study, the ad hoc committee was composed of 16 members, including 5 education board members of Korean Academic Nurses Association and 11 nursing faculty members. This committee had one day panel discussion and filled the checklist for this study. The process of analysing data was held over 10 times during 1992-1994. The analysis focussed on educational taxonomy such as cognitive domain(knowledge), psychmotor domain (skill), affective domain(attitude) and the level of learning such as recall, understanding, problems solving, and learning area of theory and practice, and the learning content categorised by nursing process and disease process. The test analysed using difficulty index and the structure of the test items was analysed. The conclusions and suggestion as follows : 1. In learning area, the average ratio of the theory and practice was 1 : 1.1 which was less than 1 : 2 suggested by Korean National Health Institute, and the ratio was different by the 8 leaning subjects of nursing. 2. In category of the educational taxonomy, the knowledge domain was emphasized mostly(79. 7%), the skill domain was 14.9%, and the attitude domain was 5.4% only. 3. In the level of learning, generally, the test items of the level of recall(45.5%) and the understanding(46.3%) were covered almost and the problem solving was 8.1%. 4. In the learning contents, generally, the test items related to nursing process was 67.2% and that of disease process was 32.8%. However, this proportion was different by the 8 leaning subjects. Even though the nursing diagnosis has been emphasized in nursing curricula recently, the test items of this was identified very few. 5. In the structure of the test item, some were not clear, incorrect grammar, unclear description and some have clues to answer. 6. In the item analysis, the non-acceptable level of the difficulty index (means too easy) was 65.7%, and the acceptable level was 33.9%. Considering the results we would like to suggest the followings, 1. Since the test items of knowledge domain was dominant, the test items of the practice domain and attitude domain should be emphasized more. 2. The regular review and analysis of NERN should be arranged in order to improve the quality of the test items which will give influence to the nursing education positively.

  • PDF

Development of Korean Version of the Dementia Eating Evaluation Tool based on Behavioral Observation (행동관찰 기반 치매 식이 평가 도구의 한국판 개발)

  • Seo, Sang-Min;Woo, Hee-Soon
    • Therapeutic Science for Rehabilitation
    • /
    • v.9 no.1
    • /
    • pp.56-68
    • /
    • 2020
  • Objective : This study introduces domestic and overseas systematic assessment tools that can identify eating problems of dementia patients based on abnormal behavior observations and turns them into Korean through the verification of content placement by expert groups. Methods : Three types of assessment tools were selected for final development in Korean version through several meetings based on a wide range of relevant literature searches. The 3 selected assessment tools were first translated by the researchers, and a 9-person expert team was used to verify the Content Validity Index. Results : The EBS content equivalence calculation shows that all 6 questions and 1 response item had a CVI value 0.9, and all items were included in Korean EBS without modification. The EdFED content equivalence calculation showed that all 11 questions had CVI value 0.9, which was included in the Korean edition of EdFED without modification. The content equivalence calculation of the FDI showed that all 19 questions had a CVI of 0.8 or higher, and all items were included in the Korean version of the FDI without modification of the item. Conclusion : Korean versions of the EBS, EdFED and FDI, which are based on behavioral observation and diet tools for people with dementia, have been developed. Early determination of problems related to diet in dementia patients and providing proper intervention through observational Korean version assessment tools is vital in terms of strengthening patient nutrition and reducing caregivers' burden.

Development of a Test of Science Inquiry Skills for Elementary School Fifth and Sixth Graders (초등학교 고학년 학생의 과학 탐구능력 측정을 위한 평가 도구 개발)

  • Song, Kyoung-Hye;Lee, Hang-Ro;Lim, Cheong-Hwan
    • Journal of The Korean Association For Science Education
    • /
    • v.24 no.6
    • /
    • pp.1245-1255
    • /
    • 2004
  • The purpose of this study is to develop a valid and reliable evaluating instrument for elementary school fifth and sixth graders. The instrument is developed through R&D procedure, which includes two checks of science specialist and two field trials of the instrument. Evaluating items are content-free for each science inquiry skill. Each science inquiry element is based on SAPA and the 7th curriculum. This study has selected 10 science inquiry skills(observing, classifying, measuring, predicting, inferring, recognizing of a problem, controlling variables, interpreting data, drawing a conclusion, designing an experiment), formulated a clear definition of the elements of science inquiry skills, and established the objectives of evaluation. The content areas are divided into three categories, material and energy, life and environment, and the earth and circulation. Each category contains 10 items. So the instrument consists of 30 items. The content validity of items, objectivity of the scoring keys, and clarity of the items has been checked twice by specialists in science education. At the same time, two field trials were performed to produce the reliability of the instruments, discrimination index, and item difficulty index. The instrument has the content validity is 91.6%, reliability 0.79, objectivity 93.3%, discrimination index 0.30, and item difficulty index 66.1%.

A Study on Difficulty Factors of Youth Startups for Activating Local Startups (지역창업 활성화를 위한 청년창업 애로 요인에 관한 연구)

  • Ahn, Tae-Uk;Kang, Tae-Won
    • Asia-Pacific Journal of Business Venturing and Entrepreneurship
    • /
    • v.15 no.2
    • /
    • pp.67-80
    • /
    • 2020
  • This study has been conducted at a time when Korean government continues to extend support for youth startups as part of its policy to create jobs and the focus moves from career and employment to youth startups with a growing interest in the field of youth startups. Against this background, this study aims to identify difficulty factors of youth startups in areas besides the Seoul Metropolitan Area, seek ways to overcome difficulty factors, and propose policy implications. To this end, this study set five criteria and 25 sub-criteria to evaluate the difficulties of youth startups by reviewing previous studies and conducting literature review, and performing brainstorming method. The empirical analysis of the evaluation criteria was performed, using the analytic hierarchy process (AHP) method, on youths aged 19 to 39 in Gunsan area. The analysis results showed that the largest difficulty factors facing local youths include business model establishment, business administration and management, and startup funding in the criteria. As for sub-criteria, the largest difficulty factors are market information acquisition, technology commercialization, project feasibility, technology development, and new market pioneering in descending order. Local youths have much difficulty about the process of turning a business item into a product and commercializing it. According to a comparative analysis by gender, men were a relatively high difficulty in commercializing business models than women. men were a relatively high difficulty in commercializing business models than women. On the other hand, women were higher than men in all factors (management management, entrepreneurship, improvement of entrepreneurship system, and improvement of entrepreneurship awareness) except for factors affecting business model. In addition, the factors of entrepreneurship were found to be relatively different among young people (college students, prospective entrepreneurs, entrepreneurs). In conclusion, it was suggested that in order to revitalize youth entrepreneurship in the region, it is necessary to actively resolve the difficulties of business model commercialization rather than entrepreneurship funds. In addition, it is necessary to strategically support customized entrepreneurship support and situational administrative services because gender and hierarchical difficulties are different than general solutions. This study presented practical priorities and derivation methods for the entrepreneurship difficulties faced by local youth, and suggested measures and improvements for vitalizing local youth entrepreneurship in the future.

Analysis of Selection Items Test for Selecting Scientifically Gifted Students in Chemistry Class (과학영재 선발을 위한 선발문항 분석: 서울대학교 과학영재센터 중학교 심화과정의 화학영역 중심)

  • Choi, Chui-Im;Jung, Min-Soo;Hong, Hun-Gi;Chae, Hee K;Jeong, Dae-Hong
    • Journal of the Korean Chemical Society
    • /
    • v.52 no.3
    • /
    • pp.295-302
    • /
    • 2008
  • In this study, the test that were used in entrance examination for chemistry class in a Science-Gifted Education Center for middle school students were analyzed by using criteria for identification and measurement of scientific giftedness and a classical test theory. The result of analysis exhibited that most of problems measured more than two elements of scientific giftedness and required applications of scientific knowledge of middle school level to solve problems. In the analysis of sub-elements of scientific giftedness, originality, fluency in creativity and finding problems/formulating hypothesis, planning inquiry, interpreting data in science process skills were dominant while drawing conclusion and generalization processes were lacking. In correlation analysis between total score and each type of problems, total score was most influenced by the problems measuring science inquiry linked with scientific knowledge. Item difficulty is moderately high and item discrimination is moderate.