• Title/Summary/Keyword: item generation

Search Result 171, Processing Time 0.023 seconds

Application of AIG Implemented within CLASS Software for Generating Cognitive Test Item Models

  • SA, Seungyeon;RYOO, Hyun Suk;RYOO, Ji Hoon
    • Educational Technology International
    • /
    • v.23 no.2
    • /
    • pp.157-181
    • /
    • 2022
  • Scale scores for cognitive domains have been used as an important indicator for both academic achievement and clinical diagnosis. For example, in education, Cognitive Abilities Test (CogAT) has been used to measure student's capability in academic learning. In a clinical setting, Cognitive Impairment Screening Test utilizes items measuring cognitive ability as a dementia screening test. We demonstrated a procedure of generating cognitive ability test items similar as in CogAT but the theory associated with the generation is totally different. When creating cognitive test items, we applied automatic item generation (AIG) that reduces errors in predictions of cognitive ability but attains higher reliability. We selected two cognitive ability test items, categorized as a time estimation item for measuring quantitative reasoning and a paper-folding item for measuring visualization. As CogAT has widely used as a cognitive measurement test, developing an AIG-based cognitive test items will greatly contribute to education field. Since CLASS is the only LMS including AIG technology, we used it for the AIG software to construct item models. The purpose of this study is to demonstrate the item generation process using AIG implemented within CLASS, along with proving quantitative and qualitative strengths of AIG. In result, we confirmed that more than 10,000 items could be made by a single item model in the quantitative aspect and the validity of items could be assured by the procedure based on ECD and AE in the qualitative aspect. This reliable item generation process based on item models would be the key of developing accurate cognitive measurement tests.

The utility of digital evaluation based on automatic item generation in mathematics: Focusing on the CAFA system (수학교과에서 자동문항생성 기반의 디지털 평가 활용 방안: CAFA 시스템을 중심으로)

  • Kim, Sungyeun
    • The Mathematical Education
    • /
    • v.61 no.4
    • /
    • pp.581-595
    • /
    • 2022
  • The purpose of this study is to specify the procedure for making item models based on ontology models using automatic item generation in the mathematics subject through the CAFA system, and to explore the generated item instances. As an illustration for this, an item model was designed as a part of formative assessment based on the content characteristics, including concepts and calculations, and process characteristics, including application, using the representative values and the measures of dispersion in Mathematics of the 9th grade based on the evaluation criteria achievement standards. The item types generated in one item model were a best answer type, a correct answer type, a combined-response type, an incomplete statement type, a negative type, a true-false type, and a matching type. It was found that HTML, Google Charts, TTS, figures, videos and so on can be used as media. The implications of the use of digital evaluation based on automatic item generation were suggested in the aspects of students, pre-service teachers, general teachers, and special education, and the limitations of this study and future research directions were presented.

A Study on Generation and Parsing System for MPEG-21 Broadcasting Digital Item (MPEG-21 방송 디지털 아이템을 위한 생성 및 파싱 시스템에 대한 연구)

  • 김천석;한희준;노용만;남제호;홍진우
    • Journal of Broadcast Engineering
    • /
    • v.8 no.1
    • /
    • pp.80-90
    • /
    • 2003
  • Today, thanks to the spread of Internet and the development of various multimedia technologies, broadcasting environment is changing in a way to merging broadcasting and communication environment. In such a new environment, transparent delivery and interoperability between different technologies become an important issue. In ISO/IEC MPEG meeting, MPEG-21 has been established. In MPEG-21, it is discussed actively about big picture to build an infrastructure for the delivery and consumption of multimedia contents. In this paper, we have applied Digital Item in MPEG-21 to broadcasting contents. Broadcasting Digital Item is generated using MPEG-7 MDS for the description of resources as well as Digital Item Declaration, and Digital Item Identification. Furthermore, we develop Digital Item generation system and parsing system. In experiment, we verify the usefulness of Broadcasting Digital Item by generating an education video contents and consuming it at different user environments.

Exploring the Reliability of an Assessment based on Automatic Item Generation Using the Multivariate Generalizability Theory (다변량일반화가능도 이론을 적용한 자동문항생성 기반 평가에서의 신뢰도 탐색)

  • Jinmin Chung;Sungyeun Kim
    • Journal of Science Education
    • /
    • v.47 no.2
    • /
    • pp.211-224
    • /
    • 2023
  • The purpose of this study is to suggest how to investigate the reliability of the assessment, which consists of items generated by automatic item generation using empirical example data. To achieve this, we analyzed the illustrative assessment data by applying the multivariate generalizability theory, which can reflect the design of responding to different items for each student and multiple error sources in the assessment score. The result of the G-study showed that, in most designs, the student effect corresponding to the true score of the classical test theory was relatively large after residual effects. In addition, in the design where the content domain was fixed, the ranking of students did not change depending on the item types or items. Similarly, in the design where the item format was fixed, the difficulty showed little variation depending on the content domains. The result of the D-study indicated that the original assessment data achieved a sufficient level of reliability. It was also found that higher reliability than the original assessment data could be obtained by reducing the number of items in the content domains of operation, geometry, and probability and statistics, or by assigning higher weights to the domains of letters and formulas, and function. The efficient measurement conditions presented in this study are limited to the illustrative assessment data. However, the method applied in this study can be utilized to determine the reliability and to find efficient measurement conditions for the various assessment situations using automatic item generation based on measurement traits.

The Relationship between Family Concept and Family Strengths Perceived by College Students (대학생들이 인식하는 가족개념과 가족건강성의 관계)

  • Park, Su-Sun
    • Journal of Family Resource Management and Policy Review
    • /
    • v.14 no.1
    • /
    • pp.37-55
    • /
    • 2010
  • The purpose of this study was to determine the factors affecting family strength and therewith, suggest some strategies to improve family strength and welfare. For this purpose, the researcher sampled 208 college students and surveyed them for their perceptions of the concept of family and family strengths. The results of this study can be summarized as follows. First, as a result of surveying the subjects on their perception of the concept of family, it was found that almost all of them (99%) perceived that 'a family consists of a couple and their children' (item 1). The other items regarding the concept of family chosen by the majority of subjects were 'a couple and adopted child' (item 3 & item 17), 'a remarried couple and their children' (item 9), 'a single parent and children' (item 2), 'a three-generation family; couple, widowed daughter and granddaughter' (item 4), 'three sisters' (item 7), 'an unmarried woman living with a son born from a sperm bank' (item 19), 'a separated couple with no child' (item 13), 'cousins living together' (item 11), 'a divorced man and his girlfriend with child' (item 15) and 'homosexual family' (item 8). Second, as a result of assessing subjects' needs for family functions and their efforts for family strengths, it was found that the family functions for family members scored higher than those for the society, and that subjects' efforts for the family functions conducive to both their family members and society scored lower than their needs for the family functions. Third, subjects' needs and efforts for family functions were positively correlated with family strengths. Namely, family functions were closely related with family strengths.

  • PDF

Design and Implementation of Test Item Generation System based on Template (템플릿을 사용한 객관식 출제시스템의 설계 및 구현)

  • Kim, Jin-Hee;Yong, Hwan-Seung
    • The Journal of Korean Association of Computer Education
    • /
    • v.5 no.2
    • /
    • pp.49-59
    • /
    • 2002
  • There have been many attempts to educationally utilize a computer. As a result, a number of learning programs and testing programs have been developed. Testing programs developed so far are rather focusing on giving learners questions without interactivity. Question givers also have to feed question data into a computer. Therefore, this thesis, firstly, explains how learners themselves feed question data into a computer. Secondly, this thesis explains how to develop such a system that can produce new questions based on the question data fed by learners. This paper also introduces the system environment, which features the test item generation system, and explains the system environment by exemplifying internal modules, a test item bank. Besides, we also describe how to apply this system to educational programs and identify whether it is possible to apply it to a Chinese subject and others.

  • PDF

A Study of Virtual 3D Fashion Coordination (가상 3D 패션 코디네이션 연구)

  • 강인애;김효숙;최창석
    • Journal of the Korean Home Economics Association
    • /
    • v.40 no.6
    • /
    • pp.159-171
    • /
    • 2002
  • Today, many people seek for their own personal character which is distinguished from another people and they utilize fashion coordination as the was of expression their own image. In addition, interest in electronic commerce and cuber shopping mall on the internet is increasing. For this reason, visual and interesting virtual fashion coordination system is needed. The purpose of this study is to propose possibility of fashion coordination by virtual 3D model. For this study, 1. We make a 3D standard body model by automatic generation. 2. We make 3D fashion item (sleeveless top and flare skirt) by automatic generation. 3. We combine 3D body model with fashion item by special point, grouping and gap being between body and clothes. 4. We make textile palettes and textile DB for texture mapping and rendering. As a effect of this study, 1. It can give the chance to coordinate clothes suitable for their own character and bodyshape on the cuber space more speedily and variously. 2. It can help fashion internet shopping mall company can save a time, expenses and tries to advertise their new products, offer service for customers and lead customers to purchasing. 3. It can accumulate a database of design and textile for using by fashion and textile industry.

Design of Iterative Learning Contents and Items Generation System based on SCORM (SCORM 기반 반복 학습 콘텐츠 및 문항 생성 시스템 설계)

  • Baek, Yeong-Tae;Lee, Se-Hoon;Jeong, Jae-Cheul
    • Journal of the Korea Society of Computer and Information
    • /
    • v.14 no.2
    • /
    • pp.201-209
    • /
    • 2009
  • According to previous researches about online evaluation in many e-Learning contents, it took too much time and effort to generate test questions for formative or achievement tests using a database as an item pool. Furthermore, it is hard to measure accomplishment of learners for each unit through overall tests provided by existing e-learning contents. In this paper, to efficiently cope with problems described above, the item pool based on Item Form was transformed into Interaction Date Model in Run-Time Environment of SCORM2004. And the contents for the math concepts and principles that students would learn from regular classroom were developed in accordance with SCORM. In addition, Confidence Factor Function was used to take an objective view in measuring the accomplishment of learners through the items automatically generated by LMS(Learning Management System).

A Basic Research for Developing Slacks Pattern of Women in Y-O Generation (Y-O세대 여성의 바지 원형 개발을 위한 기초연구)

  • Cho, Yun-Joo;Na, Hyun-Shin
    • Journal of Fashion Business
    • /
    • v.14 no.4
    • /
    • pp.132-145
    • /
    • 2010
  • These days, the aging population is becoming a critical social issue; the activation of the silver industry for the Y-O generation, meaning the young-old group of aged 55-64, is accelerating now. Pants are very important item to this generation, since they pursue active life with an exercise and leisure activities. Therefore, the physical, psychological, and social characters as well as the changed life style of women in the Y-O generation were reviewed, based on former studies and books. The consumer's patterns and actual wearing conditions about slacks were researched and analyzed through the survey toward 300 women aged 55-65 living in Seoul. Based on this research, information was provided for the development of slacks pattern which is suitable to the deformed body and aesthetic consciousness of the Y-O generation.

A Method for Automatic Check of Omitted Design Item in Structural Calculation Document of Steel Box Bridges (강박스 교량을 대상으로 한 구조계산서의 누락된 설계항목 검토 자동화 방법론)

  • Park, Sang-Il;An, Hyun-Jung;Kim, Bong-Geun;Lee, Sang-Ho
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2007.04a
    • /
    • pp.813-818
    • /
    • 2007
  • A method for automatic check of omitted design item in structural calculation document of steel box bridges is proposed. A method for automatic check of omitted design item in structural calculation document of steel box bridges is proposed. Information processing for the proposed method is divided into two steps: automatic generation of document structure in XML Schema Definition (XSD) format and extract omitted design items by using the XML Schema matching technique. The automatic omitted element filter is developed on the basis of the proposed method, and the accuracy of the developed module is examined with case study subjected to existing structural calculation document samples.

  • PDF