• Title/Summary/Keyword: content-generalizability

Search Result 13, Processing Time 0.018 seconds

The Development and Validation of Instrument for Measuring High School Students' STEM Career Motivation (고등학생들을 위한 이공계 진로동기 검사도구 개발 및 타당화)

  • Shin, Sein;Ha, Minsu;Lee, Jun-Ki
    • Journal of The Korean Association For Science Education
    • /
    • v.36 no.1
    • /
    • pp.75-86
    • /
    • 2016
  • The purpose of the present study is to develop and validate an instrument to assess STEM career motivation. We developed 32 items for 7 constructs (i.e. education experience, career value, academic self-efficacy, career self-efficacy, career interest, parents' support, and career motivation) on STEM career motivation based on Social Cognitive Career Theory (SCCT; Lent et al.,1994). 767 first year high school students participated in this study. The items were validated by Messick's framework (1995). In this study, we examined the validity of items in four aspects (i.e. content, substantive, structural and generalizability of validity). Methodologically, we used Rasch analysis, Exploratory factor analysis, confirmative factor analysis based on structural equation modelling. We confirmed that our instrument with 32 items as valid and reliable for measuring the STEM career motivation. In addition, we tested the STEM career motivation model based on SCCT. Our model explained the data well, suggesting that external factors (education experience and parents' support) and cognitive factors (perception of value, self-efficacy and interest) were significantly related to STEM career motivation.

Exploring Factors to Minimize Hallucination Phenomena in Generative AI - Focusing on Consumer Emotion and Experience Analysis - (생성형AI의 환각현상 최소화를 위한 요인 탐색 연구 - 소비자의 감성·경험 분석을 중심으로-)

  • Jinho Ahn;Wookwhan Jung
    • Journal of Service Research and Studies
    • /
    • v.14 no.1
    • /
    • pp.77-90
    • /
    • 2024
  • This research aims to investigate methods of leveraging generative artificial intelligence in service sectors where consumer sentiment and experience are paramount, focusing on minimizing hallucination phenomena during usage and developing strategic services tailored to consumer sentiment and experiences. To this end, the study examined both mechanical approaches and user-generated prompts, experimenting with factors such as business item definition, provision of persona characteristics, examples and context-specific imperative verbs, and the specification of output formats and tone concepts. The research explores how generative AI can contribute to enhancing the accuracy of personalized content and user satisfaction. Moreover, these approaches play a crucial role in addressing issues related to hallucination phenomena that may arise when applying generative AI in real services, contributing to consumer service innovation through generative AI. The findings demonstrate the significant role generative AI can play in richly interpreting consumer sentiment and experiences, broadening the potential for application across various industry sectors and suggesting new directions for consumer sentiment and experience strategies beyond technological advancements. However, as this research is based on the relatively novel field of generative AI technology, there are many areas where it falls short. Future studies need to explore the generalizability of research factors and the conditional effects in more diverse industrial settings. Additionally, with the rapid advancement of AI technology, continuous research into new forms of hallucination symptoms and the development of new strategies to address them will be necessary.

Development and Implementation of a Process-Based Evaluation Program on School Space Design: Focusing on the Housing Life Area of Home Economics Curriculum in Middle School (학교 공간 디자인을 주제로 한 과정중심평가 프로그램 개발 및 실행: 중학교 가정교과 주생활 영역을 중심으로)

  • Kang, Eun Young;Park, Mi Jeong
    • Journal of Korean Home Economics Education Association
    • /
    • v.32 no.4
    • /
    • pp.81-101
    • /
    • 2020
  • The purpose of this study is to develop and implement a process-based evaluation program with the theme of school space design in the housing area of the middle school home economics. In order to achieve For thispurpose, a process-based evaluation program based on the theme of school space design was developed following the ADDIE instructional design model, and the program was executed to a total of 93 students. A questionnaire survey and in-depth interview were conducted for the evaluation of the program. The results of this study are as follows. First, based on the results of a 2015-Revised Curriculum analysis, a school space design program evaluation plan was established, and two evaluation tasks were developed. Accordingly, scoring criteria were prepared and 8 evaluation materials for students and 2 evaluation materials for teachers were developed. A total of 9 sessions were developed for teaching and learning activities and evaluation-linked operation procedures to perform evaluation tasks. As a result of an expert validity test for the program, all items were verified to be appropriate in content validity and content composition with an average of 3.6 to 4 points (4 points). Second, after conducting the school space design program, a survey on students were conducted, and as a result, all three areas of school space design class, process-based evaluation, interest scored high in average scores of 4.12 to 4.27 out of 5. According to the survey and interview results, the program provided new learning opportunities for school space design, the students were able to reach the suggested achievement goals, and the self-assessment, peer evaluation and teacher feedback positively affected the students during the learning process so that they could reflect on their learning and actively participate in the subsequent learning activity. This study has a limitation in generalizability in that the program was conducted on a limited number of students, and future studies are expected to expand the scope in terms of research participants, evaluation criteria, and school space design classes. This study laid the foundation for theory and practice by developing and implementing a process-based evaluation program for home economics education, and it has contribution in that it suggested the possibility that teachers and students can take the initiatives in school space design, focusing on the housing content elements of home economics.