• Title/Summary/Keyword: Validity Analyses

Search Result 687, Processing Time 0.024 seconds

Validation of Science Self-Efficacy Scale for Pre-Service Teachers and Latent Mean Analysis According to Background Variable (예비 교사들을 대상으로 한 과학적 자기 효능감 척도 타당도 검증과 배경 변인별 잠재평균분석)

  • Lee, Hyundong
    • Journal of Korean Elementary Science Education
    • /
    • v.41 no.1
    • /
    • pp.65-78
    • /
    • 2022
  • This study aims to 1) verify the validity of the Science self-efficacy scale and 2) perform a latent mean analysis of the background variables about a pre-service teacher. The study uses pre-tests to analyze data from 187 pre-service teachers, which uses Tark's Science self-efficacy scale (2011). To identify the factor structure, exploratory factor analysis was performed. Based on the results of the pilot test, the expert group council revised the scale for the pre-service teachers to respond to the 3-factor structure. In the main test, 354 data were analyzed through a modified Science self-efficacy scale, and exploratory and confirmatory factor analyses were performed. The results of the study are as follows: First, in the pilot test, the pre-service teacher responded to a 3-factor instrument, but the validity of two items was examined further below. Second, the pre-service teachers responded to a 3-factor instrument on 29 items for the modified Science self-efficacy scale. The total reliability of the instrument was .886 and the reliability of each factor was analyzed as .882-.886. Finally, the latent mean analysis by gender showed that females have a higher self-regulation efficacy factor and males have a higher self-confidence factor (Cohen's d > .3). Furthermore, there is a significant difference in task difficulty preference and self-regulatory efficacy factor (Cohen's d > .8) between the college preparatory and science subject preference. This study provides important insights into and contributions to the accurate scientific self-efficacy diagnosis of pre-service teachers, as well as proposes a curriculum to improve the scientific self-efficacy of prospective teachers.

A Study on the Development and Validation of Digital Literacy Measurement for Middle School Students

  • Hee Chul Kim;Ji Young Lim;Iljun Park;Myoeun Kim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.9
    • /
    • pp.177-188
    • /
    • 2023
  • The purpose of this study is to develop and validate a scale for measuring digital literacy by identifying the factors consisting of digital literacy and extracting items for each factor. Preliminary items for the Delphi study were developed through the analysis of previous literature and the deliberation of the research team. As a result of two rounds of the expert Delphi study, 65 items were selected for the main survey. The validation of the items was carried out in the process of exploratory and confirmatory factor analyses, reliability test, and criterion validity test using the data collected in the main survey. As a result, a 4-factor structure composed of 31 questions(factor 1: digital technology & data literacy- 9 questions, factor 2: digital content & media literacy- 8 questions, factor 3: digital communication & community literacy- 9 questions, factor 4: digital wellness literacy - 5 questions) was confirmed. Also, the goodness of fit indices of the model were found to be good and the result of reliability test revealed the scale had a very appropriate level of Cronbach's alpha(α=.956). In addition, a statistically significantly positive correlations(p<.001) were found between digital literacy and internet self-efficacy and between digital literacy and self-directed learning ability, which were predicted in the existing evidence, therefore the criterion validity of the developed scale was secured. Finally, practical and academic implications of the study are provided and future study and limitations of the study are discussed.

Is it true?: A Meta-analysis on the Efficacy of CBCA in Detecting Truths (그 말은 진실일까?: CBCA의 진실 탐지 효용성에 대한 메타분석적 고찰)

  • Kim, Hye Jin;Lee, Sangmin;Hur, Taekyun;Choi, Seung-Hyuk
    • Korean Journal of Forensic Psychology
    • /
    • v.12 no.2
    • /
    • pp.121-149
    • /
    • 2021
  • Statement Validity Analysis (SVA) is utilized in criminal investigations and the court to assess the credibility of given statements. During this procedure, the criteria for Criteria-Based Content Analysis (CBCA) are used to evaluate whether statements include the characteristics reflecting actual experiences about the event in question. Various studies had been conducted on the efficacy (classification rates) of CBCA criteria, yet the consistency of the findings was not investigated. In the current study, a meta-analysis was conducted with Korean CBCA studies reported from 2004 to 2020 (a total of fourteen studies). As a result, the total score of CBCA was found to successfully discriminate truth and fabrication. A significant positive (+) effect size was found with four criteria (3, 4, 10, and 12), all of which are classified as cognitive criteria. However, contrary to the underlying assumption for CBCA, criterion 18, classified as one of the motivational criteria, showed a significant negative (-) effect size. Meanwhile, moderator analyses were possible for eleven criteria (2~9, 12, 13, 15) and the results showed the significant effects of potential moderator variables such as the gender and status of the participants, study types and designs, number of raters, and publication status. The current results suggests that more careful attention is required to each criterion-especially the cognitive criteria-rather than the total CBCA score as well as the possible moderator effects in order to assess truthfulness of the statements. The implication, limitations, and suggestions for future studies were discussed.

Development and Validation of a Korean Generative AI Literacy Scale (한국형 생성 인공지능 리터러시 척도 개발 및 타당화)

  • Hwan-Ho Noh;Hyeonjeong Kim;Minjin Kim
    • Knowledge Management Research
    • /
    • v.25 no.3
    • /
    • pp.145-171
    • /
    • 2024
  • Literacy initially referred to the ability to read and understand written documents and processed information. With the advancement of digital technology, the scope of literacy expanded to include the access and use of digital information, evolving into the concept of digital literacy. The application and purpose of digital literacy vary across different fields, leading to the use of various terminologies. This study focuses on generative artificial intelligence (AI), which is gaining increasing importance in the AI era, to assess users' literacy levels. The research aimed to extend the concept of literacy proposed in previous studies and develop a tool suitable for Korean users. Through exploratory factor analysis, we identified that generative AI literacy consists of four factors: AI utilization ability, critical evaluation, ethical use, and creative application. Subsequently, confirmatory factor analysis validated the statistical appropriateness of the model structure composed of these four factors. Additionally, correlation analyses between the newly developed literacy tool and existing AI literacy scales and AI service evaluation tools revealed significant relationships, confirming the validity of the tool. Finally, the implications, limitations, and directions for future research are discussed.

A Development of a Seismic Vulnerability Model and Spatial Analysis for Buildings (건물에 대한 지진취약도 모델링 및 공간 분석)

  • Kim, Sang-Bin;Kim, Seong-Hoon
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.10
    • /
    • pp.9-18
    • /
    • 2020
  • The purpose of this study is to suggest a method of predicting seismic vulnerability and safety conditions of each building in a targeted area. The scope of this study includes 'developing a simulation model for precaution activities,' 'testing the validity of the developed model', From the facility point of view, target of this study is a local building system. According to the literature review, the number of earthquake prediction modeling and cases with GIS applied is extremely few and the results are not proficient. This study is conducted as a way to improve the previous researches. Statistic analyses are conducted using 348 domestic and international data. Finally, as a result of the series of statistical analyses, an adequate model is developed using optimization scale method. The ratio of correct expectation is estimated as 87%. In order to apply the developed model to predict the vulnerability of the several chosen local building systems, spatial analysis technique is applied. Gangnam-gu and Jongro-gu are selected as the target areas to represent the characteristics of the old and the new downtown in Seoul. As a result of the analysis, it is discovered that buildings in Gangnam-gu are relatively more dangerous comparing to those of Jongro-gu and Eunpyeong-gu.

The Characteristics of Group and Classroom Discussions in Socioscientific Issues Classes (과학관련 사회쟁점(SSI) 수업의 소집단 토론과 전체 학급 토론에서 나타나는 특징)

  • Kim, Minhwan;Nam, Hyein;Kim, Sunghoon;Noh, Taehee
    • Journal of The Korean Association For Science Education
    • /
    • v.38 no.2
    • /
    • pp.135-145
    • /
    • 2018
  • In this study, we investigated the argumentations of group and classroom discussions in socioscientific issues (SSI) discussion classes. Twenty-seven high school students participated in the SSI discussion classes on nuclear power generation. We observed and recorded the classes and also conducted semi-structured interviews. For the analyses, we revised a previous framework that was developed to analyze dialogic argumentations in the context of SSI. The analyses of the results indicated that there were more discourse schemes in the classroom discussions than the group discussions which are related to awareness and openness to multiple perspectives, evidence based reasoning, and on-going inquiry and skepticism. And there were few discourse schemes related to moral and ethical sensitivity in the group and classroom discussions. Various grounds, data, and information were presented in the classroom discussions. Students concentrated on carrying their claims and were not able to sympathize with and accept other opinions. Therefore, there were few discourse schemes to reach consensus. In addition, they perceived classroom discussions as competitive and actively rebutted other claims or grounds. The levels of argumentation were also high in the classroom discussions. The group discussions were held in relaxed atmosphere, and they asked the opponents more for clarification or additional information and evidences. However, classroom discussions were held in serious atmosphere, and they actively queried the validity of the claims or grounds. Based on the results, some suggestions to implement SSI discussion classes were discussed.

On Feasibility of Ambulatory KDRGs for the Classification of Health Insurance Claims (KDRG를 이용한 건강보험 외래 진료비 분류 타당성)

  • 박하영;박기동;신영수
    • Health Policy and Management
    • /
    • v.13 no.1
    • /
    • pp.98-115
    • /
    • 2003
  • Concerns about growing health insurance expenditures became a national Issue in 2001 when the National Health Insurance went into a deficit. Increases in spending for ambulatory care shared the largest portion of the problem. Methods and systems to control the spending should be developed and a system to measure case mix of providers is one of core components of the control system. The objectives of this article is to examine the feasibility of applying Korean Diagnosis Related Groups (KDRGs) to classify health insurance claims for ambulatory care and to identify problem areas of the classification. A database of 11,586,270 claims for ambulatory care delivered during January 2002 was obtained for the study, and the final number of claims analyzed was 8,319,494 after KDRG numbers were assigned to the data and records with an error KDRG were excluded from the study. The unit of analysis was a claim and resource use was measured by the sum of charges incurred during a month at a department of a hospital of at a clinic. Within group variance was assessed by th coefficient of variation (CV), and the classification accuracy was evaluated by the variance reduction achieved by the KDRG classification. The analyses were performed on both all and non-outlier data, and on a subset of the database to examine the validity of study results. Data were assigned to 787 KDRGs among 1,244 KDRGs defined in the classification system. For non-outlier data, 77.4% of KDRGs had a CV of charges from tertiary care hospitals less than 100% and 95.43% of KDRGs for data from clinics. The variance reduction achieved by the KDRG classification was 40.80% for non-outlier claims from tertiary care hospitals, 51.98% for general hospitals, 40.89% for hospitals, and 54.99% for clinics. Similar results were obtained from the analyses performed on a subset of the study database. The study results indicated that KDRGs developed for a classification of inpatient care could be used for ambulatory care, although there were areas where the classification should be refined. Its power to predict tile resource utilization showed a potential for its application to measure case mix of providers for monitoring and managing delivery of ambulatory care. The issue concerning the quality of diagnostic information contained in insurance claims remains to be improved, and significance of future studies for other classification systems based on visits or episodes is guaranteed.

The Effect of Job Search Stress on Career Maturity among the Students of Security Services (경호학과 학생들의 취업스트레스가 진로성숙도에 미치는 영향)

  • Lee, sol-Ji;Lee, Ju-Lak
    • Korean Security Journal
    • /
    • no.42
    • /
    • pp.179-203
    • /
    • 2015
  • Nowadays college students in South Korea experience much stress related to job search due to the continuing unemployment crisis. Particularly, students who hold a degree in Security Services suffer from such stress at a higher level compared to other students because of the specific qualifications sought by potential employers. Therefore, this study investigates the effect of the stress related to job search on career maturity among the students of Security Services. The authors surveyed 250 students of Security Services from 7 colleges in Gyeonggi, Jeolla, and Gyeongsang provinces. Before distributing the questionnaire, its validity and reliability were assessed through the consultations with experts in the related fields. The data collected was examined via various statistical methods, including factor, reliability, correlation, and regression analyses using SPSS 20.0. The results indicated that socio-demographic characteristics affected job search stress and career maturity. Additionally, it was found that the job search-related stress of the students influenced their career maturity. To illustrate, job search stress and career maturity were positively related. Based on the results of the analyses, the authors confirm that the students of Security Services are suffering from a high level of stress resulting from job search, which impacts their career selection. Finally, policy implications are discussed, including alleviating the stress by providing diversified career choices to the students.

  • PDF

Competitive strategies, CEO characteristics, and firm performance in venture businesses (경영전략과 최고경영자 특성이 기업성과에 미치는 영향: 벤처기업을 중심으로)

  • Park, Kyoungmi;Hwang, Jaewon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.1
    • /
    • pp.52-63
    • /
    • 2019
  • Biased performance implications are common in conducting empirical analysis on leading firms in strategic management field. Venture businesses in which successful and failing firms in the future are mixed in the present could provide a better discriminative result for examining the determinants of performance. We suggest hypotheses on how competitive strategy, CEO characteristics, and their interactions affect firm performance. We examine these hypotheses through empirical analyses on the basis of a survey collected from 387 venture businesses in order to assure the validity of strategic management theories by using more deviated data. Empirical results show that innovative differentiation from competitive strategies affects firm performance and innovativeness and long-term orientation from CEO characteristics affect firm performance. According to the results of the interaction analyses between competitive strategies and CEO characteristics, cost-leadership and marketing differentiation strategies have combination effects with risk taking, innovativeness, and long-term orientation, while innovative differentiation strategy has no combination effects with risk taking, innovativeness, and long-term orientation. We conclude that cost-leadership and marketing differentiation strategies have no direct effect on firm performance but have combination effects with CEO characteristics, while innovative differentiation strategy has direct effect on firm performance but has no combination effect. Our primary contribution is that we test and confirm that the fit between competitive strategies and CEO characteristics are an important consideration to increase firm performance in venture businesses.

The Effects of Information System Quality on Public Information Project Performance: With a Focus on the Mediating Effects by the Users (정보시스템 품질이 공공정보화사업 성과에 미치는 영향: 사용자의 매개효과를 중심으로)

  • Kim, Won-Ki;Park, So-Hyun;Kim, Seung-Chul
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.8 no.8
    • /
    • pp.181-190
    • /
    • 2019
  • The purpose of this study is to verify the effects of information system quality on business performance (net benefit) in the Korean public informatization business and to verify whether the user has mediating role in the relationship between information system quality and net benefit. In order to prepare empirical tests, factor analyses was conducted and the validity and reliability of the variables were confirmed to be acceptable. The research hypotheses were tested by regression analyses. The mediating effects as well as the main effects were analyzed by SPSS statistical program. The results show that the higher the quality of the information system becomes, the higher the usability by the users of the system increases. Also, it was found that the users had more positive effect on the net benefit of the public informatization project. In addition, it was confirmed that there was a partial mediating effect by the users on the relationship between information system quality and the benefits. The results of the research suggests that we establish a management system to improve the business performance efficiently according to the priorities of detailed success factors from the viewpoint of the public information business, and the users who use the information system quality and system.