• Title/Summary/Keyword: Educational assessment

Search Result 1,134, Processing Time 0.026 seconds

A Delphi Study to Validate the Patient-Centered Doctor's Competency Framework in Korea (한국의 환자 중심 의사 역량 프레임 타당화를 위한 델파이 연구 )

  • Sunju Im;Young-Jon Kim;Chanwoong Kim;Geon-Ho Lee;Sun-Woo Lee;Woo-Taek Jeon;Hanna Jung;Sojung Yune
    • Korean Medical Education Review
    • /
    • v.25 no.2
    • /
    • pp.139-158
    • /
    • 2023
  • Defining a competent doctor is important for educating and training doctors. However, competency frameworks have rarely been validated during the process of their development in Korea. The purpose of this study was to validate the patient-centered doctor's competency framework, which had been developed by our expert working group (EWG). Two rounds of Delphi questionnaire surveys were conducted among a panel of experts on medicine and medical education. The panel members were provided with six core competencies, 17 sub-competencies, and 53 enabling competencies, and were asked to rate the importance of these competencies on a 5-point Likert scale. Between April and July 2021, a total of 28 experts completed both rounds. The data of the Delphi study were analyzed for the mean, standard deviation, median, inter-rater agreement (IRA), and content validity ratio (CVR). A CVR >0.36 and IRA ≥0.75 were deemed to indicate validity and agreement. This study found that five enabling competencies were not valid, and agreement was not reached for three sub-competencies and two enabling competencies. In consideration of CVR and the individual opinions of panel members at each session, the final competencies were extracted through consensus meetings of the EWG. The competencies were modified into six core competencies, 16 sub-competencies, and 47 enabling competencies. This study is meaningful in that it proposes patient-centered doctor's competencies enabling the development of residents' milestone competencies, an assessment system, and educational programs.

An Analysis of Cases of Real-time Online Class Design by Pre-service Science Teachers (예비 과학 교사의 실시간 온라인 수업 설계 사례 분석)

  • Hwa-Jung Han
    • Journal of The Korean Association For Science Education
    • /
    • v.43 no.6
    • /
    • pp.563-572
    • /
    • 2023
  • This study aimed to analyze cases of online class design by pre-service science teachers to identify the teaching strategies employed for online classes. For this purpose, the real-time online class lesson plans of 12 pre-service science teachers, who had experienced education utilizing online teaching tools for a semester, were collected and analyzed. The pre-service science teachers considered all the elements that were essential in traditional face-to-face class designs, including prerequisites, statements of learning objectives, stimulating motivation, teaching and learning methods, wrapping up, teacher-student interaction, and assessment. They devised teaching strategies that could overcome the limitations of online teaching and were not feasible in face-to-face classes for each element. Additionally, they were considering new instructional strategies tailored to the online teaching environment, such as creating a conducive environment for using online teaching tools and strategies related to checking the online teaching environment. However, for statements of learning objectives, stimulating motivation, and wrapping up, most of the pre-service science teachers predominantly utilized teaching strategies from traditional face-to-face classes, especially those involving the presentation of visual materials through online tools. Student-centered approaches were rarely implemented in stimulating motivation or wrapping up. These findings imply that one semester of exposure to the utilization of online teaching tools may be insufficient in teacher education. Thus, there is a need for a continuous and expanded educational program on the utilization of online teaching tools as part of pre-service teacher education.

Beginning Science Teachers' Teaching Practice in Relation to Arranging Science Content and Sense-Making Strategy (초임 중등 과학 교사의 수업에서 과학 내용의 전개 방식과 내용 이해 전략)

  • Ahn, Yu-Min;Kim, Chan-Jong;Choe, Seung-Um
    • Journal of The Korean Association For Science Education
    • /
    • v.26 no.6
    • /
    • pp.691-702
    • /
    • 2006
  • The purposes of the study are to portray Korean beginning secondary science teachers' ways of arranging science content, sense-making strategy, and factors contributing to the tensions between teachers' intentions and actual practice. Six beginning secondary science teachers participated in this study. Science classes taught by the participating teachers were observed and videotaped. Semi-structured interviews were conducted for science teachers participated in this study after science classes were observed. Instructional materials were also collected for each science class. Video- and audio-taped data were transcribed and analyzed using conceptual framework developed by the Michigan State University. The findings of this study produce the following conclusions: (1) beginning teachers' science classes are arranged in ways compatible to traditional school science, (2) frequently used sense-making strategies are procedural display and narrative reasoning, (3) tensions between beginning teachers' intentions and practice arise from two factors such as assessment and differences in educational views with peer teachers, and (4) learning experiences, lack of perceptions and preparations on reform science teaching, and the absence of systematic program for professional development programs for beginning science teachers are major obstacles to reform science teaching for beginning teachers.

A School-tailored High School Integrated Science Q&A Chatbot with Sentence-BERT: Development and One-Year Usage Analysis (인공지능 문장 분류 모델 Sentence-BERT 기반 학교 맞춤형 고등학교 통합과학 질문-답변 챗봇 -개발 및 1년간 사용 분석-)

  • Gyeongmo Min;Junehee Yoo
    • Journal of The Korean Association For Science Education
    • /
    • v.44 no.3
    • /
    • pp.231-248
    • /
    • 2024
  • This study developed a chatbot for first-year high school students, employing open-source software and the Korean Sentence-BERT model for AI-powered document classification. The chatbot utilizes the Sentence-BERT model to find the six most similar Q&A pairs to a student's query and presents them in a carousel format. The initial dataset, built from online resources, was refined and expanded based on student feedback and usability throughout over the operational period. By the end of the 2023 academic year, the chatbot integrated a total of 30,819 datasets and recorded 3,457 student interactions. Analysis revealed students' inclination to use the chatbot when prompted by teachers during classes and primarily during self-study sessions after school, with an average of 2.1 to 2.2 inquiries per session, mostly via mobile phones. Text mining identified student input terms encompassing not only science-related queries but also aspects of school life such as assessment scope. Topic modeling using BERTopic, based on Sentence-BERT, categorized 88% of student questions into 35 topics, shedding light on common student interests. A year-end survey confirmed the efficacy of the carousel format and the chatbot's role in addressing curiosities beyond integrated science learning objectives. This study underscores the importance of developing chatbots tailored for student use in public education and highlights their educational potential through long-term usage analysis.

Exploring the Changes in Elementary Teachers' Modeling pPCK for Science Modeling Instructions Through Knowledge Exchange of the Refined Consensus Model (개선된 합의 모델(RCM)의 지식 교환을 통한 초등교사의 모델링 pPCK 변화 탐색)

  • Hyun-Ju Kim;Chae-Seong Lim;Ki-Young Lee
    • Journal of The Korean Association For Science Education
    • /
    • v.44 no.1
    • /
    • pp.105-117
    • /
    • 2024
  • The purpose of this study was to explore changes in elementary teachers' modeling pPCK (personal PCK) resulting from knowledge exchange within the realms of PCK described in the Refined Consensus Model (hereafter RCM). For this purpose, a professional learning community (hereafter PLC) was established for three elementary school teachers to facilitate knowledge exchange specifically focused on science modeling instructions. The study then analyzed the CoRe (content representations) written by the research participants twice to explore any changes in modeling pPCK (personal PCK). In addition, the discourse shared by the participants in the PLC and the data from the in-depth interviews were also analyzed using grounded theory research methods. The results of the study showed that there was no significant change in knowledge of the science curriculum in elementary teachers' modeling pPCK, but there were changes in orientations toward teaching science, knowledge of students' understanding in science, knowledge of instructional strategies and representations, and knowledge of assessment of science learning. Furthermore, the analysis of PLC discourse and in-depth interviews showed that modeling instructions reflection (ePCK; enacted PCK) and educational research-based modeling cPCK (collective PCK) influenced these changes in teachers' modeling pPCK. Accordingly, this study suggests recommendations for pedagogical approaches aimed at improving teachers' modeling PCK.

Impact of Construction Safety Managers and Project Characteristics on Air Conditioning Installation Safety Scores (건설 안전관리자의 특성 및 프로젝트 특성이 에어컨 설치 공사의 안전 점수에 미치는 영향)

  • Uhm, Miyoung;Kim, Jinyoung;Kim, Hongjo
    • Journal of the Korea Institute of Building Construction
    • /
    • v.24 no.3
    • /
    • pp.381-391
    • /
    • 2024
  • This study examined the factors influencing safety scores in air conditioning installation projects, with a specific focus on the characteristics of safety managers and project-specific details. Given the increase in industrial accidents within this sector and the lack of research on smaller-scale operations, this analysis of 7,046 safety data records from Company A aimed to address this gap. The results indicate that the month of project commencement has the most significant impact on safety scores(correlation coefficient of 0.21), followed by the age of the safety manager(correlation coefficient of 0.06). Interestingly, the educational background of the managers did not appear to influence safety outcomes. Furthermore, project cost was found to have a negative correlation with safety scores(-0.1), suggesting that lower-cost projects may be associated with higher risk levels. These findings underscore the importance of developing tailored safety checklists that take into account the specific timing and scale of air conditioning installation projects. Additionally, the results suggest that incorporating both experienced(older) and less experienced(younger) safety managers into safety strategies may be beneficial for achieving optimal safety outcomes. This balanced approach could leverage the strengths of both groups, potentially enhancing overall risk assessment and mitigation efforts.

Fulfilling the Export Potential of Agricultural Production in the Context of Aggravating Global Food Crisis

  • Hassan Ali Al-Ababneh;Ainur Osmonova;Ilona Dumanska;Petro Matkovskyi;Andriy Kalynovskyy
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.7
    • /
    • pp.128-142
    • /
    • 2024
  • Creation and implementation of export-oriented strategy is an urgent issue of economic development of any country. In an export-oriented model of economic development, exports should be a means of promoting economic growth and a tool to strengthen existing and potential competitive advantages. Agricultural production is the key factor in exports and the source of foreign exchange earnings in many countries. However, the export potential of agricultural producers may be inefficiently fulfilled due to the heterogeneity of countries in terms of economic development, trade relations and border policy. The aim of the research is to study the nature, main trends and problematic aspects of fulfilling the export potential of agricultural production in the context of aggravating food crisis. The study involved general scientific methods (induction and deduction, description, analysis, synthesis, generalization) and special (statistical method, economic analysis, descriptive statistics and interstate comparisons, graphical method). The need to ensure food security by countries around the world urges the importance of the agricultural sector as a catalyst for economic development, sources of foreign exchange earnings, investment direction, etc. The study of agricultural specialization led to the conclusion that wheat and sugar are goods with the highest export potential. It is substantiated that the countries of South America, OECD, North America and Europe have the highest level of realization of export potential of agricultural production, and African countries are import-dependent. In addition, the low export orientation of Africa and Asia due to the peculiarities of their natural and climatic conditions is established based on the assessment of export-import operations in the regional context. The internal and external export potential of each of the regions is analysed. Economic and mathematical simulation of assessing the impact of the most important factors on the wheat exports volumes was applied, which allowed predicting wheat exports volume and making sound management decisions regarding the realization of the export potential of agricultural companies. The inverse correlation between the exports volume and wheat consumption per capita, and the direct correlation between the effective size and area of land used for wheat cultivation was established through the correlation and regression analysis.

Instrument Development and Analysis for Mathematical Learning Motivation and Causal Attribution (수학 학습 동거와 귀인의 측정 도구 개발 및 분석)

  • Lee, Chong-Hee;Kim, Bu-Mi
    • Journal of Educational Research in Mathematics
    • /
    • v.20 no.3
    • /
    • pp.413-444
    • /
    • 2010
  • The purpose of the present study is to develop an instrument of mathematical learning motivation and causal attribution for students and to analyze the results of the instrument. Based on the literature review, mathematical learning motivation is the cumulative effects of self-assessment and self-regulation in mathematical learning and achievement experience. Three factors of mathematical learning motivation is identified as self-regulatory efficacy, task difficulty and mathematical anxiety with 17 self-regulatory efficacy items, 9 task difficulty items and 9 mathematical anxiety items. Three factors of causal attribution for success is identified as ability/effort, luck, and other person with 6 ability/effort items, 4 luck items and 3 other person items. Also, four factors of causal attribution for failure is identified as ability, effort, luck, and other person with 3 ability items, 7 effort items, 3 luck items and 4 other person items. The instrument of mathematical learning motivation and causal attribution for success and failure was administered to 919 middle school students from eight different middle middle schools in Seoul, Gyeonggi-Do, Busan, jeolla-Do area. The correlation of three factors of mathematical learning motivation was calculated. As a result, a positive correlation between self-regulatory efficacy and task difficulty was appeared but mathematical anxiety has a negative correlation with self-regulatory efficacy and task difficulty. This study also examined the differences about mathematical learning motivation's sub-factors shown by three groups of mathematics achievement level. Students of higher achievement level showed that the degree of self-regulatory efficacy and task difficulty was higher than that of lower level group. Students of lowest achievement level showed significantly higher mathematical anxiety degree than that of middle and high group. Students that have higher degree of self-regulatory efficacy and task difficulty preference were attributed into ability/effort cause toward success of mathematics achievement. Also, Male students preferred more difficult task and higher degree of self-regulatory efficacy in mathematics learning than female students. On the contrary, Female students showed higher mathematical anxiety level than male students.

  • PDF

Development of Korean Neurobehavioral Test Battery -Assessment of the Validity of Traditional and Computerized Neurobehavioral Tests- (한국형 신경행동검사 배터리의 개발 -면접과 컴퓨터 신경행동검사의 타당성 평가-)

  • Chung, Jong-Hak;Kim, Chang-Yoon;SaKong, Joon;Jeon, Man-Joong;Park, Hong-Chin
    • Journal of Preventive Medicine and Public Health
    • /
    • v.31 no.4 s.63
    • /
    • pp.692-707
    • /
    • 1998
  • Aim. A neurobehavioral test for workers exposed to organic solvents in the workplace can be affected by many factors : age, education, motivation, ethnicity, etc. To apply more suitable neurobehavioral test for Korean workers, we evaluated the validity of several items of computerized and traditional neurobehavioral tests. Methods. We have applied eleven tests : four items of computerized neurobehavioral test(Swedish Performance Evaluation System) including Addition, Symbol-Digit, Dig-it Span, and Finger tapping speed, and seven items of traditional neurobehavioral test consisting of Addition, Digit-Symbol, Digit Span, Benton visual retention test, Pursuit aiming, Pegboard, and Tapping. These tests were performed on 96 workers exposed to solvents, and 100 reference workers. The concurrent and construct validities were evaluated by group difference, correlation with age, educational level, hippuric acid level, neurotoxic symptom, current exposure level, multitrait-multimethod matrix, fator analysis, and discriminant analysis. Results. Statistically significant differences were observed between the workers exposed to solvents and referents in computerized Symbol-Digit, Finger tapping speed, traditional Digit-Symbol and Pegboard. The computerized Symbol-Digit, traditional Digit-Symbol, Addition, Benton visual retention test, and Pegboard were found to be related to the age. The performance of computerized Symbol-Digit, Addition, and traditional Digit-Symbol were found to be related to the educational level significantly. The computerized Symbol-Digit, Finger tapping speed, and traditional Digit-Symbol were found to be related to hippuric acid, and neurotoxic symptom. The discriminability of Finger tapping speed, and Pegboard was better than the other tests. In discriminant analysis, the model with two variables, the computerized Symbol-Digit and Pegboard, classified almost 70 percent of the workers correctly. Conclusions. These results suggest that the computerized Symbol-Digit, Finger tapping speed, and Pegboard are more satisfactory for our purpose, and the Addition, Tapping, Benton visual retention test, and Pursuit aiming are less valid than other items. These may allow the reasonable selection of core neurobehavioral tests for workers exposed to solvents in Korea.

  • PDF

Development and Application of Scientific Inquiry-based STEAM Education Program for Free-Learning Semester in Middle School (중학교 자유학기제에 적합한 과학 탐구 중심의 융합인재교육 프로그램 개발 및 적용)

  • Jeong, Hyeondo;Lee, Hyonyong
    • Journal of Science Education
    • /
    • v.41 no.3
    • /
    • pp.334-350
    • /
    • 2017
  • The purposes of this study are to develop scientific-inquiry based on STEAM education program and to investigate the effects of the program on middle-school students' interests, self-efficacy, and career choice about science, technology/engineering, and mathematics. In order to develop this program, the literature investigation and previous studies were conducted, so that finally the developmental direction was based on scientific inquiry and the developmental theme and model were selected. A total 92 first-graders in G middle-school of Daegu city were participated in this study. A single group pre-post test paired t-test was conducted to figure out changes of students' interest, self-efficacy, and career choices before or after applying this program. In addition, in-depth interviews were conducted with 14 students to find their specific responses. The results of this study were as follows. First, STEAM education program on the theme of 'RC Airplane' was developed on the basis of the 'ADBA' model. Second, the developed STEAM educational program not only results a decisive difference statistically but also has significant effects on middle-school students' interests, self-efficacy, and career choice in science, technology/engineering, and mathematics, who are involved in the free-semester program, across the overall affective domain. In conclusion, the STEAM educational program in this study could affect significant meanings to middle-school students during the free-semester. It could contribute to facilitate middle-school students' education for happiness and to grow the creative STEAM talents.