• Title/Summary/Keyword: Assessments, Educational

Search Result 109, Processing Time 0.029 seconds

Automatic scoring of mathematics descriptive assessment using random forest algorithm (랜덤 포레스트 알고리즘을 활용한 수학 서술형 자동 채점)

  • Inyong Choi;Hwa Kyung Kim;In Woo Chung;Min Ho Song
    • The Mathematical Education
    • /
    • v.63 no.2
    • /
    • pp.165-186
    • /
    • 2024
  • Despite the growing attention on artificial intelligence-based automated scoring technology as a support method for the introduction of descriptive items in school environments and large-scale assessments, there is a noticeable lack of foundational research in mathematics compared to other subjects. This study developed an automated scoring model for two descriptive items in first-year middle school mathematics using the Random Forest algorithm, evaluated its performance, and explored ways to enhance this performance. The accuracy of the final models for the two items was found to be between 0.95 to 1.00 and 0.73 to 0.89, respectively, which is relatively high compared to automated scoring models in other subjects. We discovered that the strategic selection of the number of evaluation categories, taking into account the amount of data, is crucial for the effective development and performance of automated scoring models. Additionally, text preprocessing by mathematics education experts proved effective in improving both the performance and interpretability of the automated scoring model. Selecting a vectorization method that matches the characteristics of the items and data was identified as one way to enhance model performance. Furthermore, we confirmed that oversampling is a useful method to supplement performance in situations where practical limitations hinder balanced data collection. To enhance educational utility, further research is needed on how to utilize feature importance derived from the Random Forest-based automated scoring model to generate useful information for teaching and learning, such as feedback. This study is significant as foundational research in the field of mathematics descriptive automatic scoring, and there is a need for various subsequent studies through close collaboration between AI experts and math education experts.

Gross, organoleptic and histologic assessment of cadaveric equine heads preserved using chemical methods for veterinary surgical teaching

  • Rodrigo Romero Correa;Rubens Peres Mendes;Diego Darley Velasquez Pineros;Aymara Eduarda De Lima;Andre Luis do Valle De Zoppa;Luis Claudio Lopes Correia da Silva;Ricardo de Francisco Strefezzi;Silvio Henrique de Freitas
    • Journal of Veterinary Science
    • /
    • v.25 no.2
    • /
    • pp.29.1-29.11
    • /
    • 2024
  • Background: Preservation of biological tissues has been used since ancient times. Regardless of the method employed, tissue preservation is thought to be a vital step in veterinary surgery teaching and learning. Objectives: This study was designed to determine the usability of chemically preserved cadaveric equine heads for surgical teaching in veterinary medicine. Methods: Six cadaveric equine heads were collected immediately after death or euthanasia and frozen until fixation. Fixation was achieved by using a hypertonic solution consisting of sodium chloride, sodium nitrite and sodium nitrate, and an alcoholic solution containing ethanol and glycerin. Chemically preserved specimens were stored at low temperatures (2℃ to 6℃) in a conventional refrigerator. The specimens were submitted to gross and organoleptic assessment right after fixative solution injection (D0) and within 10, 20, and 30 days of fixation (D10, D20, and D30, respectively). Samples of tissue from skin, tongue, oral vestibule, and masseter muscle were collected for histological evaluation at the same time points. Results: Physical and organoleptic assessments revealed excellent specimen quality (mean scores higher than 4 on a 5-point scale) in most cases. In some specimens, lower scores (3) were assigned to the range of mouth opening, particularly on D0 and D10. A reduced the range of mouth opening may be a limiting factor in teaching activities involving structures located in the oral cavity. Conclusions: The excellent physical, histologic, and organoleptic characteristics of the specimens in this sample support their usability in teaching within the time frame considered. Appropriate physical and organoleptic characteristics (color, texture, odor, and flexibility) of the specimens in this study support the use of the method described for preparation of reusable anatomical specimens.

The impact of conversion and sanctification-centered educational programs on youth spirituality : Focusing on Camp 'A' (회심 및 성화 중심의 교육 프로그램이 청소년의 영성에 미치는 영향 : A캠프를 중심으로)

  • Minho Kim
    • Journal of Christian Education in Korea
    • /
    • v.76
    • /
    • pp.237-258
    • /
    • 2023
  • Purpose of Research: This study examines how an intensive Christian program focused on conversion and sanctification impacts youth spirituality. While previous research was qualitative, looking at program design and family-church ties, this research provides a needed quantitative analysis of the program's effect on youths' spiritual development. Research content and method: The research, centering on 'A' Camp's focus on conversion and sanctification, used a pre-post test model with Lee and Kim's metrics to gauge youth spirituality. Conducted in a 2023 summer camp, assessments on days one and three yielded 109 valid questionnaires, analyzed via paired t-tests. As a result of the analysis, relationship with God t=-9.65, traditional faith t=-6.22, influence of spirituality t=-6.35, religious activity t=-8.32, experience of transcendent power t=-8.67, living righteously t=-8.04 It was statistically significant in all areas. Conclusion and Recommendation: The study confirmed that programs emphasizing conversion and sanctification markedly improve youth spirituality, notably enhancing experiences of God and righteous living via the Holy Spirit. These findings are pivotal for guiding future youth education programs, especially those conducted in camp settings.

Exploring Differences of Student Response Characteristics between Computer-Based and Paper-Based Tests: Based on the Results of Computer-Based NAEA and Paper-Based NAEA (컴퓨터 기반 평가와 지필평가 간 학생 응답 특성 탐색 -컴퓨터 기반 국가수준 학업성취도 평가 병행 시행 결과를 중심으로-)

  • Jongho Baek;Jaebong Lee;Jaok Ku
    • Journal of The Korean Association For Science Education
    • /
    • v.43 no.1
    • /
    • pp.17-28
    • /
    • 2023
  • In line with the entry into the digital-based intelligent information society, the science curriculum emphasizes the cultivation of scientific competencies, and computer-based test (CBT) is drawing attention for assessment of competencies. CBT has advantages to develop items that have high fidelity, and to establish a feedback system by accumulating results into the database. However, it is necessary to solve the problems of improving validity of assessment results, lowering measurement efficiency, and increasing management factors. To examine students' responses to the introduction of the new assessment tools in the process of transitioning from paper-based test (PBT) to CBT, in this study, we analyzed the results of the PBT and the CBT conducted in 2021 National Assessment of Educational Achievement (NAEA). In particular, we sought to find the effects on student achievement when only the mode of assessment was changed without change of items, and the effect on student achievement when the items were composed including technology enhanced features that take advantage of CBT. This study is derived through the analysis of the results of 7,137 third-grade middle school students taking one among the three kinds of assessments, which were the PBT or two kinds of CBT. After the assessment, the percentage of correct answers and the item discriminations were collected for each group, and expert opinions on characteristics of response were collected through the expert council involving 8 science teachers with experience in NAEA. According to the results, there was no significant difference between students' achievement results in the PBT and the CBT-M, which means simple mode conversion type of CBT, so it could be explained that the mode effect did not appear. However, it was confirmed that the percentage of correct answers for the construct response items was somewhat high in the CBT, and this result was analyzed to be related to the convenience of the response. On the other hand, there were the items with a difference of more than 10%p from the correct answer rate of similar items, among the items to which technology enhanced functions were applied following the introduction of CBT. According to the analysis of response rate of options, these results could be explained that the students' level of understanding could be more closely grasped through the innovative items developed through the technology enhanced function. Based on the results, we discussed some guidance to be considered when introducing CBT and developing items through CBT, and presented implications.

A Study on Development of Achievement Standards and Assessment Standards of Vocational Inquiry Section for 2005 College Scholastic Ability Test - Focus on Food and Nutrition Subject in the Field of Home Economics Order - (2005 수능 직업탐구영역의 과목별 성취기준과 평가기준 개발 - 식품과 영양 과목을 중심으로 -)

  • Na Hyeon-Ju;Min Kyung-Hee;Lee Hwa-young;Pyo Jum-sun;Ha Mi-ok;Jang Myung-Hee
    • Journal of Korean Home Economics Education Association
    • /
    • v.17 no.2
    • /
    • pp.197-219
    • /
    • 2005
  • This study attempted, in accordance with the National Educational Curriculum, to develop achievement assessment standards for a course within the field of home economics which has been widely adopted by Korean vocational high schools, namely, the food and nutrition subject. Focus was also placed on strengthening the management of the curriculum for this food and nutrition course, as well as on establishing proper assessment standards by developing model assessment tools which can be used to assess the subject. The results of this study can be summarized as follows : First, based on an analysis of the related literature and materials. the desired notion of the achievement and assessment standards was established, and their significance ascertained the achievement and assessment standards for the food and nutrition course were set and the type of model assessment tool which should be developed, as well as the method in which it should be applied. was established Second. by analyzing the curriculums and the contents of the textbooks used in the food and nutrition subject, the researcher was able to compile the 70 factors which could to be used to develop the achievement and assessments standards, and then classify these into 6 main categories and 32 sub-categories. Based on the characteristics of these factors and learners' academic performance levels the number of factors was expanded to 89 in order to establish the achievement standards. In turn, these achievement standards were used, in accordance with the learners' achievement and teaming activity levels, to develop three different levels of assessment standards. namely, upper, middle, and lower ones. Third. a model assessment tool was developed which could be used by individual school units as a reference in terms of achievement and assessment standards, and that could be modified to meet each school's circumstances. In order to create the model assessment tool a 100-question questionnaire was formulated that contained various types of questions, such as essay, report, theoretical and practical, portfolio, as well as multiple choice-type questions. Lastly, the researcher introduced measures to effectively use the achievement and assessment standards developed for the food and nutrition course, as well as the model assessment tool in school units.

  • PDF

A Narrative Inquiry of the Identities of Male Home Economics Teachers (남자 가정과교사의 정체성에 대한 내러티브 탐구)

  • Ahn, Jae Hyun;Park, Mi Jeong
    • Journal of Korean Home Economics Education Association
    • /
    • v.32 no.2
    • /
    • pp.159-178
    • /
    • 2020
  • This study aimed at exploring male home economics(HE) teachers' identities through narrative inquiry. Considering experiences of HE teachers and diversity in regions, twelve male teachers were chosen, and in-depth interviews were conducted between June 1st and July 31st, 2019. The transcription of the data was transferred to the Hancom Office Hangeul 2010 while the researcher listened to the recordings of the interviews. The total amount of transcription data was 174 pages, and the data were analyzed through open coding, categorization, and category verification. The themes identified as results of this study were as follows: First, 'Coincidence: Breaking the Wall of Prejudice' is related to the experiences that have a great influence on the formation of identity as a male HE teacher: motivation to enter the HE department, educational practice, etc. Through this, the experience of becoming a male HE teacher was recorded. Second, 'Facing: Surviving as a male HE Teacher' captures the current story of male HE teachers and the perspectives of their fellow teachers, family, and friends about male HE teachers. In this section, male HE teachers showed how HE classes and assessments, and their experiences in their lives, influenced their identities. Third, 'Expectations: Growing as a HE teacher' is a story about the future of male HE teachers. The ideal teacher image pursued by male HE teachers was a practical teacher. They hoped that in 10 or 20 years, they would have smooth and professional relationship with students. They advise prospective male HE teachers to become a competent HE teacher regard less of their gender. The significance of this study is that it broke the stereotype of 'HE teachers should be female' and expanded the horizon of HE education by exploring the identities of male HE teachers.

Meta-Analysis on Effectiveness of Intervention to Improve Patient Compliance in Korean (한국인 치료순응도 향상을 위한 개입 효과에 대한 메타분석)

  • 김춘배;조희숙;현숙정;박애화
    • Health Policy and Management
    • /
    • v.12 no.2
    • /
    • pp.23-42
    • /
    • 2002
  • The purpose of this study was to analyze the results of 133 studies related to patient compliance published between 1980 and 2001 and to assess the effectiveness of intervention on compliance by using meta-analysis. We collected the existing literatures by using web and manual search 'patient compliance', 'sick role behavior', 'major clinical disease', and 'intervention' as key words and by reviewing content of journals related to medicine, nursing and public health. The compliance interventions were classified by theoretical focus into educational, behavioral, and affective categories within which specific intervention strategies were further distinguished. The compliance indicators broadly represent five classes of compliance-related assessments: (1) health outcomes (eg, blood pressure and hospitalization), (2) direct indicators (eg, urine and blood tracers and weight change), (3) indirect indicators (eg, pill count and refill records), (4) subjective report (eg, patients' or others' reports), (5) utilization (appointment making and keeping, use of preventive services). Quantitative meta-analysis was performed by MetaKorea program which was developed for meta-analysis in Korea. Among the 133 articles, 10 studies were selected through the qualitative meta-analysis process, and then only 6 studies were selected for the quantitative meta-analysis finally. The interventions produced significant effects for all the compliance indicators with the magnitude of common effect size (4.1192) than the non-intervention group in a random effect model. The largest effects were each study for patient of hypertension using health outcome such as blood pressure (0.4679) and diabetes mellitus using direct indicator such as glucose level in blood and urine (0.7753). These results suggest that strategic interventions showed clear advantage for improvement of patient compliance compared with non-intervention group.

A Trend of Research in Community Health Nursing (지역사회간호학 관련 논문 연구동향 분석 -학회지 발표 논문을 중심으로-)

  • Lee, In-Sook;Kim, Yu-Na;Choi, Key-Won;Chin, Young-Ran
    • Research in Community and Public Health Nursing
    • /
    • v.12 no.1
    • /
    • pp.288-298
    • /
    • 2001
  • This article makes an attempt to evaluate the extent of developing community health nursing knowledge and to suggest the direction of developing a body of knowledge henceforth through the results of analysis for contents and outcomes of all literatures. which have been published in the Journal related to community health nursing. Refer to the following for the result of this article. 1. The total number of literatures analyzed amounted to 100 pieces in Journal of community health nursing society. 78 in Journal of industrial nursing society, 134 in Journal of school health society. 40 in Journal of home care nursing society. 2. Journal of community health nursing society Health needs and educational-behavioral diagnoses, which are more concrete nursing assessments and diagnoses. formed the main current(54%) of articles published in Journal of community health nursing society since 1992. There was a quantitative growth as well as a qualitative advance. Through a classification by the type of a body of knowledge. It was found that the knowledge providing nursing practice with bases, commanded an overwhelming majority(71.8%). Also, Researches on systemic supports for nursing practice are showing a tendency to increase. 3. Journal of industrial nursing society 52.6% of research papers presented in Journal of industrial nursing society dealt with health problem of workers. assessment of risk factors, diagnosis of health behaviors. Because of the beginning of an industrial nursing, the domain of nursing management to establish the role and task, work condition, training. documentary system made up 23 percent of research, subjects. A knowledge providing nursing practice with bases have a majority, 69.2%. In addition. the subject concerning a systemic support and quality assurance was scarce but continuously presented. 4. Journal of school health society The major point of this journal is the identification of health problems and risk factors which belong to assessment and diagnosis domain(56.8%) regardless of year, Because of the interdisciplinary characteristic. The knowledge on quality assurance of nursing practice is relatively rare. But, articles related to a systemic support is plentiful. 5. Journal of home care nursing society In its infancy, there was a large number of papers concerning need assessment and diagnosis, Comparing others, this journal has introduced a good many of articles related to program management. delivery system. service fee, etc that belong to domain of systemic support for nursing practice. 6. It is showing definitely that quantity and extent of research have grown for a short period. See the analysis in terms of nursing process, studies related to the domain of assessment and diagnosis command an absolute majority regardless of kinds of journal. Although articles referring to program management and implementation is increasing in number, it is scarce to evaluate a nursing program and grope for an improvement. Also, program development based on a theoretical framework is little. Therefore much more scientific effort to ensure profession should be executed. 7. In the methodological aspect, longitudinal study needs to be carried out so that we could show the evidence based nursing theory. To develop a more general theory, we have to conduct a study of various subjects and improve a validity of tools through a repeat test. In addition, the effort for interdisciplinary cooperation is needed.

  • PDF

Development of the Values and Assessment Indicators of Traditional Temple Area - Focused on In-depth Interview, Focus Group Interview, and Pairwise Comparison - (전통사찰 보존지의 가치 및 평가지표 도출 - 심층인터뷰, 포커스 그룹 인터뷰, 쌍체비교를 중심으로 -)

  • Yi, Young Kyoung
    • Journal of the Korean Institute of Traditional Landscape Architecture
    • /
    • v.35 no.4
    • /
    • pp.14-28
    • /
    • 2017
  • Currently, the object of conservation in heritage conservation is defined as "the value of the heritage" and the value-based management plan has been introduced. Most of traditional temples in korea have been sustained over 1000 years, which make them mixed heritages, including cultural, religious and natural heritages. Therefore, traditional temples should be managed by value-based management plans. This article aims to develop the values and assessment indicators of traditional temple areas and to evaluate the importances of the values and indicators, in order to prepare the basic materials for conserving the values of traditional temples. This study used the diverse research methods such as literature review, in-situ survey, in-depth interview, focus group interview, questionnaire survey. The results showed that the identified values and assessment indicators of traditional temple area were defined as three classes: high class value was consisted of intrinsic value and use value, middle class values were 10 (5 for intrinsic and 5 for use value). 5 middle class values belonging to the intrinsic value were religious/humanity, historical, cultural, environmental/ecological, landscape values. 5 values constituting the use value were social, educational, therapeutic, recreational, and economic values. As a low class, 102 assessment indicators were identified. 60 participants (30 buddhism people, 30 KNPS people) evaluated the importances of the developed values and indicators, using the pairewise comparison for the values and the interval scale for the indicators. It was found that both groups evaluated the use value more important than the intrinsic value and that religious/humanity, landscape, environmental/ecological, economic, recreational values were evaluated more important than the other middle class values. It was also revealed that the two groups were different in their assessments of the indicators. Based on the results, some suggestions were made to improve the management of the traditional temple areas.