• Title/Summary/Keyword: PPL Training

Search Result 2, Processing Time 0.014 seconds

Evaluating the Impact of Training Conditions on the Performance of GPT-2-Small Based Korean-English Bilingual Models

  • Euhee Kim;Keonwoo Koo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.9
    • /
    • pp.69-77
    • /
    • 2024
  • This study evaluates the performance of second language acquisition models learning Korean and English using the GPT-2-Small model, analyzing the impact of various training conditions on performance. Four training conditions were used: monolingual learning, sequential learning, sequential-interleaved learning, and sequential-EWC learning. The model was trained using datasets from the National Institute of Korean Language and English from BabyLM Challenge, with performance measured through PPL and BLiMP metrics. Results showed that monolingual learning had the best performance with a PPL of 16.2 and BLiMP accuracy of 73.7%. In contrast, sequential-EWC learning had the highest PPL of 41.9 and the lowest BLiMP accuracy of 66.3%(p < 0.05). Monolingual learning proved most effective for optimizing model performance. The EWC regularization in sequential-EWC learning degraded performance by limiting weight updates, hindering new language learning. This research improves understanding of language modeling and contributes to cognitive similarity in AI language learning.

The Effect of Studying Flight Training Materials utilizing Encoding Techniques on Situational Awareness Capabilities of Students in PPL Training

  • Moon, Jeong Yoon;Lee, Jang Ryong
    • Journal of the Korean Society for Aviation and Aeronautics
    • /
    • v.28 no.4
    • /
    • pp.154-163
    • /
    • 2020
  • The pilot's aeronautical decision-making during the flying greatly affects flight safety, and the importance of situational awareness has been greatly emphasized as a prerequisite for making the right decision. This is the reason why more research and interests are needed to help students entering the pilot training program develop excellent situational awareness from the initial stage of training. Situational awareness is closely related to long-term memory activities in human information processing, and pedagogy and cognitive psychology have emphasized the encoding techniques as an effective long-term memory method. This study was conducted to confirm whether pilot students' using the encoding techniques to learn flight education materials in the early stage of their training at domestic universities has a positive effect on improving their situational awareness.